[Lustre-discuss] lustre-discuss at lists.lustre.org

[Chris Gearing]

Hi Aurélien,

Do you have a specification for the junit test results you produce, or 
an example of one of your test results sets. We would be more than
willing to pick up and go with something that can be used with a wider 
set of tools, with the obvious caveat that it provides everything needed 
to completely capture the test results for Lustre today and in the future.

If you have some example results set's that you can forward please mail 
them to chris whamcloud.com

Thanks

Chris

I see that PerfPublisher uses xml, although this seems to be the only 
specification.

On 17/12/2010 20:11, Aurélien wrote:
>> Robert Read a écrit :
>>> We don't plan to use Hudson to manage our testing results as I don't 
>>> think it would scale very well for all the testing we might do for 
>>> each build. We're currently building a more custom results server 
>>> that's similar (in spirit at least) to the kinds of tools we had at 
>>> Oracle.  We'll make it available once it's in presentable form.
>>> Actually, our first step was to replace the acceptance-small.sh 
>>> driver script with one that has a more sensible user interface for 
>>> running the standard tests.  Since the test-framework.sh on master 
>>> has already been changed to produce test results in yaml format, 
>>>  the new script collects these with the logs, and is capable of 
>>> submitting them to the test results server.   Currently this is 
>>> being run manually, though.  Automating the test execution and 
>>> connecting all the pieces will be next step.
>> Ok. I will be very interested in seeing the final result.
>> But I think it is a good idea to stick to standard format and tools 
>> as much as possible. This could be a pity if all your new work will 
>> be only usable by  your tool.
>>
>> Junit is quite standard.
>> PerfPublisher has its own format due to junit limitations. There is 
>> other ones. It could be really good if you do not create a new one.
>>
>> And indeed, acc-sm is a bit limited and improve it could be really 
>> interesting.
>>
>>
>> Aurélien
>
>