[Automated-testing] WG: Automated testing with LAVA

[Markus Boos]

Hi 

I asked a similar question as in Bug 6335 [1] on the oe-core mailing list [2].

Is there any progress for the opkg packages?

BR
Markus

[1]: https://bugzilla.yoctoproject.org/show_bug.cgi?id=6335
[2]: http://lists.openembedded.org/pipermail/openembedded-core/2015-January/101205.html


> -----Ursprüngliche Nachricht-----
> Von: Stoicescu, Corneliu [mailto:corneliu.stoicescu at intel.com]
> Gesendet: Montag, 8. September 2014 12:14
> An: Alan Bennett; Boos Markus
> Cc: Musat, George L
> Betreff: RE: [Automated-testing] Automated testing with LAVA
> 
> Hello,
> 
> 
> 
> Aside the LAVA discussion, I would like to note that we are working on a feature to
> parse ptest and other results-based logs (example: LSB, LTP, stress tests) into a
> common format for further interpretation. Here are the feature requests and some
> initial proposed patches for it:
> 
> http://lists.openembedded.org/pipermail/openembedded-core/2014-
> September/096693.html
> 
> http://lists.openembedded.org/pipermail/openembedded-core/2014-
> September/096692.html
> 
> 
> 
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=4114
> 
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=6336
> 
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=6335
> 
> 
> 
> This feature should be available in the 1.7 release to use as part of the automated
> runtime testing framework integrated in Poky.
> 
> 
> 
> If you are interested in the development of our work I hope we can contribute to each
> other’s progress in this direction.
> 
> 
> 
> Regards,
> 
> Corneliu
> 
> Yocto QA
> 
> 
> 
> From: automated-testing-bounces at yoctoproject.org [mailto:automated-testing-
> bounces at yoctoproject.org] On Behalf Of Alan Bennett
> Sent: Thursday, September 04, 2014 8:24 PM
> To: Markus Boos
> Cc: automated-testing at yoctoproject.org
> Subject: Re: [Automated-testing] Automated testing with LAVA
> 
> 
> 
> Hi Markus;
> 
> 
> 
> On 4 September 2014 06:02, Markus Boos <Markus.Boos at kistler.com> wrote:
> 
> Hi Folks
> 
> I'm Test Manger in a company using Yocto for several products.
> And we are start to setup an automated test environment for those products as well.
> 
> > -----Ursprüngliche Nachricht-----
> > Von: automated-testing-bounces at yoctoproject.org
> > [mailto:automated-testing- bounces at yoctoproject.org] Im Auftrag von
> > Paul Eggleton
> > Gesendet: Donnerstag, 4. September 2014 13:23
> > An: automated-testing at yoctoproject.org
> > Cc: Chase Maupin; Ionut Chisanovici; Catalin Scrieciu
> > Betreff: [Automated-testing] Automated testing with LAVA
> 
> >
> > Hi folks,
> >
> > As some of you may know, over the last few months we've been working
> > through some exercises with LAVA attempting to see how it could be
> > integrated into the Yocto Project QA workflow. At this point I think
> > we've reached some conclusions about how it's currently working, and
> > I'd like to schedule a meeting to discuss that with interested parties
> > some time next week (perhaps on a hangout as previously?)
> >
> > It also strikes me that this mailing list has gone a little quiet
> > lately, we've not had a meeting for a while and I've not really heard
> > anything from other folks working on LAVA integration - it would be good to get an
> update on how that is going.
> 
> We do not work on LAVA integration cause our test system should work with dll's and
> other nasty stuff like NI cards. So we are focusing on using robot framework for our
> purpose.
> 
> Furthermore we may extend the ptest feature with black/with listing packages and
> have the result available in xUnit format to merge them easily into our management
> tools.
> Someone interested in such extensions of the ptest feature?
> 
> 
> 
> I definitely would like to know what your plans are here.  I think the biggest value of
> any automation system is ultimately the test portfolio and I'd love to be able to run
> and trend each nightly build's ptest results.  However, based on the few ptest
> samples I looked at it's not going to be 100% straightforward.  The heavy use of
> special characters and repetition / nesting will require us to create a pretty smart
> state machine to parse through the results, and though it's not necessarily difficult, ...
> 
> 
> 
> 	>
> 	> Could you let me know your availability for a meeting next week (especially
> those on
> 	> CC, but others are welcome)? I would tentatively suggest Friday UK
> evening / US
> 	> Pacific morning time - would that work?
> 	>
> 	> Thanks,
> 	> Paul
> 	>
> 	> --
> 	>
> 	> Paul Eggleton
> 	> Intel Open Source Technology Centre
> 
> 	> --
> 	> _______________________________________________
> 	> automated-testing mailing list
> 	> automated-testing at yoctoproject.org
> 	> https://lists.yoctoproject.org/listinfo/automated-testing
> <https://lists.yoctoproject.org/listinfo/automated-testing>
> 
> 	Cheers
> 	Markus
> 	--
> 	_______________________________________________
> 	automated-testing mailing list
> 	automated-testing at yoctoproject.org
> 	https://lists.yoctoproject.org/listinfo/automated-testing
> 
> 
> 
> 
> 
> 
> 
> --
> 
> Alan Bennett, Director of Product Technology Linaro.org <http://www.linaro.org/>  │
> Open source software for ARM SoCs | Follow Linaro: Facebook
> <http://www.facebook.com/pages/Linaro>  | Twitter
> <http://twitter.com/#%21/linaroorg>  | Blog <http://www.linaro.org/linaro-blog/>
> irc: akbennett | alan.bennett at linaro.org <mailto:alan.bennett at linaro.org>  | linaro
> toolchain, linaro stable kernel & linaro lava