[yocto] QA Tests in Yocto development environment block diagram

[Dilip Kumar]

Dear corneliux

Thanks a lot for your response with clear and detailed information.

Regards

Dilip Kumar b


On Thursday, November 21, 2013, Stoicescu, CorneliuX wrote:

>  Hello Dilip,
>
>
>
> I will try and answer as much as I can on behalf of Alex:
>
>
>
> We have 2 types of tests:
>
> 1)      Buildtime
>
> 2)      Runtime
>
>
>
> Each type of test has 2 main categories(from a QA point of view):
>
> -          Automated
>
> -          Manual
>
>
>
> Here is where you can find each:
>
>
>
> -          Automated Buildtime:
>
> o   Sanity tests(run for every build):
>
> §  In the Yocto sources: meta/classes/sanity.bbclass
>
> §  In the Yocto sources: meta-yocto/classes/poky-sanity.bbclass
>
> §  There are other many various sanity checks done explicitly throughout
> poky. I do not have the knowledge to get in more detail on this though.
>
> o   We are working on a new feature that will add automated “gray box”
> buildtime tests: https://bugzilla.yoctoproject.org/show_bug.cgi?id=4740
>
>
>
> -          Automated Runtime:
>
> o   Automated image tests:
>
> §  Covers only QEMU(virtual) targets
>
> §  After building an image, if the correct configuration is set, it will
> boot up and tests will be run on it consisting of commands sent over ssh
>
> §  The tests can be found in the Yocto sources: meta/lib/oeqa/runtime/
>
> §  This uses the ‘testme.bbclass’ from /meta/classes/testme.bbclass
>
> §  More documentation on this feature can be found here:
> https://wiki.yoctoproject.org/wiki/Image_tests
>
> §  The test cases are also described in Testopia:
> https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=18
>
> ·         Note that this source contains both manual and automated tests
>
> §  We are working on a new feature to expand these tests to BSP(hardware)
> targets: https://bugzilla.yoctoproject.org/show_bug.cgi?id=1596
>
> o   Package testing
>
> §  Documentation: https://wiki.yoctoproject.org/wiki/Ptest
>
>
>
> -          Manual Buildtime:
>
> o   Can be found in Testopia:
> https://bugzilla.yoctoproject.org/tr_show_product.cgi
>
> §  At the moment the following buildtime products in Testopia contain
> tests:
>
> ·         ADT:
> https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=1
>
> ·         Eclipse Plugin:
> https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=5
>
> ·         HOB:
> https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=8
>
> ·         OE-CORE:
> https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=25
>
> ·         Meta-Yocto:
> https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=26
>
> ·         Bitbake:
> https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=9
>
> ·         Build Appliance:
> https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=28
>
>
>
> -          Manual Runtime:
>
> o   Covers BSP(hardware) and QEMU(virtual) targets
>
> o   Can be found in Testopia:
> https://bugzilla.yoctoproject.org/tr_show_product.cgi
>
> §  At the moment the following runtime products in Testopia contain tests:
>
> ·         BSP:
> https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=18
>
> ·         Runtime(mostly performance and compliance tests):
> https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=34
>
> o   Note that this source contains both manual and automated tests
>
>
>
> I hope I did not miss anything and that I was clear in my description. If
> you need any more information, please don’t hesitate to ask!
>
>
>
> Regards,
>
> Corneliu
>
> Romania Yocto QA
>
>
>
>
>
> Dear Alex,
>
> Thank you for your response.
>
> And I need to know one more thing whether these QA tests are done manually
> or it's automated during the build or its done separately by Yocto for
> particular distribution?
>
> Is there any Q
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20131125/ce9d861e/attachment.html>