[yocto] QA cycle report for 2.7 M2 RC1

[Jain, Sangeeta]

Hello All,



This is the full report for 2.7 M2 RC1:



https://wiki.yoctoproject.org/wiki/WW01_-_2019-01-28_-_Full_Test_Cycle_2.7_M2_RC1



======= Summary ========



All planned tests were executed.

Total Test Executed - 3629

Passed Test - 3613

Failed Test - 16





There were zero high milestone defect.  Team had found 3 new defects in BSP[1], Compliance [2] and  OE-Core[3].

5 existing issues were observed in this release.



For ptest, there is a drop in percentage of pass rate for 3 modules: nettle, perl and valgrind. Bugs are reported for Nettle [4] and Perl [5]. For Valgrind, no bug is filed, since there is a decrease in percentage but no failures as compared to previous results.



======= QA-Hints========



  1.  No high milestone defect.
  2.  For performance test results, this time there is a new machine "pokybuild at perf-centos7.yoctoproject.org" introduced in performance test results from Yocto-perf mailing list. And results from "Yocto CentOS 7 Build Perf Tester" is missing for this release. Hence, the comparison between results from two "centos7" machines shows huge differences.



======= Bugs ========



New Bugs

[1] Bug 13153 - [2.7 M2 RC1] Systemtap doesn't work on beaglebone

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13153



[2] Bug 13160 - [2.7_m2_rc1][compliance test][LSB Test] "Failed to load module Core_test.pm, samba_test.pm", LSB Test has failed"

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13160



[3] Bug 13161 - [2.7 M2 RC1] Perl can not handle signals

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13161



ptest Bugs:



[4] Bug 13155 - [2.7 M2 RC1] nettle ptest failure

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13155





[5] Bug 13154<https://bugzilla.yoctoproject.org/show_bug.cgi?id=12991> - [2.7 M2 RC1] perl ptest failure

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13154





Previous Bugs observed in this release:



[6] Bug 13102 - [Bug][QA 2.7 M1 rc1][Toaster] All layers are not getting populated after clicking "View compatible layers" on project page

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13102



[7] Bug 13103 - [Bug][QA 2.7 M1 rc1][Toaster] "Recipes" table  and  "machines" table are not getting populated after clicking on imported layer as well as after clicking Machines Tab on project page

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13103



[8] Bug 13104 - [Bug][QA 2.7 M1 rc1][Toaster] All "Image Recipes" are not getting populated after clicking  "Image Recipes"  on project page

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13104



[9] Bug 12991<https://bugzilla.yoctoproject.org/show_bug.cgi?id=12991> - [Bug] [2.6 M4 RC1][Build-Appliance] Bitbake build-appliance-image getting failed during building image due to webkitgtk package.

https://bugzilla.yoctoproject.org/show_bug.cgi?id=12991



[10] Bug 12499<https://bugzilla.yoctoproject.org/show_bug.cgi?id=12991> - [Bug] [2.5 M1 RC3] qemuarm: failed to shutdown.

https://bugzilla.yoctoproject.org/show_bug.cgi?id=12499






Thanks & Regards,
Sangeeta Jain
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20190208/101b0348/attachment-0001.html>