[yocto] QA cycle report for 2.6 M3 RC1

[Jain, Sangeeta]

Hello All,



This is the full report for 2.6 M3 RC1:

https://wiki.yoctoproject.org/wiki/WW41_-_2018-10-03_-_Full_Test_Cycle_2.6_M3_RC1





Summary



All planned tests were executed.



Total Test Executed - 3358

Passed Test - 3332

Failed Test - 20

Blocked Test - 6



There were zero high priority defect.  Team had found 5 new defects. ptest for 8 modules failed in current release but passed in previous 2.6 M1 rc1.  Present status of bugs for respective modules is as  follows:



ModuleName  -  BugId  -  Present Status



e2fsprogs        - 12946     - Accepted, in discussion

gdbm              - 12954     - New

glib-2.0              - 12851     - Won't fix

pango                - 12947     - Fixed

perl                    - 12787      - Accepted for previous release; Failures observed in current release also

python              - 12788     - Fixed

strace               - 12948     - New

valgrind           - 12837      - New (Bug is open since 2.6 M1)



Performance test :  rootfs performance on ubuntu1604 degraded by  11.05% in 2.6 M3 RC1 w.r.t. 2.6 M2 RC1



QA-Hints



Team has observed in ptest report,  it is showing that "openssl" is not executed for current release.

But while analyzing ptest logs, following is mentioned in summary for openssl:

Test Summary Report

-------------------

../test/recipes/01-test_symbol_presence.t        (Wstat: 512 Tests: 4 Failed: 2)

  Failed tests:  2, 4

  Non-zero exit status: 2

Files=152, Tests=1360, 71 wallclock secs ( 1.41 usr  0.14 sys + 69.96 cusr 13.14 csys = 84.65 CPU)

Result: FAIL

END: /usr/lib/openssl/ptest





QA Team is investigating more to reach out the correct status and root cause of openssl ptest failures.



New Bugs



[1] Bug 12950<https://bugzilla.yoctoproject.org/show_bug.cgi?id=12950> -  [Yocto-2.6_M3.rc1] [MANUAL_SCRIPTS_OE-Core] [Case 2021] [Cross_tap]semantic error: while resolving probe point: identifier 'syscall' at trace_open.stp

https://bugzilla.yoctoproject.org/show_bug.cgi?id=12950



[2] Bug 12952<https://bugzilla.yoctoproject.org/show_bug.cgi?id=12952> - [QA 2.6.M3 rc1 ][BSP/Mturbot] Not able to see login prompt when using serial

https://bugzilla.yoctoproject.org/show_bug.cgi?id=12952


[3] Bug 12946<https://bugzilla.yoctoproject.org/show_bug.cgi?id=12946> - [2.6 M3 RC1] e2fsprogs ptest failed
https://bugzilla.yoctoproject.org/show_bug.cgi?id=12946

[4] Bug 12954<https://bugzilla.yoctoproject.org/show_bug.cgi?id=12954> - [2.6 M3 RC1] gdbm ptest failures
https://bugzilla.yoctoproject.org/show_bug.cgi?id=12954

[5] Bug 12948<https://bugzilla.yoctoproject.org/show_bug.cgi?id=12948> - [2.6 M3 RC1] strace ptest failed
https://bugzilla.yoctoproject.org/show_bug.cgi?id=12948


Thanks & Regards,
Sangeeta Jain

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20181010/b0a15362/attachment.html>