[yocto] Yocto Full Pass report for 1.5_M4.rc2

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Wed Sep 4 08:48:01 PDT 2013 

Hello,

Here is the QA report for Yocto Project 1.5_M4.rc2.
As a highlight for this test run is that we have dropped Atom PC images and instead we have tested the genericx86 which will replaces it. The image was tested on Atom-PC hardware (Lenovo S10-3). You can see the test run available for the Atom PC environment. We are also working on validating the image on all the HW available but this will require more time to complete.

Issue summary highlights:

*         #5088<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5088> - [OE-Core]Buildhistory fails to report error if PR of some recipes go backwards

*         #5077<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5077> - beagleboard cannot boot up with 1.5_M4.rc2 image. After uboot updated the system could not boot up the rootfs. Will be fixed in M5 - according to its status.

*         #5100<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5100> - Use "yocto-kernel patch add" added a patch, then core-image-sato build hangs

*         #5061<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5061> - [Build-appliance] Cannot choose non-x86 qemu to build - already fixed.

*         #5104<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5104> - common-pc missing CONFIGs of atom-pc - no eth interface and no kernel module

*         #5095<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5095> - Keyboard doesn't work on qemumips

*         #5100<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5100> - Use "yocto-kernel patch add" added a patch, then core-image-sato build hangs

More details on the bugs and test runs can be found below or accessing the full QA report: https://wiki.yoctoproject.org/wiki/WW35_-_2013-08-28_-_Full_Pass_Yocto_1.5_M4.rc2#Testing_data
Since there are many new bugs on this RC, QA will perform another Full Pass on RC3 which will be available soon.


Testing data

 Test type: Full Pass Release

 Branch: Master

 Milestone: M4

 Build name: 1.5_M4.rc2

 poky commit: 5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f

 poky commit date:  Thu Aug 29 00:22:41 2013 +0100

 Eclipse Plugin commit Kepler:  f1fc72a31f7e51364ba3bccf45c028e694aefb9a

 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/1.5_M4.rc2/

 Distributions tested: Ubuntu 12.04 64bit, Ubuntu 13.10 64bit, Fedora 17 64bit, Fedora 19 32bit



Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

1099<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1099> 1102<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1102>

ADT: master branch

Fedora 19 i686

100.0%

none

0.0%

none

0.0%

none

100.0%

1098<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1098> 1101<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1101>

ADT: master branch

Ubuntu 13.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

1138<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1138>

BSP/QEMU: master branch

Atom PC

80.6%

none

5.6%

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005> 5104<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5104>

13.9%

5104<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5104>

100.0%

1113<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1113> 1114<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1114>

BSP/QEMU: master branch

Beagleboard

1.4%

none

1.4%

5077<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5077>

97.1%

5077<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5077>

100.0%

1080<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1080>

BSP/QEMU: dylan branch

Fish River Island 2 (FRI2)

95.1%

none

2.5%

2646<https://bugzilla.yoctoproject.org/show_bug.cgi?id=2646> 2415<https://bugzilla.yoctoproject.org/show_bug.cgi?id=2415>

2.5%

2415<https://bugzilla.yoctoproject.org/show_bug.cgi?id=2415>

100.0%

1121<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1121> 1124<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1124>

BSP/QEMU: master branch

MPC8315e-rdb

100.0%

none

0.0%

none

0.0%

none

100.0%

1105<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1105> 1106<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1106>

BSP/QEMU: master branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

1085<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1085> 1135<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1135>

BSP/QEMU: master branch

qemu-x86

98.1%

none

1.9%

4832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4832>

0.0%

none

100.0%

1087<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1087> 1116<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1116>1137<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1137>

BSP/QEMU: master branch

qemuarm

98.8%

none

1.2%

4832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4832>

0.0%

none

100.0%

1118<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1118> 1119<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1119>1122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1122>

BSP/QEMU: master branch

qemumips

97.6%

5095<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5095>

2.4%

4832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4832> 5095<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5095>

0.0%

none

100.0%

1117<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1117> 1120<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1120>1123<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1123>

BSP/QEMU: master branch

qemuppc

98.8%

none

1.2%

4832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4832>

0.0%

none

100.0%

1086<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1086> 1136<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1136>

BSP/QEMU: master branch

qemux86-64

96.2%

none

3.8%

4953<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4953> 4832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4832>

0.0%

none

100.0%

1107<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1107> 1109<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1109>

BSP/QEMU: master branch

Routerstationpro

100.0%

none

0.0%

none

0.0%

none

100.0%

1088<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1088> 1089<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1089>

Eclipse Plugin: master branch

Fedora 18 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

1115<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1115> 1129<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1129>

Meta-yocto: master branch

Ubuntu 13.04 x86-64

85.7%

none

14.3%

3908<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3908> 5100<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5100>

0.0%

none

100.0%

1095<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1095> 1111<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1111>

Hob: master branch

Ubuntu 13.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

1082<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1082> 1084<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1084>

OE-Core: master branch

Multiple environments

94.9%

none

2.6%

5088<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5088>

2.6%

5088<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5088>

100.0%

1081<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1081> 1083<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1083>

BitBake: master branch

Ubuntu 12.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

1091<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1091> 1092<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1092>

Runtime: master branch

Multiple Environments

66.7%

none

11.1%

5077<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5077>

22.2%

5077<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5077>

100.0%

1112<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1112>

Build Appliance: master branch

qemu-kvm on Ubuntu 12.04 libvirt

50.0%

none

50.0%

4727<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4727> 5061<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5061>5034<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5034>

0.0%

none

100.0%

Total: 20



Test Case Status Report

Status

Count

BLOCKED

82

FAILED

21

PASSED

1012

Total: 1115


[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:82,21,1012&chco=FFFF66|FF9933|00FF00&chl=BLOCKED(82)+7%25|FAILED(21)+2%25|PASSED(1012)+91%25]



Bug Status Report


ID[↓]<https://wiki.yoctoproject.org/wiki/WW35_-_2013-08-28_-_Full_Pass_Yocto_1.5_M4.rc2>

Priority[↓]<https://wiki.yoctoproject.org/wiki/WW35_-_2013-08-28_-_Full_Pass_Yocto_1.5_M4.rc2>

Status[↓]<https://wiki.yoctoproject.org/wiki/WW35_-_2013-08-28_-_Full_Pass_Yocto_1.5_M4.rc2>

Resolution[↓]<https://wiki.yoctoproject.org/wiki/WW35_-_2013-08-28_-_Full_Pass_Yocto_1.5_M4.rc2>

Test Runs[↓]<https://wiki.yoctoproject.org/wiki/WW35_-_2013-08-28_-_Full_Pass_Yocto_1.5_M4.rc2>

Description[↓]<https://wiki.yoctoproject.org/wiki/WW35_-_2013-08-28_-_Full_Pass_Yocto_1.5_M4.rc2>

Version[↓]<https://wiki.yoctoproject.org/wiki/WW35_-_2013-08-28_-_Full_Pass_Yocto_1.5_M4.rc2>

Target Milestone[↓]<https://wiki.yoctoproject.org/wiki/WW35_-_2013-08-28_-_Full_Pass_Yocto_1.5_M4.rc2>

Age (days)[↓]<https://wiki.yoctoproject.org/wiki/WW35_-_2013-08-28_-_Full_Pass_Yocto_1.5_M4.rc2>

2415<https://bugzilla.yoctoproject.org/show_bug.cgi?id=2415>

Medium

NEW

1080<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1080>

connman doesn't provide a 3g configuration utility

1.2

Future

471

2646<https://bugzilla.yoctoproject.org/show_bug.cgi?id=2646>

Medium

ACCEPTED

1080<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1080>

Windows switching failure

1.2

1.5

422

3908<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3908>

Medium+

IN PROGRESS REVIEW

1115<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1115>

Kernel panic on qemux86-64 when using runqemu kvm and cpu host

1.4

1.5 M2

190

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

Low

NEW

1138<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1138>

dmesg log errors in Atom-PC

1.3.1

1.5

170

4727<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4727>

Medium

IN PROGRESS DESIGN

1112<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1112>

Opening build logs does not work in HOB under Build Appliance

unspecified

1.5 M5

77

4832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4832>

Medium

NEW

1123<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1123> 1122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1122> 1086<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1086> 1085<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1085> 1087<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1087>

[Test Case 225] ethernet static ip set in connman

1.5

1.5 M5

50

4953<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4953>

Medium

RESOLVED

WORKSFORME

1086<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1086>

[Test Case 207] sudoku-savant project compile in sdk image

1.5

1.5

29

5034<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5034>

Medium

RESOLVED

FIXED

1112<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1112>

"File a bug" button does not work under Build Appliance

unspecified

1.5 M5

7 (Recent)

5061<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5061>

Medium+

RESOLVED

FIXED

1112<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1112>

[Build-appliance] Can not choose non-x86 qemu to build

unspecified

1.5 M5

NEW

5077<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5077>

High

NEW

1113<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1113> 1114<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1114> 1092<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1092>

beagleboard can not boot up with 1.5_M4.rc2 image

1.5

1.5 M5

NEW

5088<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5088>

Medium

VERIFIED

FIXED

1084<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1084>

[OE-Core]Buildhistory fails to report error if PR of some recipes go backwards

1.5

1.5 M5

NEW

5095<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5095>

Medium+

NEEDINFO

1118<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1118> 1122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1122> 1119<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1119>

Keyboard doesn't work on qemumips

1.5

1.5 M5

NEW

5100<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5100>

Medium+

ACCEPTED

1129<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1129>

Use "yocto-kernel patch add" added a patch, then core-image-sato build hangs.

1.5

1.5 M5

NEW

5104<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5104>

Undecided

NEW

1138<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1138>

common-pc missing CONFIGs of atom-pc

1.5

---

NEW

Total: 14





Build Performance Status:

Below you can find the Milestone build performance charts. Data taken from: Data taken from: https://wiki.yoctoproject.org/wiki/Performance_Test#1.5_Milestones_only_results. Attached you can find the detailed report with all the measurements.
A note would be that for building the rootfs for the H2 increased by 30 seconds, but there has been some performance improvement work merged including elimination of Pseudo double execution which was not merged in this build. Overall there is no concern regarding build performance.

[cid:image001.png at 01CEA820.CBBCC910]

Regards,
--
Alexandru Georgescu
Yocto QA Lead Engineer
SSG/SSD Open Source Technology Center Romania

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20130904/1b9b24c6/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 65764 bytes
Desc: image001.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20130904/1b9b24c6/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 10090 bytes
Desc: image002.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20130904/1b9b24c6/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.gif
Type: image/gif
Size: 462 bytes
Desc: image003.gif
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20130904/1b9b24c6/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Performance Comparison.xlsx
Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Size: 51131 bytes
Desc: Performance Comparison.xlsx
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20130904/1b9b24c6/attachment.xlsx>

More information about the yocto mailing list