[yocto] FW: Yocto 1.5.2.rc3 Full Pass QA Report

Fri May 9 06:29:56 PDT 2014

Resending with better formatting:

Here is the full pass report for 1.5.2.rc3 release.The QA report summary, testing data and issue summary are available below, and the full pass report is available on https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3  wiki.

Issue summary:

  *   There were no release blocker issues found in this release. We have found:
     *   6269 - gtk 2.24.20 fails at do_compile  on Ubuntu 13.10 which have been addressed.
     *   6264 -  repository 'http://git.pingu.fi/xf86-video-omapfb/' not found which was fixed
     *   6301 - nightly-world build hangs on AB machine having OpenSuse 13.1

Testing data

 Test type: Full Pass Release

 Branch: Dora

 Build name: 1.5.2 rc3

 poky commit: b626e109e83384558f45dc2e30e7caec677ce1db

 Eclipse Plugin commit Kepler:  e842d41f05066df1533a2788e650f0be213ad5b5

 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.5.2.rc3/

 Distributions tested: Ubuntu 14.04 64bit, Ubuntu 13.10 64bit, Fedora 19 64bit, Fedora 20 32bit,  OpenSuse 13.1 64bit, CentOS 6.5 64bit,  Debian 7 64bit

Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

2318<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2318>2320<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2320>

ADT: dora branch

Fedora 20 i686

100.0%

none

0.0%

none

0.0%

none

100.0%

1751<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1751>1753<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=1753>

ADT: dora branch

Ubuntu 13.10 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2321<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2321>2322<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2322>

BSP/QEMU: dora branch

Beagleboard

71.0%

none

4.3%

5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182>3936<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3936>

24.6%

5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182>

100.0%

2297<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2297>2300<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2300>

BSP/QEMU: dora branch

generic-x86 on AtomPC

97.1%

none

2.9%

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

0.0%

none

100.0%

2303<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2303>2307<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2307>

BSP/QEMU: dora branch

genericx86-64 on Sugarbay

98.6%

none

1.4%

5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

0.0%

none

100.0%

2327<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2327>2328<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2328>

BSP/QEMU: dora branch

MPC8315e-rdb

100.0%

none

0.0%

none

0.0%

none

100.0%

2323<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2323>2324<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2324>

BSP/QEMU: dora branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

2339<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2339>2340<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2340>

BSP/QEMU: dora branch

qemu-x86

100.0%

none

0.0%

none

0.0%

none

100.0%

2311<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2311>2312<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2312>

BSP/QEMU: dora branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

2315<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2315>2316<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2316>

BSP/QEMU: dora branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

2313<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2313>2314<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2314>

BSP/QEMU: dora branch

qemuppc

100.0%

none

0.0%

none

0.0%

none

100.0%

2336<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2336>2337<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2337>

BSP/QEMU: dora branch

qemux86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

2325<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2325>2326<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2326>

BSP/QEMU: dora branch

Routerstationpro

100.0%

none

0.0%

none

0.0%

none

100.0%

2301<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2301>2302<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2302>2304<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2304>2305<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2305>2306<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2306>2332<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2332>

Eclipse plugin: Dora branch

Ubuntu 13.10 x86_64

100.0%

5760<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5760>5163<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5163>

0.0%

none

0.0%

none

100.0%

2329<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2329>2330<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2330>

Meta-yocto: dora branch

Ubuntu 13.10 x86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

2309<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2309>2310<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2310>

Hob: dora branch

Ubuntu 14.04 x86_64

97.8%

none

2.2%

5892<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5892>

0.0%

none

100.0%

2298<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2298>2299<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2299>

OE-Core: dora branch

Multiple environments

100.0%

none

0.0%

none

0.0%

none

100.0%

2333<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2333>2334<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2334>

Bitbake: dora branch

Ubuntu 13.10 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2335<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2335>

Runtime: dora branch

Multiple Environments

100.0%

none

0.0%

none

0.0%

none

100.0%

2331<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2331>

Build Appliance: dora branch

qemu-kvm on Ubuntu 12.04 libvirt

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 20

Test Case Status Report

Status

Count

BLOCKED

17

FAILED

7

PASSED

1015

Total: 1039

[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:17,7,1015&chco=FFFF66|FF9933|00FF00&chl=BLOCKED(17)+2%25|FAILED(7)+1%25|PASSED(1015)+98%25]

Bug Status Report

[Bug Status]

ID[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3>

Priority[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3>

Status[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3>

Resolution[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3>

Test Runs[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3>

Description[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3>

Version[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3>

Target Milestone[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3>

Age (days)[?]<https://wiki.yoctoproject.org/wiki/WW18_-_2014-04-28_-_Full_Pass_Release_Dora_1.5.2_rc3>

3936<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3936>

Medium

ACCEPTED

2321<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2321>

[beagleboard xM] Some error message with usbhs_omap in dmesg

1.4

1.6

426

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

Low

NEW

2297<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2297>

dmesg log errors in Atom-PC

1.3.1

1.7

413

5163<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5163>

Medium

ACCEPTED

2305<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2305>2301<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2301>

no external tools displayed when first trying to run QEMU - test case 48 failed on Ubuntu 12.04 x86-64 host(build 1.5 M4 rc2)

1.5

1.7

229

5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182>

Medium+

RESOLVED

WONTFIX

2322<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2322>2321<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2321>

[Beagleboard xM]X can not startup with 3.10 kernel

1.5

1.5.1

227

5760<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5760>

Low

NEW

2305<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2305>2301<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2301>

headless build takes took long

1.6

1.6

91

5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

Medium

NEW

2300<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2300>2307<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2307>

Cannot wake from suspend state using the USB mouse or keyboard

1.6

1.6

70

5892<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5892>

Medium

RESOLVED

FIXED

2310<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2310>

Deploy image does not always write correctly to USB

1.6

1.6 M4

60

Total: 7

Distro testing
Here are the distro testing results for 1.5.2.rc3 release. The distribution hosts used are Fedora 20, OpenSuse 13.1, CentOS 6.5 and Ubuntu 13.10. We have also performed manual distro tests on Ubuntu 14.04.

BRANCH

sgw/dora-next

dora

COMMIT

9b7d43963f54d25e087a4cc55623a4cfeac121a9

6a92f7ede3be3edd58d7819aa611b0c5270756bf

RELEASE

1.5.2 RC3

1.5.2 RC3

Fedora 20

* nighlty-world

FAILED - 6264

PASS

* buildtools

PASS

* nightly-arm

FAILED - 6264

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS

OpenSuSE 13.1

* nighlty-world

FAILED - 6301

* buildtools

PASS

* nightly-arm

FAILED - 6264

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS

Ubuntu 13.10

* nighlty-world

FAILED - 6269

FAILED - 6269

* buildtools

PASS

* nightly-arm

FAILED - 6264

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS

CentOS 6.5

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

FAILED - 6264

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS

Performance test

The build performance test data is available on the 1.5.2 performance_test wiki. The below charts reflects the data tables in the wiki which shows an overall similar build performance, even though there are slight degradations observed from the trend.

Trend for building core-image-sato (rm_work):

[cid:image001.jpg at 01CF6BA3.E84B1630]

The trend for building the virtual/kernel:

[cid:image002.jpg at 01CF6BA3.E84B1630]

The trend for building the rootfs:

[cid:image003.jpg at 01CF6BA3.E84B1630]

Regards,

--

Alexandru Georgescu

Yocto QA Engineer

SSG/SSD Open Source Technology Center Romania

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140509/18bd2025/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 83060 bytes
Desc: image001.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140509/18bd2025/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 63222 bytes
Desc: image002.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140509/18bd2025/attachment-0001.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.jpg
Type: image/jpeg
Size: 71905 bytes
Desc: image003.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140509/18bd2025/attachment-0002.jpg>