[yocto] Yocto 1.6_M5.rc1 Full Pass Report

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Wed Apr 2 00:34:09 PDT 2014


Hello,
Here is the Full Pass report for The Yocto  1.6_M5.rc1 release build: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.6_M5.rc1/.

Issue Summary:

-          There are no HIGH bugs found during this Test Run.

-          The only medium+ valid issues found  are the ADT-installation fail: 5900<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5900> - ADT installation failed - this issue is fixed in the RC2 build; also, 5499<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5499> - "source toaster start" fail - toaster issue was found and is fixed for the rc2 release.

The summary report can be viewed below and the full pass report is available on the wiki at: https://wiki.yoctoproject.org/wiki/WW13_-_2014-03-26_-_Full_Pass_Release_1.6_M5.rc1.


Testing data

 Test type:  Full Pass Release Test

 Branch: master

 Milestone: M5

 Build name: 1.6_M5.rc1

 poky commit: 1960f6b2ecbb793b40ebc9aed25c8f9cb7884c9a

 Eclipse Plugin commit Kepler:  1dfe1d2f1322b5fda8e1a7637c447b0e060efb3e

 Autobuilder images repository:  http://autobuilder.yoctoproject.org/pub/releases/yocto-1.6_M5.rc1/

 Distributions tested: Ubuntu 13.10 64bit, Fedora 19 64bit, Fedora 20 32bit, Opensuse 12.3 64bit, CentOS 6.5 64 bit

Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

2154<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2154> 2156<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2156>

ADT: master branch

Fedora 20 i686

71.6%

none

5.2%

5900<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5900>

23.3%

5900<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5900>

100.0%

2153<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2153> 2155<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2155>

ADT: master branch

Ubuntu 13.10 x86_64

71.6%

none

5.2%

5900<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5900>

23.3%

5900<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5900>

100.0%

2150<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2150> 2151<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2151>

BSP/QEMU: master branch

Beagleboard

71.0%

none

4.3%

5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182> 3936<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3936>

24.6%

5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182>

100.0%

2113<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2113> 2120<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2120>

BSP/QEMU: master branch

generic-x86 on AtomPC

97.1%

none

2.9%

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005> 5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

0.0%

none

100.0%

2121<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2121> 2123<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2123>

BSP/QEMU: master branch

genericx86-64 on Sugarbay

98.6%

none

1.4%

5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

0.0%

none

100.0%

2146<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2146> 2147<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2147>

BSP/QEMU: master branch

MPC8315e-rdb

100.0%

none

0.0%

none

0.0%

none

100.0%

2144<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2144> 2145<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2145>

BSP/QEMU: master branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

2157<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2157> 2159<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2159>

BSP/QEMU: master branch

qemu-x86

100.0%

none

0.0%

none

0.0%

none

100.0%

2131<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2131> 2132<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2132>

BSP/QEMU: master branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

2135<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2135> 2136<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2136>

BSP/QEMU: master branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

2133<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2133> 2134<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2134>

BSP/QEMU: master branch

qemuppc

100.0%

none

0.0%

none

0.0%

none

100.0%

2160<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2160> 2158<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2158>

BSP/QEMU: master branch

qemux86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

2148<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2148> 2149<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2149>

BSP/QEMU: master branch

Routerstationpro

100.0%

none

0.0%

none

0.0%

none

100.0%

2114<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2114> 2115<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2115>2116<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2116>

Eclipse Plugin: master branch

Fedora 20 x86_64

89.3%

none

0.0%

none

10.7%

5900<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5900>

100.0%

2117<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2117> 2118<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2118>2119<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2119>

Eclipse Plugin: master branch

Ubuntu 13.10 x86_64

89.3%

5291<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5291>

0.0%

none

10.7%

5900<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5900>

100.0%

2141<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2141> 2142<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2142>

Meta-yocto: master branch

Ubuntu 13.10 x86-64

95.8%

none

4.2%

6016<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6016>

0.0%

none

100.0%

2125<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2125> 2126<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2126>

Hob: master branch

Ubuntu 13.10 x86_64

89.1%

none

10.9%

6088<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6088> 6086<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6086> 5995<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5995>

0.0%

none

100.0%

2122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2122>

Toaster: master branch

Ubuntu 13.04 x86_64

81.6%

none

18.4%

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187> 5642<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5642> 5485<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5485> 5988<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5988> 5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255> 5226<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5226> 5811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5811> 5820<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5820>5499<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5499>

0.0%

none

100.0%

2111<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2111> 2112<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2112>

OE-Core: master branch

Multiple environments

100.0%

none

0.0%

none

0.0%

none

100.0%

2129<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2129> 2130<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2130>

BitBake: master branch

Ubuntu 13.10 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2161<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2161>

Runtime: master branch

Multiple Environments

100.0%

none

0.0%

none

0.0%

none

100.0%

2139<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2139>

Build Appliance: master branch

qemu-kvm on Ubuntu 12.04 libvirt

75.0%

none

25.0%

6086<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6086>

0.0%

none

100.0%

Total: 22



Test Case Status Report

Status

Count

BLOCKED

50

FAILED

26

PASSED

896

Total: 972


[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:50,26,896&chco=FFFF66|FF9933|00FF00&chl=BLOCKED(50)+5%25|FAILED(26)+3%25|PASSED(896)+92%25]



Bug Status Report


ID[?]<https://wiki.yoctoproject.org/wiki/WW13_-_2014-03-26_-_Full_Pass_Release_1.6_M5.rc1>

Priority[?]<https://wiki.yoctoproject.org/wiki/WW13_-_2014-03-26_-_Full_Pass_Release_1.6_M5.rc1>

Status[?]<https://wiki.yoctoproject.org/wiki/WW13_-_2014-03-26_-_Full_Pass_Release_1.6_M5.rc1>

Resolution[?]<https://wiki.yoctoproject.org/wiki/WW13_-_2014-03-26_-_Full_Pass_Release_1.6_M5.rc1>

Test Runs[?]<https://wiki.yoctoproject.org/wiki/WW13_-_2014-03-26_-_Full_Pass_Release_1.6_M5.rc1>

Description[?]<https://wiki.yoctoproject.org/wiki/WW13_-_2014-03-26_-_Full_Pass_Release_1.6_M5.rc1>

Version[?]<https://wiki.yoctoproject.org/wiki/WW13_-_2014-03-26_-_Full_Pass_Release_1.6_M5.rc1>

Target Milestone[?]<https://wiki.yoctoproject.org/wiki/WW13_-_2014-03-26_-_Full_Pass_Release_1.6_M5.rc1>

Age (days)[?]<https://wiki.yoctoproject.org/wiki/WW13_-_2014-03-26_-_Full_Pass_Release_1.6_M5.rc1>

3936<https://bugzilla.yoctoproject.org/show_bug.cgi?id=3936>

Medium

ACCEPTED

2150<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2150>

[beagleboard xM] Some error message with usbhs_omap in dmesg

1.4

1.6

393

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

Low

NEW

2113<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2113>

dmesg log errors in Atom-PC

1.3.1

1.5

380

5182<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5182>

Medium+

RESOLVED

WONTFIX

2151<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2151> 2150<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2150>

[Beagleboard xM]X can not startup with 3.10 kernel

1.5

1.5.1

194

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187>

Medium

ACCEPTED

2122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2122>

same cooker log file name used for several builds

unspecified

1.6

194

5226<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5226>

Medium

NEW

2122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2122>

in 'variables' API, the 'changed' field seems to return always 'FALSE'

1.5

1.7

189

5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255>

Medium

ACCEPTED

2122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2122>

source_url in the tasks table is empty

unspecified

1.7

184

5291<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5291>

Medium

NEW

2118<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2118>

eclipse console doesn't display parsing results for bitbake recipes

1.5

1.6

177

5485<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5485>

Medium

RESOLVED

FIXED

2122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2122>

Buildstats info and database entries doesn't match sometimes

unspecified

1.6 M1

140

5499<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5499>

Medium+

RESOLVED

FIXED

2122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2122>

"source toaster start" fail

unspecified

1.6

140

5642<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5642>

Medium

REOPENED

2122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2122>

The number of warnings from Build table doesn't match the number of orm_logmessage.level entries with value 1

unspecified

1.6 M5

110

5811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5811>

Medium

IN PROGRESS IMPLEMENTATION

2122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2122>

the orm_variablehistory table should collect the variable value for each file

unspecified

1.7

43

5820<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5820>

Medium

IN PROGRESS IMPLEMENTATION

2122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2122>

Link warnings to their corresponding tasks (when applicable)

unspecified

1.6 M5

41

5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

Medium

NEW

2120<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2120> 2123<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2123>

Cannot wake from suspend state using the USB mouse or keyboard

1.6

1.6

37

5900<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5900>

Medium+

RESOLVED

FIXED

2154<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2154> 2156<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2156> 2117<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2117> 2114<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2114>

ADT installation failed on all ARCHs with build 20140226-1

1.6

1.6 M4

23

5988<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5988>

Medium

REOPENED

2122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2122>

Wrong outcome (OUTCOME_NA) when task_executed = false

unspecified

1.6 M5

9

5995<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5995>

Medium

ACCEPTED

2126<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2126>

xinit:giving up on sato image

1.6

1.6 M4

8

6016<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6016>

Medium

REOPENED

2142<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2142>

CrossTap has issues on running scheduler script against qemuppc

1.6

1.6 M5

6 (Recent)

6086<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6086>

Undecided

NEW

2126<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2126> 2139<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2139>

A hob error occurs after recipe add

1.6

---

NEW

6088<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6088>

Undecided

NEW

2126<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2126>

Error during DEB package build

1.6

---

NEW

Total: 19




Distro Testing

Here are the Distro Testing results for the latest distro releases. We also have added to our manual distro tests the Ubuntu 14.04 Beta version (not viewed in the table below but are covered by the DISTRO marked test cases). Until Ubuntu 14.04 will be released, we will continue to runt the distro tests on it manually.

COMMIT

47ceed0d8d60a3ddc398738acafe3aabf4ab8c90

RELEASE

1.6_M5.rc1

Fedora 20



* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS





OpenSuSE 13.1



* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS





Ubuntu 13.10



* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS





CentOS 6.5



* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS



Performance Test

Here are the performance comparison charts. There is a slight degradation observed when building core-image-sato with rm_work but nothing notable. Building the virtual/kernel and rootfs don't measure any degradations. The full data is available on the Performance_test wiki: https://wiki.yoctoproject.org/wiki/Performance_Test.


bitbake core-image-sato (rm_work) comparison:

[cid:image004.jpg at 01CF4E5F.1308B0B0]



bitbake virtual/kernel comparison:

[cid:image008.jpg at 01CF4E5F.1308B0B0]


Bitbake core-image-sato -c rootfs comparison:

[cid:image011.jpg at 01CF4E5F.1308B0B0]

Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140402/212df373/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 10341 bytes
Desc: image001.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140402/212df373/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.gif
Type: image/gif
Size: 462 bytes
Desc: image002.gif
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140402/212df373/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.jpg
Type: image/jpeg
Size: 46933 bytes
Desc: image004.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140402/212df373/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image008.jpg
Type: image/jpeg
Size: 41314 bytes
Desc: image008.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140402/212df373/attachment-0001.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image011.jpg
Type: image/jpeg
Size: 39879 bytes
Desc: image011.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140402/212df373/attachment-0002.jpg>


More information about the yocto mailing list