[yocto] Yocto 1.7_M4.rc4 Full Pass test report

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Sun Oct 19 09:41:57 PDT 2014 

Hello,
Here is the Full Pass test report for 1.7_M4.rc4 build.

As issue summary, the previous ADT-installer fails are fixed, also for Build Appliance. No new Medium+/High bugs are found during this test run, though there are several medium errors found in the BSP logs (like dmesg, rpm, Xorg, etc) none of which are considered blockers of the release atm. The full list of bugs is listed below, but it can be accessed also on the Full Pass test report link: https://wiki.yoctoproject.org/wiki/WW41_-_2014-10-11_-_Full_Pass_-_1.7_M4.rc4#Summary.
Distro testing is green, also build_performance with a slightly improvement on every build type.

Testing data

 Test type:  Full Pass Release Test

 Branch: master

 Build name: 1.7_M4.rc4

 poky commit: ccf5a4d2342c4fd40e4e0b332ea7e34e0bf175d4.tar

 Eclipse Plugin commit Kepler: 4a167fd662262ebdaa3cf0d332ac0debb52d7904

 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.7.rc4/

 Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 7 64 bit

Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

3028<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3028>3030<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3030>

ADT: master branch

Fedora 20 i686

100.0%

none

0.0%

none

0.0%

none

100.0%

3027<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3027>3029<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3029>

ADT: master branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

3005<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3005>3006<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3006>

BSP/QEMU: master branch

Beaglebone Black

98.7%

none

1.3%

6665<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6665>

0.0%

none

100.0%

3007<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3007>3008<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3008>

BSP/QEMU: master branch

EdgeRouter

100.0%

none

0.0%

none

0.0%

none

100.0%

2989<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2989>2990<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2990>

BSP/QEMU: master branch

generic-x86 on AtomPC

98.8%

none

1.2%

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>6846<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6846>6848<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6848>6849<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6849>6850<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6850>

0.0%

none

100.0%

3011<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3011>3012<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3012>

BSP/QEMU: master branch

genericx86-64 on Sugarbay

98.8%

none

1.2%

5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

0.0%

none

100.0%

3009<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3009>3010<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3010>

BSP/QEMU: master branch

MPC8315e-rdb

100.0%

none

0.0%

none

0.0%

none

100.0%

3002<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3002>3003<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3003>

BSP/QEMU: master branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

2999<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2999>

BSP/QEMU: master branch

qemu-x86

100.0%

none

0.0%

none

0.0%

none

100.0%

3021<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3021>3022<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3022>

BSP/QEMU: master branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

3025<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3025>3026<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3026>

BSP/QEMU: master branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

3023<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3023>3024<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3024>

BSP/QEMU: master branch

qemuppc

100.0%

none

0.0%

none

0.0%

none

100.0%

2998<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2998>3000<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3000>

BSP/QEMU: master branch

qemux86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

3014<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3014>

Eclipse Plugin: master branch

Fedora 20 x86_64

90.9%

none

9.1%

5769<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5769>5285<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5285>4403<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4403>5713<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5713>

0.0%

none

100.0%

3019<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3019>3020<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3020>

Meta-yocto: master branch

Ubuntu 14.04 x86_64

100.0%

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

0.0%

none

0.0%

none

100.0%

3016<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3016>3017<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3017>

Hob: master branch

Ubuntu 14.04 x86_64

95.6%

none

0.0%

none

4.4%

4503<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4503>

100.0%

3018<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3018>

Toaster: master branch

Fedora 20 x86_64

96.7%

none

3.3%

6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684>

0.0%

none

100.0%

3013<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3013>

Toaster: master branch

Ubuntu 14.04 LTS x86_64

83.3%

none

14.3%

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187>6681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6681>6832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6832>6799<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6799>6833<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6833>6800<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6800>6802<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6802>

2.4%

none

100.0%

2993<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2993>2994<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2994>

OE-Core: master branch

Ubuntu 14.04 x86_64

96.6%

none

3.4%

6804<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6804>

0.0%

none

100.0%

2991<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2991>2992<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2992>

BitBake: master branch

Ubuntu 14.04 x86_64

91.9%

none

5.4%

6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752>

2.7%

none

100.0%

3015<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3015>

Runtime: master branch

Multiple Environments

100.0%

6733<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6733>

0.0%

none

0.0%

none

100.0%

3004<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3004>

Build Appliance: master branch

VMWare Workstation

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 22




Bug Status Report

[Bug Status]

ID[?]<https://wiki.yoctoproject.org/wiki/WW41_-_2014-10-11_-_Full_Pass_-_1.7_M4.rc4>

Priority[?]<https://wiki.yoctoproject.org/wiki/WW41_-_2014-10-11_-_Full_Pass_-_1.7_M4.rc4>

Status[?]<https://wiki.yoctoproject.org/wiki/WW41_-_2014-10-11_-_Full_Pass_-_1.7_M4.rc4>

Resolution[?]<https://wiki.yoctoproject.org/wiki/WW41_-_2014-10-11_-_Full_Pass_-_1.7_M4.rc4>

Test Runs[?]<https://wiki.yoctoproject.org/wiki/WW41_-_2014-10-11_-_Full_Pass_-_1.7_M4.rc4>

Description[?]<https://wiki.yoctoproject.org/wiki/WW41_-_2014-10-11_-_Full_Pass_-_1.7_M4.rc4>

Version[?]<https://wiki.yoctoproject.org/wiki/WW41_-_2014-10-11_-_Full_Pass_-_1.7_M4.rc4>

Target Milestone[?]<https://wiki.yoctoproject.org/wiki/WW41_-_2014-10-11_-_Full_Pass_-_1.7_M4.rc4>

Age (days)[?]<https://wiki.yoctoproject.org/wiki/WW41_-_2014-10-11_-_Full_Pass_-_1.7_M4.rc4>

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

Low

NEW

2990<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2990>

dmesg log errors in Atom-PC

1.3.1

1.7

579

4403<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4403>

Medium

ACCEPTED

3014<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3014>

stap fails on core-image-sato x86-64

1.4

Future

536

4503<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4503>

Medium

VERIFIED

WORKSFORME

3017<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3017>

Failed to build an non-GPLv3 image.

1.3.2

1.5

513

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187>

Medium

ACCEPTED

3013<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3013>

same cooker log file name used for several builds

unspecified

1.8

393

5285<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5285>

Medium

NEW

3014<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3014>

powertop: Output is useless

unspecified

Future

379

5713<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5713>

Medium

NEW

3014<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3014>

systemtap displays blank pop-up error window

1.5

1.7

274

5769<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5769>

Low

NEW

3014<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3014>

ssh connection doesn't disconnect when qemu is restarted/shut down

1.6

1.7

255

5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

Medium

NEW

3012<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3012>

Cannot wake from suspend state using the USB mouse or keyboard

1.6

1.7

236

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

Medium

ACCEPTED

3020<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3020>

[crosstap] no trace message output on qemuarm

1.6

1.7

180

6665<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6665>

Medium

NEW

3006<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3006>

[Beaglebone] Xserver segmentation fault when reboot the system

1.7

1.7

44

6681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6681>

Medium

NEW

3013<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3013>

Check if the number of errors from Build table matches the number of level entries with value 2 from LogMessage table.

1.7

1.7 M4

37

6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684>

Medium

NEW

3018<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3018>

The content of the license column shouldn't be 4.0k.

1.7

1.7 M4

36

6733<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6733>

Medium

NEW

3015<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3015>

[LTP] some rwtest cases hang on mpc8315e-rdb

1.7

1.7

23

6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752>

Medium

NEW

2992<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2992>

bitbake-prserv-tool has issues when it comes to exporting the PR database

1.7

1.7 M4

18

6799<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6799>

Medium

NEW

3013<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3013>

cpu_usage value 0 for tasks with outcome=0

1.7

1.8

5(Recent)

6800<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6800>

Medium

NEW

3013<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3013>

elapsed_time value null for tasks with outcome=0

1.7

1.8

5(Recent)

6802<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6802>

Undecided

NEEDINFO

3013<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3013>

Lots of empty fields in the database.

1.7

---

5(Recent)

6804<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6804>

Medium

NEW

2994<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2994>

do_rootfs fails for btrfs image build

1.7

1.7

5(Recent)

6832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6832>

Low

NEW

3013<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3013>

disk_io value in database doesn't match sometime with the value in the task buildstats file

1.7

1.8

NEW

6833<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6833>

Low

NEW

3013<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3013>

elapsed_time value in database doesn't match sometime the value in the task stats file

1.7

1.8

NEW

6846<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6846>

Medium

NEEDINFO

2990<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2990>

DMESG error: check_tsc_sync_source failed

1.7

1.8

NEW

6848<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6848>

Undecided

NEEDINFO

2990<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2990>

BeagleBone Black errors in logs

1.7

---

NEW

6849<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6849>

Medium

NEW

2990<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2990>

EdgeRouter and Minnowboard Xorg Fatal Server Error

1.7

1.8

NEW

6850<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6850>

Undecided

NEW

2990<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2990>

Minnowboard Xorg Open ACPI failed error

1.7

---

NEW

Total: 24





Bug Trend

An overview of this week's Yocto Bug Trend<https://wiki.yoctoproject.org/wiki/Yocto_Bug_Trend> charts can be accessed on the following page<https://wiki.yoctoproject.org/charts/combo.html>

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test<https://wiki.yoctoproject.org/wiki/Performance_Test> wiki. The below charts are displaying the build performance trend for 1.7 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link<https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html> where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.

As a status, building kernel takes by 17 seconds less on average on Ubuntu and 4 secods on Fedora. The rootfs build time remained the same around 4:18 and 4:14 for Fedora and Ubuntu hosts. Building a sato image (with rmwork enabled) improved with 4 seconds on Ubuntu machine and 29 seconds on Fedora on average.

As a QA point of view, for the latter there is no great change in the build performance results to be a concern for the release candidate.

Performance Charts

For Bitbake core-image-sato with rm_work

[Ww41 - rmwork.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-core-image-sato-rmwork.html>

Building the Virtual kernel

[Ww41 - kernel.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-virtual-kernel.html>

Building the rootfs

[Ww41 - rootfs.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-core-image-sato-rootfs.html>

Distro Testing

Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing<https://wiki.yoctoproject.org/wiki/Distribution_Support#Distro_Testing> wiki.

Summary

At this point all buildsets are fine.

Distro Results
BRANCH

master

COMMIT

Poky: ccf5a4d2342c4fd40e4e0b332ea7e34e0bf175d4

RELEASE

1.7_M4.rc4

Ubuntu 14.04 LTS

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS



Fedora 20

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS



CentOS 7

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS



OpenSuse 13.1

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS



Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141019/e09d43c9/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 8927 bytes
Desc: image001.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141019/e09d43c9/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.gif
Type: image/gif
Size: 462 bytes
Desc: image002.gif
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141019/e09d43c9/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 89657 bytes
Desc: image003.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141019/e09d43c9/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 91519 bytes
Desc: image004.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141019/e09d43c9/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.png
Type: image/png
Size: 90249 bytes
Desc: image005.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141019/e09d43c9/attachment-0003.png>

More information about the yocto mailing list