[yocto] Full Pass test Report for Yocto Project 1.6.2 point release

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Mon Nov 3 00:37:56 PST 2014 

Hello,
Here is the Full Pass test report for Yocto 1.6.2 point release.
There were few new issues found during this test run:

  *   6905<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6905> - "unrecognized options: --with-libtool-sysroot" when configure iptables using mips32 toolchain (Medium+)
  *   6904<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6904> - yocto-bsp tool: Wrong tune file for qemux86-64 and qemuppc. The issue is fixed on master, it needs back-porting in 1.6.2 as well.
  *   6899<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6899> - cpu_usage value for some tasks doesn't match the value in the stats file in Toaster
  *   6908<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6908> - Headless install fails while downloading SDK. The issue is fixed on master, it needs back-porting in 1.6.2 as well.
Below you can find the summary report, with the test run status and the full list of bugs. The report is also available at this wiki link: https://wiki.yoctoproject.org/wiki/WW44_-_2014-10-26_-_Full_Pass_Release_1.6.2.

Testing data

 Test type:  Full Pass Release Test

 Branch: daisy

 Build name: 1.6.2

 poky commit: 313864bf528696a72c3ee6b3dec1a0c7b0b223f6.tar

 Eclipse Plugin commit Kepler: 1dfe1d2f1322b5fda8e1a7637c447b0e060efb3e

 Autobuilder images repository:  http://autobuilder.yoctoproject.org/pub/releases/yocto-1.6.2.rc1/

 Distributions tested: Ubuntu 14.04 64bit,  Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 7 64 bit

Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

3123<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3123> 3124<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3124>

ADT: daisy_branch

Fedora 20 i686

99.1%

6906<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6906>

0.9%

6905<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6905>

0.0%

none

100.0%

3121<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3121> 3122<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3122>

ADT: daisy_branch

Ubuntu 14.04 x86_64

100.0%

6906<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6906>

0.0%

none

0.0%

none

100.0%

3114<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3114> 3116<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3116>

BSP/QEMU: daisy branch

Beaglebone Black

97.3%

none

2.7%

6462<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6462> 6665<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6665>

0.0%

none

100.0%

3117<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3117> 3118<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3118>

BSP/QEMU: daisy branch

EdgeRouter

100.0%

none

0.0%

none

0.0%

none

100.0%

3095<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3095> 3097<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3097>

BSP/QEMU: daisy branch

generic-x86 on AtomPC

98.6%

none

1.4%

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

0.0%

none

100.0%

3106<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3106> 3107<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3107>

BSP/QEMU: daisy branch

genericx86-64 on Sugarbay

98.6%

none

1.4%

5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

0.0%

none

100.0%

3119<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3119> 3120<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3120>

BSP/QEMU: daisy branch

MPC8315e-rdb

100.0%

none

0.0%

none

0.0%

none

100.0%

3112<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3112> 3113<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3113>

BSP/QEMU: daisy branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

3126<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3126> 3128<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3128>

BSP/QEMU: daisy branch

qemu-x86

100.0%

none

0.0%

none

0.0%

none

100.0%

3136<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3136> 3137<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3137>

BSP/QEMU: daisy branch

qemuarm

98.1%

none

1.9%

4024<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4024>

0.0%

none

100.0%

3138<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3138> 3139<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3139>

BSP/QEMU: daisy branch

qemumips

98.1%

none

1.9%

6913<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6913>

0.0%

none

100.0%

3140<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3140> 3141<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3141>

BSP/QEMU: daisy branch

qemuppc

100.0%

none

0.0%

none

0.0%

none

100.0%

3127<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3127> 3129<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3129>

BSP/QEMU: daisy branch

qemux86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

3142<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3142> 3143<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3143>3144<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3144>

Eclipse Plugin: Daisy Branch

Fedora 20 x86_64

92.9%

6908<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6908> 5769<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5769>5163<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5163>

7.1%

5285<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5285> 4403<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4403>

0.0%

none

100.0%

3110<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3110> 3111<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3111>

meta-yocto: daisy branch

Ubuntu 14.04 x86_64

96.7%

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

3.3%

6904<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6904>

0.0%

none

100.0%

3108<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3108> 3109<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3109>

HOB: daisy branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

3130<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3130>

Toaster: daisy branch

Fedora 20 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

3131<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3131>

Toaster: daisy branch

Ubuntu 14.04 LTS x86_64

89.2%

none

10.8%

6832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6832> 6899<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6899> 6833<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6833> 6685<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6685> 5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255> 5266<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5266>5811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5811>

0.0%

none

100.0%

3099<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3099> 3102<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3102>

OE-Core: daisy branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

3098<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3098> 3103<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3103>

BitBake: daisy branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

3125<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3125>

Runtime: daisy branch

Multiple Environments

100.0%

6914<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6914>

0.0%

none

0.0%

none

100.0%

3115<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3115>

Build Appliance: daisy branch

qemu-kvm on Ubuntu 12.04 libvirt

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 22




Bug Status Report

[Bug Status]

ID

Priority

Status

Resolution

Test Runs

Description

Version

Target Milestone

Age (days)

4005<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4005>

Low

NEW

3095<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3095>

dmesg log errors in Atom-PC

1.3.1

1.7

594

4024<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4024>

Low

REOPENED

3136<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3136>

start qemuarm with "core-image-sato", use "dmesg | grep -i error" shows 2 errors

1.4

1.7

590

4403<https://bugzilla.yoctoproject.org/show_bug.cgi?id=4403>

Medium

ACCEPTED

3142<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3142>

stap fails on core-image-sato x86-64

1.4

Future

551

5163<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5163>

Medium

ACCEPTED

3143<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3143>

no external tools displayed when first trying to run QEMU - test case 48 failed on Ubuntu 12.04 x86-64 host(build 1.5 M4 rc2)

1.5

1.7

410

5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255>

Medium

ACCEPTED

3131<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3131>

source_url in the tasks table is empty

unspecified

Future

398

5266<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5266>

Medium

RESOLVED

FIXED

3131<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3131>

quagga/ripd: two unexpected behavior after received SIGHUP signal

unspecified

1.5.1

396

5285<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5285>

Medium

NEW

3142<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3142>

powertop: Output is useless

unspecified

Future

394

5769<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5769>

Low

NEW

3143<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3143>

ssh connection doesn't disconnect when qemu is restarted/shut down

1.6

1.7

270

5811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5811>

Medium

IN PROGRESS IMPLEMENTATION

3131<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3131>

the orm_variablehistory table should collect the variable value for each file

unspecified

Future

257

5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

Medium

NEW

3107<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3107>

Cannot wake from suspend state using the USB mouse or keyboard

1.6

1.7

251

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

Medium

ACCEPTED

3111<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3111>

[crosstap] no trace message output on qemuarm

1.6

1.7

195

6462<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6462>

Medium

IN PROGRESS DESIGN

3116<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3116>

[1.6.1] watchdog doesn't work in beaglebone black

1.6.1

1.6.2

130

6665<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6665>

Medium

NEW

3116<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3116>

[Beaglebone] Xserver segmentation fault when reboot the system

1.7

1.7

59

6685<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6685>

Medium

IN PROGRESS REVIEW

3131<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3131>

Elapsed_time value null for tasks with outcome=0

1.7

1.7.1

51

6832<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6832>

Medium

NEW

3131<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3131>

disk_io value in database doesn't match sometime with the value in the task buildstats file

1.7

1.7.1

12

6833<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6833>

Medium

IN PROGRESS REVIEW

3131<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3131>

elapsed_time value in database doesn't match sometime the value in the task stats file

1.7

1.7.1

12

6899<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6899>

Medium

NEW

3131<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3131>

cpu_usage value for some tasks doesn't match the value in the stats file

1.6.2

1.6.2

NEW

6904<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6904>

Medium

NEW

3111<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3111>

[1.6.2] yocto-bsp tool: Wrong tune file for qemux86-64 and qemuppc

1.6.2

1.6.2

NEW

6905<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6905>

Medium+

IN PROGRESS REVIEW

3123<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3123>

[1.6.2] "unrecognized options: --with-libtool-sysroot" when configure iptables using mips32 toolchain

1.6.2

1.6.2

NEW

6906<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6906>

Medium

RESOLVED

WONTFIX

3123<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3123>

[1.6.2] C++ compiler does not work for ppce500v2 cross toolchain

1.6.2

1.6.2

NEW

6908<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6908>

Undecided

NEW

3143<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3143>

[daisy] Headless install fails while downloading SDK

1.6.2

---

NEW

6913<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6913>

Medium

RESOLVED

DUPLICATE

3138<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3138>

[1.6.2] syslog startup failed on qemumips due to missing execution permission

1.6.2

1.6.2

NEW

6914<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6914>

Medium

NEW

3125<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3125>

[1.6.2] Missing unzip_tests.sh in LTP package

1.6.2

1.6.2

NEW

Total: 23





Bug Trend

An overview of this week's Yocto Bug Trend<https://wiki.yoctoproject.org/wiki/Yocto_Bug_Trend> charts can be accessed on the following page<https://wiki.yoctoproject.org/charts/combo.html>

Build Performance Test

note: all the measurements displayed are against 1.6 release in the performance test page<https://wiki.yoctoproject.org/charts/charts_161/performance_test.html>.
§  Building the rootfs improved on Ubuntu host against 1.6 release by 10 seconds taking 4:30 minutes to build. On the Fedora the build time average takes with 2 seconds longer (against 1.6) with 4.38 minutes needed to build.
§  The kernel takes longer to build (against 1.6) with 30 seconds longer on average (12:36 minutes on Ubuntu and 11:22 minutes on Fedora)
§  A sato image with rmwork takes less, with 1:11:07 hours agasint 1:11:32 horurs on Ubuntu and 1:14:14 against 1:15:56 on Fedora Host.

Overall even if the kernel takes longer to build, the rootfs and images takes less on average.

Performance Charts

For Bitbake core-image-sato with rm_work

[Ww44 - rmwork.png]<https://wiki.yoctoproject.org/charts/charts_161/bitbake-core-image-sato-rmwork.html>

Building the Virtual kernel

[Ww44 - kernel.png]<https://wiki.yoctoproject.org/charts/charts_161/bitbake-virtual-kernel.html>

Building the rootfs

[Ww44 - rootfs.png]<https://wiki.yoctoproject.org/charts/charts_161/bitbake-core-image-sato-rootfs.html>

Distro Testing

Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing<https://wiki.yoctoproject.org/wiki/Distribution_Support#Distro_Testing> wiki.



Summary

At this point all buildsets are fine.

Distro Results
BRANCH

master

COMMIT

Poky: 313864bf528696a72c3ee6b3dec1a0c7b0b223f6

RELEASE

1.6.2

Ubuntu 14.04 LTS

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS



Fedora 20

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS



CentOS 7

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS



OpenSuse 13.1

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS



Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141103/aaad8f89/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 9925 bytes
Desc: image001.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141103/aaad8f89/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 83661 bytes
Desc: image002.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141103/aaad8f89/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 75687 bytes
Desc: image003.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141103/aaad8f89/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 71751 bytes
Desc: image004.png
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141103/aaad8f89/attachment-0003.png>

More information about the yocto mailing list