[yocto] Yocto 1.7_M3.rc1 Full Pass test report

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Thu Sep 11 08:21:53 PDT 2014 

Hello,
Here is the full pass test report for Yocto 1.7_M3.rc1 build.
Issue summary:

  *   6680<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6680> - [Build Appliance] The system can not boot up. This is a blocker for 1.7_M3.rc1 release.
  *   6689<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6689> - Buildhistory reports no error if recipes go backward
  *   6699<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6699> - Missing files in ltp package
The full pass test report is available here:https://wiki.yoctoproject.org/wiki/WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1.  Below you can find the summary report including build performance results and distro testing results.

Testing data

 Test type:  Full Pass Release Test

 Branch: master

 Build name: 1.7_M3.rc1

 poky commit: a44006262cf3b810ec78b4cccd8076102a7a0f3e

 Eclipse Plugin commit Kepler: 4a167fd662262ebdaa3cf0d332ac0debb52d7904

 Autobuilder images repository:  http://autobuilder.yoctoproject.org/pub/releases/yocto-1.7_M3.rc1

 Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 6.5 64 bit

[edit<https://wiki.yoctoproject.org/wiki/index.php?title=WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1&action=edit&section=2>]Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

2844<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2844>2846<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2846>

ADT: master branch

Fedora 20 i686

97.0%

none

3.0%

6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613>

0.0%

none

100.0%

2845<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2845>2847<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2847>

ADT: master branch

Ubuntu 14.04 x86_64

99.2%

none

0.8%

6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613>

0.0%

none

100.0%

2832<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2832>2833<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2833>

BSP/QEMU: master branch

Beaglebone Black

98.7%

none

1.3%

6665<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6665>

0.0%

none

100.0%

2830<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2830>2831<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2831>

BSP/QEMU: master branch

EdgeRouter

100.0%

none

0.0%

none

0.0%

none

100.0%

2819<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2819>2820<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2820>

BSP/QEMU: master branch

generic-x86 on Atom N2600

96.1%

none

3.9%

5653<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5653> 6492<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6492>

0.0%

none

100.0%

2816<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2816>2817<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2817>

BSP/QEMU: master branch

genericx86-64 on Sugarbay

93.8%

none

6.2%

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584> 6583<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6583> 6492<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6492> 5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

0.0%

none

100.0%

2828<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2828>2829<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2829>

BSP/QEMU: master branch

MPC8315e-rdb

100.0%

none

0.0%

none

0.0%

none

100.0%

2826<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2826>2827<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2827>

BSP/QEMU: master branch

P1022ds

100.0%

none

0.0%

none

0.0%

none

100.0%

2813<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2813>2848<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2848>

BSP/QEMU: master branch

qemu-x86

100.0%

none

0.0%

none

0.0%

none

100.0%

2836<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2836>2837<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2837>

BSP/QEMU: master branch

qemuarm

100.0%

none

0.0%

none

0.0%

none

100.0%

2840<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2840>2841<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2841>

BSP/QEMU: master branch

qemumips

100.0%

none

0.0%

none

0.0%

none

100.0%

2838<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2838>2839<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2839>

BSP/QEMU: master branch

qemuppc

100.0%

none

0.0%

none

0.0%

none

100.0%

2814<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2814>2849<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2849>

BSP/QEMU: master branch

qemux86-64

100.0%

none

0.0%

none

0.0%

none

100.0%

2821<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2821>

Eclipse Plugin: master branch

Fedora 20 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2843<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2843>

Eclipse Plugin: master branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2824<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2824>2825<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2825>

Meta-yocto: master branch

Ubuntu 14.04 x86_64

100.0%

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

0.0%

none

0.0%

none

100.0%

2810<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2810>2818<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2818>

Hob: master branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2834<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2834>

Toaster: master branch

Ubuntu 12.04 x86

96.7%

none

3.3%

6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684>

0.0%

none

100.0%

2815<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2815>

Toaster: master branch

Ubuntu 14.04 LTS x86_64

88.1%

6686<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6686>

11.9%

6681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6681> 6685<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6685> 5253<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5253> 5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255> 5226<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5226> 5811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5811> 5844<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5844>6688<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6688>

0.0%

none

100.0%

2804<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2804>2807<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2807>

OE-Core: master branch

Ubuntu 14.04 x86_64

93.1%

none

3.4%

6689<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6689>

3.4%

6689<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6689>

100.0%

2808<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2808>2809<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2809>

BitBake: master branch

Ubuntu 14.04 x86_64

100.0%

none

0.0%

none

0.0%

none

100.0%

2835<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2835>

Runtime: master branch

Multiple Environments

100.0%

6699<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6699>

0.0%

none

0.0%

none

100.0%

2823<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2823>

Build Appliance: master branch

VMWare Player on Ubuntu

16.7%

none

16.7%

6680<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6680>

66.7%

6680<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6680>

100.0%

Total: 23



Test Case Status Report

Status

Count

BLOCKED

5

FAILED

22

PASSED

1244

Total: 1271


[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:5,22,1244&chco=FFFF66|FF9933|00FF00&chl=BLOCKED(5)+0%25|FAILED(22)+2%25|PASSED(1244)+98%25]



Bug Status Report

[Bug Status]

ID[?]<https://wiki.yoctoproject.org/wiki/WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1>

Priority[?]<https://wiki.yoctoproject.org/wiki/WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1>

Status[?]<https://wiki.yoctoproject.org/wiki/WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1>

Resolution[?]<https://wiki.yoctoproject.org/wiki/WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1>

Test Runs[?]<https://wiki.yoctoproject.org/wiki/WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1>

Description[?]<https://wiki.yoctoproject.org/wiki/WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1>

Version[?]<https://wiki.yoctoproject.org/wiki/WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1>

Target Milestone[?]<https://wiki.yoctoproject.org/wiki/WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1>

Age (days)[?]<https://wiki.yoctoproject.org/wiki/WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1>

5226<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5226>

Medium

NEW

2815<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2815>

in 'variables' API, the 'changed' field seems to return always 'FALSE'

1.5

Future

351

5253<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5253>

Medium

RESOLVED

WONTFIX

2815<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2815>

[webhob-poky/master] work_directory in tasks table is empty

unspecified

1.6 M1

346

5255<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5255>

Medium

ACCEPTED

2815<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2815>

source_url in the tasks table is empty

unspecified

Future

346

5653<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5653>

Medium

NEW

2819<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2819>

minnow: issues from logs

1.6

1.6

268

5811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5811>

Medium

IN PROGRESS IMPLEMENTATION

2815<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2815>

the orm_variablehistory table should collect the variable value for each file

unspecified

Future

205

5834<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5834>

Medium

NEW

2817<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2817>

Cannot wake from suspend state using the USB mouse or keyboard

1.6

1.7

199

5844<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5844>

Medium

ACCEPTED

2815<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2815>

Wrong script_type when task is not executed.

unspecified

1.7 M3

198

6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>

Medium

ACCEPTED

2825<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2825>

[crosstap] no trace message output on qemuarm

1.6

1.7

143

6492<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6492>

Medium

IN PROGRESS REVIEW

2820<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2820> 2817<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2817>

[Generic x86_64] USB not mounted

1.7

1.7

66

6583<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6583>

Medium

NEW

2816<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2816>

[Test Case 972] Xorg log: Failed to load module "present"

1.7

1.7

38

6584<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6584>

Medium

NEW

2816<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2816>

genericx86-64 on Sugarbay dmesg uvesafb: probe of uvesafb.0 failed with error -22

1.7

1.7

38

6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613>

Medium

NEW

2844<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2844> 2845<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2845>

C++ compiler does not work for ppce500v2 cross toolchain

1.7

1.7

29

6665<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6665>

Medium

NEW

2833<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2833>

[Beaglebone] Xserver segmentation fault when reboot the system

1.7

1.7

7 (Recent)

6680<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6680>

High

ACCEPTED

2823<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2823>

[Build Appliance] The system can not boot up

1.7

1.7

NEW

6681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6681>

Medium

NEW

2815<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2815>

Check if the number of errors from Build table matches the number of level entries with value 2 from LogMessage table.

1.7

1.7

NEW

6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684>

Medium

NEW

2834<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2834>

The content of the license column shouldn't be 4.0k.

1.7

1.7

NEW

6685<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6685>

Medium

NEW

2815<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2815>

Elapsed_time value null for tasks with outcome=0

1.7

1.7

NEW

6686<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6686>

Undecided

VERIFIED

FIXED

2815<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2815>

cpu_usage value null for tasks with outcome=0

1.7

---

NEW

6688<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6688>

Medium

NEW

2815<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2815>

Build image using managed mode - Toaster web interface tries to load from address http://0.0.0.0:8000

1.7

1.7

NEW

6689<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6689>

Medium+

RESOLVED

FIXED

2804<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2804>

Buildhistory reports no error if recipes go backward

1.7

1.7 M3

NEW

6699<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6699>

Medium+

NEW

2835<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2835>

Missing files in ltp package

1.7

1.7 M4

NEW

Total: 21





[edit<https://wiki.yoctoproject.org/wiki/index.php?title=WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1&action=edit&section=3>]Bug Trend

An overview of this week's Yocto Bug Trend<https://wiki.yoctoproject.org/wiki/Yocto_Bug_Trend> charts can be accessed on the following page<https://wiki.yoctoproject.org/charts/combo.html>

[edit<https://wiki.yoctoproject.org/wiki/index.php?title=WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1&action=edit&section=4>]Build Performance Test

Detailed description on how performance test are run can be found on Performance Test<https://wiki.yoctoproject.org/wiki/Performance_Test> wiki. The below charts are displaying the build performance trend for 1.7 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link<https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html> where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart. As a status, building kernel improved by 20 seconds on average for both hosts. The rootfs build time improved by few seconds, 9 on average on Ubuntu and 2 on Fedoora and for building a sato image with rmwork the average build time increased by 48 seconds on Fedora and increased a little by 4 seconds on Ubuntu host. As a QA point of view, for the latter there is no great degradation in the build time, but the trend is continuing to grow starting 1.7_M1

[edit<https://wiki.yoctoproject.org/wiki/index.php?title=WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1&action=edit&section=5>]Performance Charts

For Bitbake core-image-sato with rm_work

[Ww36 - rmwork.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-core-image-sato-rmwork.html>

Building the Virtual kernel

[Ww36 - kernel.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-virtual-kernel.html>

Building the rootfs

[Ww36 - rootfs.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-core-image-sato-rootfs.html>

[edit<https://wiki.yoctoproject.org/wiki/index.php?title=WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1&action=edit&section=6>]Distro Testing

Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing<https://wiki.yoctoproject.org/wiki/Distribution_Support#Distro_Testing> wiki.

[edit<https://wiki.yoctoproject.org/wiki/index.php?title=WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1&action=edit&section=7>]Summary

At this point the situation is stable, all tests being fine on all distros.

[edit<https://wiki.yoctoproject.org/wiki/index.php?title=WW36_-_2014-09-04_-_Full_Pass_-_1.7_M3.rc1&action=edit&section=8>]Distro Results


BRANCH

master

COMMIT

Poky: a44006262cf3b810ec78b4cccd8076102a7a0f3e

RELEASE

1.7 M3

Ubuntu 14.04 LTS

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS



Fedora 20

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS



CentOS 6.5

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS



OpenSuse 13.1

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS

* nightly-qa-systemd

PASS

* nightly-x86

PASS

* nightly-x86-64

PASS

* nightly-x86-64-lsb

PASS

Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20140911/32288120/attachment.html>

More information about the yocto mailing list