[yocto] Yocto 1.7_M4.rc3 Full Pass report

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Thu Oct 9 06:00:38 PDT 2014 

The formatting gone wild so resending ...

Status summary:

  *   #6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> - Mouse does not work in X window for all QEMU images.
  *   #6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815> - On Ubuntu Host, X doesn't show up for QEMUPPC
  *   #6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793> - Configure fail using adt-installer on sudoku-savant because of wrong SDKTARGETSYSROOT
  *   #6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613> - C++ compiler does not work for ppce500v2 cross toolchain was reopened. #6766 was fixed but still remains for ppce500v2
  *   All buildsets were built successfully on Distro testing, with #6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811> and #6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6812> sanity tests failed (new dmesg errors found)
  *   On Build performance side<https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html>, building kernel takes by 20 seconds longer on average for both hosts, very possible a result of the kernel upgrade to 3.17. The rootfs build time remained the same around 4:18 and 4:14 for Fedora and Ubuntu hosts. Building a sato image (with rmwork enabled) improved by 40 seconds on Fedora machine (1:10:57) and decreased by 15 seconds on Ubuntu machine (1:09:01) on average.
Issue summary can be found below and as reference, the full pass report is available here: https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3.

Testing data

 Test type:  Full Pass Release Test

 Branch: master

 Build name: 1.7_M4.rc3

 poky commit: 5367855fe56db0c09b8fa7bb423b9de18d11eecc

 Eclipse Plugin commit Kepler: 4a167fd662262ebdaa3cf0d332ac0debb52d7904

 Autobuilder images repository:  http://autobuilder.yoctoproject.org/pub/releases/yocto-1.7.rc3/

 Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 6.5 64 bit

Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

2976<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2976> 2975<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2975>

ADT: master branch

Fedora 20 x86_64

72.0%

6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793>

6.8%

6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613>

21.2%

6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793>

100.0%

2979<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2979>

BSP/QEMU: master branch

Beaglebone Black

100.0%

none

0.0%

none

0.0%

none

100.0%

2978<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2978>

BSP/QEMU: master branch

EdgeRouter

97.6%

none

2.4%

6820<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6820>

0.0%

none

100.0%

2971<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2971>

BSP/QEMU: master branch

generic-x86 on Atom N2600

100.0%

none

0.0%

none

0.0%

none

100.0%

2967<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2967>

BSP/QEMU: master branch

generic-x86 on AtomPC

97.4%

none

2.6%

6814<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6814>

0.0%

none

100.0%

2970<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2970>

BSP/QEMU: master branch

genericx86-64 on NUC

97.7%

none

2.3%

6583<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6583>

0.0%

none

100.0%

2939<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2939> 2962<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2962>

BSP/QEMU: master branch

qemu-x86

96.7%

none

3.3%

6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6812>

0.0%

none

100.0%

2941<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2941> 2964<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2964>

BSP/QEMU: master branch

qemuarm

98.4%

none

1.6%

6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810>

0.0%

none

100.0%

2942<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2942> 2961<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2961>

BSP/QEMU: master branch

qemumips

96.7%

none

3.3%

6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>

0.0%

none

100.0%

2943<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2943> 2965<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2965>2974<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2974>

BSP/QEMU: master branch

qemuppc

77.9%

none

2.6%

6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815>

19.5%

6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815>

100.0%

2940<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2940> 2963<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2963>

BSP/QEMU: master branch

qemux86-64

96.7%

none

3.3%

6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>

0.0%

none

100.0%

2977<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2977>

Eclipse Plugin: master branch

Fedora 20 x86_64

87.9%

none

0.0%

none

12.1%

6766<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6766>

100.0%

2946<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2946> 2947<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2947>

Meta-yocto: master branch

Ubuntu 14.04 x86_64

100.0%

6162<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6162>

0.0%

none

0.0%

none

100.0%

2944<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2944> 2952<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2952>

Hob: master branch

Ubuntu 14.04 x86_64

97.8%

none

0.0%

none

2.2%

none

100.0%

2972<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2972>

Toaster: master branch

Fedora 20 x86_64

96.7%

none

3.3%

6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684>

0.0%

none

100.0%

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

Toaster: master branch

Ubuntu 14.04 LTS x86_64

81.0%

none

19.0%

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187> 6681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6681> 6800<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6800> 6799<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6799> 6802<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6802>5844<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5844> 6801<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6801> 6688<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6688>

0.0%

none

100.0%

2953<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2953> 2954<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2954>

OE-Core: master branch

Ubuntu 14.04 x86_64

93.1%

none

6.9%

6804<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6804>

0.0%

none

100.0%

2948<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2948> 2949<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2949>

BitBake: master branch

Ubuntu 14.04 x86_64

91.9%

6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752>

5.4%

6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752>

2.7%

none

100.0%

2968<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2968>

Runtime: master branch

Multiple Environments

100.0%

none

0.0%

none

0.0%

none

100.0%

2973<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2973>

Build Appliance: master branch

VMWare Player on Fedora 20 64bit

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 20



Test Case Status Report

Status

Count

BLOCKED

46

FAILED

33

PASSED

826

PAUSED

3

Total: 908


[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:46,33,826,3&chco=FFFF66|FF9933|00FF00|3366FF&chl=BLOCKED(46)+5%25|FAILED(33)+4%25|PASSED(826)+91%25|PAUSED(3)+0%25]



Bug Status Report

[Bug Status]

ID[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Priority[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Status[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Resolution[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Test Runs[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Description[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Version[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Target Milestone[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Age (days)[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187>

Medium

ACCEPTED

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

same cooker log file name used for several builds

unspecified

1.8

384

5844<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5844>

Medium

ACCEPTED

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

Wrong script_type when task is not executed.

unspecified

1.7 M4

226

6162<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6162>

Medium+

REOPENED

2947<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2947>

linux-yocto failed to do_patch after add a patch by yocto-kernel tool

1.6

1.7

170

6583<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6583>

Medium

IN PROGRESS REVIEW

2970<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2970>

[Test Case 972] Xorg log: Failed to load module "present"

1.7

1.7 M4

66

6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613>

Medium

REOPENED

2976<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2976>

C++ compiler does not work for ppce500v2 cross toolchain

1.7

1.7

57

6681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6681>

Medium

NEW

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

Check if the number of errors from Build table matches the number of level entries with value 2 from LogMessage table.

1.7

1.7 M4

28

6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684>

Medium

NEW

2972<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2972>

The content of the license column shouldn't be 4.0k.

1.7

1.7 M4

27

6688<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6688>

Medium

NEW

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

Build image using managed mode - Toaster web interface tries to load from address http://0.0.0.0:8000

1.7

1.8

27

6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752>

Medium

NEW

2948<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2948>

bitbake-prserv-tool has issues when it comes to exporting the PR database

1.7

1.7 M4

9

6766<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6766>

High

RESOLVED

FIXED

2977<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2977>

adt installed toolchain compilation error under ALL ARCHs with build yocto_1.7.rc1

1.7

1.7 M4

6 (Recent)

6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793>

Medium+

RESOLVED

FIXED

2976<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2976>

configure fail using adt-installer on sudoku-savant because of wrong SDKTARGETSYSROOT

1.7

1.7 M4

NEW

6799<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6799>

Undecided

NEW

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

cpu_usage value 0 for tasks with outcome=0

1.7

---

NEW

6800<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6800>

Undecided

NEW

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

elapsed_time value null for tasks with outcome=0

1.7

---

NEW

6801<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6801>

Undecided

RESOLVED

NOTABUG

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

Toaster UI - create project doesn't work

1.7

---

NEW

6802<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6802>

Undecided

NEW

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

Lots of empty fields in the database.

1.7

---

NEW

6804<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6804>

Undecided

NEW

2954<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2954>

do_rootfs fails for btrfs image build

1.7

---

NEW

6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810>

High

IN PROGRESS IMPLEMENTATION

2942<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2942> 2940<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2940> 2943<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2943> 2941<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2941>2939<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2939>

Mouse does not work in X window

1.7

1.7 M4

NEW

6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>

Undecided

NEW

2961<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2961> 2963<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2963>

usbhid: probe of 1-1:1.0 failed with error -32

1.7

---

NEW

6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6812>

Undecided

NEW

2962<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2962>

uvesafb errors in dmesg for qemux86

1.7

---

NEW

6814<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6814>

Undecided

NEW

2967<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2967>

rpm log file size stays the same no matter what

1.7

---

NEW

6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815>

Undecided

NEW

2974<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2974>

Yocto image qemuppc do not boot and OS not load

1.7

---

NEW

6820<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6820>

Undecided

NEW

2978<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2978>

dmesg err in BeagleBone Black

unspecified

---

NEW

Total: 22




Distro Testing

Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing<https://wiki.yoctoproject.org/wiki/Distribution_Support#Distro_Testing> wiki.

Summary

At this point all buildsets are fine, exepting the dmesg errors in qemu found by the sanity tests: [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>] and [6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

Distro Results
BRANCH

master

COMMIT

Poky: 5367855fe56db0c09b8fa7bb423b9de18d11eecc

RELEASE

1.7_M4.rc3

Ubuntu 14.04 LTS

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-qa-systemd

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64-lsb

PASS



Fedora 20

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-qa-systemd

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64-lsb

PASS



CentOS 6.5

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-qa-systemd

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64-lsb

PASS



OpenSuse 13.1

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-qa-systemd

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>] - [6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64-lsb

PASS


Build Performance Test

Detailed description on how performance test are run can be found on Performance Test<https://wiki.yoctoproject.org/wiki/Performance_Test> wiki. The below charts are displaying the build performance trend for 1.7 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link<https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html> where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.

As a status, building kernel takes by 20 seconds longer on average for both hosts, very possible a result of the kernel upgrade to 3.17. The rootfs build time remained the same around 4:18 and 4:14 for Fedora and Ubuntu hosts. Building a sato image (with rmwork enabled) improved by 40 seconds on Fedora machine (1:10:57) and decreased by 15 seconds on Ubuntu machine (1:09:01) on average.

As a QA point of view, for the latter there is no great change in the build performance results to be a concern for the release candidate.

Performance Charts

For Bitbake core-image-sato with rm_work

[Ww40 - rmwork.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-core-image-sato-rmwork.html>

Building the Virtual kernel

[Ww40 - kernel.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-virtual-kernel.html>

Building the rootfs

[Ww40 - rootfs.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-core-image-sato-rootfs.html>


Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20141009/b2908950/attachment.html>

More information about the yocto mailing list