[yocto] Yocto 1.7_M4.rc3 Full Pass report
Georgescu, Alexandru C
alexandru.c.georgescu at intel.com
Thu Oct 9 05:43:24 PDT 2014
Hello,
Here is the Full Pass test report for Yocto 1.7_M4.rc3 build.
Status summary:
* #6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> - Mouse does not work in X window for all QEMU images.
* #6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815> – On Ubuntu Host, X doesn’t show up for QEMUPPC
* #6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793> - Configure fail using adt-installer on sudoku-savant because of wrong SDKTARGETSYSROOT
* #6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613> - C++ compiler does not work for ppce500v2 cross toolchain was reopened. #6766 was fixed but still remains for ppce500v2
* All buildsets were built successfully on Distro testing, with #6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811> and #<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6812> sanity tests failed (new dmesg errors found)
* On Build performance side<https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html>, building kernel takes by 20 seconds longer on average for both hosts, very possible a result of the kernel upgrade to 3.17. The rootfs build time remained the same around 4:18 and 4:14 for Fedora and Ubuntu hosts. Building a sato image (with rmwork enabled) improved by 40 seconds on Fedora machine (1:10:57) and decreased by 15 seconds on Ubuntu machine (1:09:01) on average.
Issue summary can be found below and as reference, the full pass report is available here: https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3.
Testing data
Test type: Full Pass Release Test
Branch: master
Build name: 1.7_M4.rc3
poky commit: 5367855fe56db0c09b8fa7bb423b9de18d11eecc
Eclipse Plugin commit Kepler: 4a167fd662262ebdaa3cf0d332ac0debb52d7904
Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.7.rc3/
Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 6.5 64 bit
Summary Report
Testing Summary Report
Test Run Test Plan Environment Passed Other issues Failed Failing bugs Blocked Blocking bugs Complete
2976<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2976> 2975<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2975> ADT: master branch Fedora 20 x86_64 72.0% 6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793> 6.8% 6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613> 21.2% 6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793> 100.0%
2979<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2979> BSP/QEMU: master branch Beaglebone Black 100.0% none 0.0% none 0.0% none 100.0%
2978<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2978> BSP/QEMU: master branch EdgeRouter 97.6% none 2.4% 6820<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6820> 0.0% none 100.0%
2971<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2971> BSP/QEMU: master branch generic-x86 on Atom N2600 100.0% none 0.0% none 0.0% none 100.0%
2967<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2967> BSP/QEMU: master branch generic-x86 on AtomPC 97.4% none 2.6% 6814<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6814> 0.0% none 100.0%
2970<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2970> BSP/QEMU: master branch genericx86-64 on NUC 97.7% none 2.3% 6583<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6583> 0.0% none 100.0%
2939<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2939> 2962<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2962> BSP/QEMU: master branch qemu-x86 96.7% none 3.3% 6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6812> 0.0% none 100.0%
2941<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2941> 2964<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2964> BSP/QEMU: master branch qemuarm 98.4% none 1.6% 6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 0.0% none 100.0%
2942<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2942> 2961<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2961> BSP/QEMU: master branch qemumips 96.7% none 3.3% 6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811> 0.0% none 100.0%
2943<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2943> 2965<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2965>2974<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2974> BSP/QEMU: master branch qemuppc 77.9% none 2.6% 6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815> 19.5% 6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815> 100.0%
2940<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2940> 2963<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2963> BSP/QEMU: master branch qemux86-64 96.7% none 3.3% 6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811> 0.0% none 100.0%
2977<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2977> Eclipse Plugin: master branch Fedora 20 x86_64 87.9% none 0.0% none 12.1% 6766<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6766> 100.0%
2946<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2946> 2947<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2947> Meta-yocto: master branch Ubuntu 14.04 x86_64 100.0% 6162<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6162> 0.0% none 0.0% none 100.0%
2944<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2944> 2952<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2952> Hob: master branch Ubuntu 14.04 x86_64 97.8% none 0.0% none 2.2% none 100.0%
2972<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2972> Toaster: master branch Fedora 20 x86_64 96.7% none 3.3% 6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684> 0.0% none 100.0%
2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960> Toaster: master branch Ubuntu 14.04 LTS x86_64 81.0% none 19.0% 5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187> 6681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6681> 6800<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6800> 6799<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6799> 6802<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6802>5844<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5844> 6801<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6801> 6688<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6688> 0.0% none 100.0%
2953<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2953> 2954<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2954> OE-Core: master branch Ubuntu 14.04 x86_64 93.1% none 6.9% 6804<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6804> 0.0% none 100.0%
2948<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2948> 2949<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2949> BitBake: master branch Ubuntu 14.04 x86_64 91.9% 6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752> 5.4% 6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752> 2.7% none 100.0%
2968<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2968> Runtime: master branch Multiple Environments 100.0% none 0.0% none 0.0% none 100.0%
2973<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2973> Build Appliance: master branch VMWare Player on Fedora 20 64bit 100.0% none 0.0% none 0.0% none 100.0%
Total: 20
Test Case Status Report
Status Count
BLOCKED 46
FAILED 33
PASSED 826
PAUSED 3
Total: 908
[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:46,33,826,3&chco=FFFF66|FF9933|00FF00|3366FF&chl=BLOCKED(46)+5%|FAILED(33)+4%|PASSED(826)+91%|PAUSED(3)+0%]
Bug Status Report
[Bug Status]
ID[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Priority[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Status[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Resolution[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Test Runs[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Description[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Version[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Target Milestone[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Age (days)[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#>
5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187> Medium ACCEPTED 2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960> same cooker log file name used for several builds unspecified 1.8 384
5844<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5844> Medium ACCEPTED 2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960> Wrong script_type when task is not executed. unspecified 1.7 M4 226
6162<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6162> Medium+ REOPENED 2947<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2947> linux-yocto failed to do_patch after add a patch by yocto-kernel tool 1.6 1.7 170
6583<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6583> Medium IN PROGRESS REVIEW 2970<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2970> [Test Case 972] Xorg log: Failed to load module "present" 1.7 1.7 M4 66
6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613> Medium REOPENED 2976<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2976> C++ compiler does not work for ppce500v2 cross toolchain 1.7 1.7 57
6681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6681> Medium NEW 2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960> Check if the number of errors from Build table matches the number of level entries with value 2 from LogMessage table. 1.7 1.7 M4 28
6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684> Medium NEW 2972<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2972> The content of the license column shouldn't be 4.0k. 1.7 1.7 M4 27
6688<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6688> Medium NEW 2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960> Build image using managed mode - Toaster web interface tries to load from address http://0.0.0.0:8000 1.7 1.8 27
6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752> Medium NEW 2948<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2948> bitbake-prserv-tool has issues when it comes to exporting the PR database 1.7 1.7 M4 9
6766<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6766> High RESOLVED FIXED 2977<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2977> adt installed toolchain compilation error under ALL ARCHs with build yocto_1.7.rc1 1.7 1.7 M4 6 (Recent)
6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793> Medium+ RESOLVED FIXED 2976<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2976> configure fail using adt-installer on sudoku-savant because of wrong SDKTARGETSYSROOT 1.7 1.7 M4 NEW
6799<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6799> Undecided NEW 2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960> cpu_usage value 0 for tasks with outcome=0 1.7 --- NEW
6800<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6800> Undecided NEW 2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960> elapsed_time value null for tasks with outcome=0 1.7 --- NEW
6801<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6801> Undecided RESOLVED NOTABUG 2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960> Toaster UI - create project doesn't work 1.7 --- NEW
6802<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6802> Undecided NEW 2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960> Lots of empty fields in the database. 1.7 --- NEW
6804<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6804> Undecided NEW 2954<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2954> do_rootfs fails for btrfs image build 1.7 --- NEW
6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> High IN PROGRESS IMPLEMENTATION 2942<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2942> 2940<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2940> 2943<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2943> 2941<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2941>2939<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2939> Mouse does not work in X window 1.7 1.7 M4 NEW
6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811> Undecided NEW 2961<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2961> 2963<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2963> usbhid: probe of 1-1:1.0 failed with error -32 1.7 --- NEW
6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6812> Undecided NEW 2962<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2962> uvesafb errors in dmesg for qemux86 1.7 --- NEW
6814<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6814> Undecided NEW 2967<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2967> rpm log file size stays the same no matter what 1.7 --- NEW
6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815> Undecided NEW 2974<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2974> Yocto image qemuppc do not boot and OS not load 1.7 --- NEW
6820<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6820> Undecided NEW 2978<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2978> dmesg err in BeagleBone Black unspecified --- NEW
Total: 22
Distro Testing
Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing<https://wiki.yoctoproject.org/wiki/Distribution_Support#Distro_Testing> wiki.
Summary
At this point all buildsets are fine, exepting the dmesg errors in qemu found by the sanity tests: [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>] and [6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
Distro Results
BRANCH master
COMMIT Poky: 5367855fe56db0c09b8fa7bb423b9de18d11eecc
RELEASE 1.7_M4.rc3
Ubuntu 14.04 LTS
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-qa-systemd PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64-lsb PASS
Fedora 20
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-qa-systemd PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64-lsb PASS
CentOS 6.5
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-qa-systemd PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64-lsb PASS
OpenSuse 13.1
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-qa-systemd PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>] - [6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64-lsb PASS
Build Performance Test
Detailed description on how performance test are run can be found on Performance Test<https://wiki.yoctoproject.org/wiki/Performance_Test> wiki. The below charts are displaying the build performance trend for 1.7 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link<https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html> where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.
As a status, building kernel takes by 20 seconds longer on average for both hosts, very possible a result of the kernel upgrade to 3.17. The rootfs build time remained the same around 4:18 and 4:14 for Fedora and Ubuntu hosts. Building a sato image (with rmwork enabled) improved by 40 seconds on Fedora machine (1:10:57) and decreased by 15 seconds on Ubuntu machine (1:09:01) on average.
As a QA point of view, for the latter there is no great change in the build performance results to be a concern for the release candidate.
Performance Charts
For Bitbake core-image-sato with rm_work
[Ww40 - rmwork.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-core-image-sato-rmwork.html>
Building the Virtual kernel
[Ww40 - kernel.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-virtual-kernel.html>
Building the rootfs
[Ww40 - rootfs.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-core-image-sato-rootfs.html>
Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania
More information about the yocto
mailing list