[yocto] Fullpass Test Report for Yocto M4 RC1 20110226 Build
Xu, Jiajun
jiajun.xu at intel.com
Sun Mar 6 01:32:55 PST 2011
Hi all,
This is the fullpass test report for RC1 build 20110226. The critical bug blocks out testing is most BSP targets build failed on autobuilder. Together with sanity test result against the same build, there are 17 new bugs reported with RC1 build. And there are 31 bugs met in this testing, which cause 73 cases failed. For QEMU targets, most functionality work well, except for partial zypper function. Most failed test cases on beagleboard are excepted and will not be fixed in v1.0. For poky feature, sstate and non-GPLv3 build do not work correctly. SDK testing is partly blocked with i586 toolchain tarball build failed. For compliance with LTP/POSIX/LSB, these testing results are still in analysis and will be published later.
NOTE: Yi Zhao, Liangliang Wang and Liang Li helped to do a sanity test against the latest BSP builds(20110301), including beagleboard, mpc8315e-rdb and routerstationpro. They did not find any show-stoper or critical bugs with this build. Only one new issue is found with RTC set on routerstationpro. You could find the detailed test report in attachment.
Test Summary
---------------------------------------
Test Result Summary
Component
Target
Status
Comments
BSP
SugarBay
BLOCK
BSP build failed
CrownBay
BLOCK
BSP build failed
JasperForest
BLOCK
BSP build failed
Blacksand
BUGGY
BSP build failed, atom-pc build pass for core; With atom-pc image, partial zypper function not work well; connman-applet and audio/video not work;
Beagleboard
BUGGY
USB, RTC, X window, NAND do not work; sato-sdk image not copied to sharing folder; Most failed cases will be fixed in v1.1. So will skip them in next RC2 testing;
Routerstationpro
BLOCK
sato-sdk image not copied to sharing folder
Mpc8315e-rdb
BLOCK
sato-sdk image not copied to sharing folder
QEMU
qemux86
GOOD
Partial zypper function not work well
qemux86-64
GOOD
Partial zypper function not work well
qemuarm
GOOD
Partial zypper function not work well
qemuppc
BUGGY
gcc segfault and zypper function not work well
qemumips
BUGGY
x11vnc and partial zypper function not work well
Poky
BUGGY
sstate and non-gplv3 build do not work correctly
Documentation
GOOD
SDK
BLOCK
unfs not work for qemuppc; i586 toolchain not build out
Complience Test
In analysis
LTP and POSIX testing is finished and being analysis now; LSB testing is partly finished, you could check the attachment for LSP test result.
Critical bugs, more than 50% test cases are blocked
Only Normal, Minor or Enhancement bugs, less than 10% test cases failed
Normal, Major and Critical bugs, more than 10% test cases failed
Detailed Test Result for each component
Target
Total TCs
Not Run
Passed
Failed
Not testable (Blocked)
Blacksand Sato
52
0
33
14 (bug 607, 803, 804, 613, 798, 799)
5 (bug 779, 613)
BeagleBoard Sato
21
0
8
10 (bug 764, 765, 767, 772)
3 (bug 764)
Qemux86-64 Sato
21
0
20
1 (bug 721)
0
Qemux86-64 SDK
26
0
22
4 (bug 721)
0
Qemux86 Sato
21
0
18
3 (bug 803, 804)
0
Qemux86 SDK
26
0
23
3 (bug 803, 804)
0
Qemumips Sato
21
0
15
6 (bug 721, 782, 787)
0
Qemumips SDK
26
0
20
6 (bug 721, 782, 787)
0
Qemuppc Sato
18
0
12
6 (bug 722, 787)
0
Qemuppc SDK
23
0
16
7 (bug 722, 780, 778)
0
Qemuarm Sato
21
0
16
5 (bug 491, 489, 490, 749, 787)
0
Qemuarm SDK
26
0
22
4 (bug 491, 489, 490, 787)
0
SDK
3
0
0
1 (bug 414)
2 (Toolchain tarballs not built out for i586)
Poky
8
0
5
3 (bug 598, 712, 788, 789)
0
Documentation
1
0
1
0
0
Total
314
0
231
73
10
* You can check the detailed test result in attachment for each target.
** The failed/blocked case number is listed with failed cases’ bug number.
Images
---------------------------------------
http://autobuilder.pokylinux.org/nightly/20110226-1/
Issue Summary
---------------------------------------
Zypper/RPM:
1. New! [zypper] zypper install does not work on qemux86/atom-pc
http://bugzilla.pokylinux.org/show_bug.cgi?id=803
2. New! [zypper] package installed by rpm could not be recognized by zypper
http://bugzilla.pokylinux.org/show_bug.cgi?id=804
3. New! rpm remove package error
http://bugzilla.pokylinux.org/show_bug.cgi?id=787
4. [zypper] zypper segfault in qemux86-64 sdk image
http://bugzilla.pokylinux.org/show_bug.cgi?id=721
5. [qemuarm]zypper search package warning in sato image: no '/usr/bin/uuidgen'
http://bugzilla.pokylinux.org/show_bug.cgi?id=749
6. [zypper] package removal failure
http://bugzilla.pokylinux.org/show_bug.cgi?id=491
7. [zypper] uname -m and repo arch difference
http://bugzilla.pokylinux.org/show_bug.cgi?id=489
8. [zypper] installation failure on arm
http://bugzilla.pokylinux.org/show_bug.cgi?id=490
9. [zypper] search failure on qemuppc (nightly build 20110212-1)
http://bugzilla.pokylinux.org/show_bug.cgi?id=722
Poky:
1. New! [sstate] random error message shown when sstate is used
http://bugzilla.pokylinux.org/show_bug.cgi?id=788
2. New! [sstate] only few setscene tasks run even with same build environment
http://bugzilla.pokylinux.org/show_bug.cgi?id=789
3. Fail to build non-GPLv3 image
http://bugzilla.pokylinux.org/show_bug.cgi?id=712
4. [poky] kernel interactive build does not work via ssh
http://bugzilla.pokylinux.org/show_bug.cgi?id=598
SDK:
1. [PPC] kernel panic when booting poky-image-sdk-qemuppc through UNFS
http://bugzilla.pokylinux.org/show_bug.cgi?id=414
BSP:
1. New! [blacksand] no sound even all options in amixer enabled
http://bugzilla.pokylinux.org/show_bug.cgi?id=798
2. New! [blacksand] configured audiosink is not working for video player
http://bugzilla.pokylinux.org/show_bug.cgi?id=799
3. New! [RouterStationPro] Missing file when setting RTC on routerstationpro
http://bugzilla.pokylinux.org/show_bug.cgi?id=801
4. [Connman] xuser must be granted privilege to start connman-applet
http://bugzilla.pokylinux.org/show_bug.cgi?id=779
5. [Blacksand] Some error information prompted when run dmesg command
http://bugzilla.pokylinux.org/show_bug.cgi?id=607
6. [Blacksand]system cannot enter S3 standby mode
http://bugzilla.pokylinux.org/show_bug.cgi?id=613
7. [beagleboard] X server can not startup on beagleboard
http://bugzilla.pokylinux.org/show_bug.cgi?id=764
8. [beagleboard] USB does not work on beagleboard
http://bugzilla.pokylinux.org/show_bug.cgi?id=765
9. [beagleboard] Can not set RTC correctly
http://bugzilla.pokylinux.org/show_bug.cgi?id=767
10. [beagleboard] Can not recognize NAND flash on board
http://bugzilla.pokylinux.org/show_bug.cgi?id=772
Complience:
1. New! The process of installing LSB test suit and running LSB test on qemu-ppc is very slow
http://bugzilla.pokylinux.org/show_bug.cgi?id=793
2. New! LSB: A test case (lib/Config.t) failed during running perl test of LSB
http://bugzilla.pokylinux.org/show_bug.cgi?id=794
3. New! LSB: Some cases (libstdc++.so.6) failed on library check of LSB test
http://bugzilla.pokylinux.org/show_bug.cgi?id=795
4. New! LSB: Some cases related to locale failed on libstdcpp and cpp-t2c test of LSB
http://bugzilla.pokylinux.org/show_bug.cgi?id=796
Others:
1. [X11VNC Server ] No response when I click 'X11VNC Server' icon
http://bugzilla.pokylinux.org/show_bug.cgi?id=781
2. gcc segfault on qemuppc (nightly build 20110226-1)
http://bugzilla.pokylinux.org/show_bug.cgi?id=780
3. The vnc client does not pop-up on qemumips-sato-sdk
http://bugzilla.pokylinux.org/show_bug.cgi?id=782
Best Regards,
Jiajun
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110306/d2d2ba74/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: M4-RC1_20110226_detail_testreport_fullpass.ods
Type: application/oleobject
Size: 22095 bytes
Desc: M4-RC1_20110226_detail_testreport_fullpass.ods
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110306/d2d2ba74/attachment.bin>
-------------- next part --------------
An embedded message was scrubbed...
From: Zhao Yi <yi.zhao at windriver.com>
Subject: Sanity Test Report for Yocto 1.0 RC1 20110301 build on non-x86 hardware
Date: Fri, 4 Mar 2011 17:22:53 +0800
Size: 32697
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110306/d2d2ba74/attachment.mht>
-------------- next part --------------
An embedded message was scrubbed...
From: Xiaofeng Yan <xiaofeng.yan at windriver.com>
Subject: The status for lsb test
Date: Fri, 4 Mar 2011 18:35:12 +0800
Size: 16076
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110306/d2d2ba74/attachment-0001.mht>
More information about the yocto
mailing list