[yocto] Fullpass test report for Yocto1.1 M3 RC3 build

Fri Aug 12 02:06:09 PDT 2011

Hi All,
      This is the Fullpass test report for Yocto1.1 M3 RC3 build. There are three new bugs found in this testing compared with weekly testing. Hob and some core build feature tests are added. Yocto build failed on Fedora 15, but there has been a fixing patch for it. Lib32 build failed when kernel build error with 32bit mode. Lib64 build failed with gcc-cross-intermediate error. Bitbake-layers could work well.
For hob, images as well as toolchains build could work now. Non-GPLv3 and other options in Preferences could work also. There remains 18 open bugs for hob now. The major issue is that package dependency and reload are not correctly set, which cause bug 1281, 1364 and 1359 -- packages not reload correctly when changing Machine type, image do_rootfs build fail with packages deselected against base image, package number is not consistent with user customized bb file. And user has to exit hob to restart a new build each time.
Helltest and Crashme could pass 24 hours testing on Jasperforest. Crashme could pass 24 hours testing on Beagleboard also. But LTP stress is running on Beagleboard. Idle power consumption of sugarbay and crownbay are 34.26W and 23.30W respectively.
Note：For different images, they are built against different commit/branch on autobuilder. You can refer to “Commit Information” section for detailed information. The test report is archived @https://wiki.pokylinux.org/wiki/Yocto_1.1_Milestone_Test_Report
Hob and Multilib are tested against latest master, instead of M3 branch, since there are some fixing patches not in M3 currently.

Test Summary:
---------------------------------------

Test Result Summary

Component

Target

Status

Comments

BSP

SugarBay

GOOD

3D testing blocked due to libsdl.so;RTLDLIST invalid in ldd command.

CrownBay-emgd

GOOD

Xorg eats lots of CPU time after standby

JasperForest

GOOD

I/OAT DMA engine init failed;

Blacksand

GOOD

Everything runs well

eMenlow

GOOD

I2C_transfer error; Standby failed;

Beagleboard

BUGGY

RPM package can not be installed.

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

QEMU

qemux86

GOOD

Rpm/zypper install/removal consume disk space;"Install/Remove" icon can't work.

qemux86-64

GOOD

Rpm/zypper install/removal consume disk space;"Install/Remove" icon can't work.

qemuarm

BUGGY

RPM package can not be installed.

qemuppc

GOOD

Unfs does not work with qemuppc

qemumips

GOOD

The image can not boot up.

Core Build System

BUGGY

Skeleton initscript can not start with minimal image.

Power/Performance

GOOD

Power consumption of sugarbay and crownbay are 37.50W and 23.96W respectively

Compliance

GOOD

LTP result: https://wiki.yoctoproject.org/wiki/LTP_result
POSIX result: https://wiki.pokylinux.org/wiki/Posix_result

Stress

GOOD

Except for Helltest on Beagleboard is on running, Helltest and crashme could pass 24 hours testing

ADT

BUGGY

Unfs does not work with qemuppc;

HOB

BUGGY

Packages not reload correctly when changing Machine type; User could not build other package/image after one build finished;  image do_rootfs build fail with packages deselected against base image.

Critical bugs, more than 50% test cases are blocked

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

Normal, Major and Critical bugs, and more than 10% test cases failed

Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Sugarbay Sato-SDK

62

0

59

1 (bug 1236)

2 (bug 883)

Jasperforest Sato-SDK

34

0

33

1 (bug 1188)

0

n450 Sato-SDK

58

0

58

0

0

eMenlow Sato-SDK

58

0

56

2 (bug 310, 503)

0

Crownbay-Sato-SDK

59

0

59

0

0

Beagleboard

40

0

37

3 (bug 1352, 1234)

0

Routerstationpro

33

0

33

0

0

Mpc8315e-rdb

36

0

36

0

0

Qemux86-64 Sato

30

0

28

2 (bug 1174, 1234)

0

Qemux86-64 Sato-SDK

35

0

32

3 (bug 1174, 1234, 1236)

0

Qemux86 Sato

30

0

28

2 (bug 1174, 1234)

0

Qemux86 Sato-SDK

35

0

33

2 (bug 1174, 1234)

0

Qemumips Sato

30

0

29

1 (bug 1234)

0

Qemumips Sato-SDK

35

0

34

1 (bug 1234)

0

Qemuppc Sato

22

0

21

1 (bug 414)

0

Qemuppc Sato-SDK

27

0

26

1 (bug 414)

0

Qemuarm Sato

30

0

24

6 (bug 1352, 1234)

0

Qemuarm Sato-SDK

35

0

29

6 (bug 1352, 1234)

0

Core Build System

24

0

16

8 (bug 1358, 1361, 1362, 1165, 1210)

0

Power/Performance

4

0

4

0

0

Compliance

2

0

2

0

0

Stress

2

0

2

0

0

ADT

6

0

5

1 (bug 414)

0

HOB

30

0

27

3 (bug 1281, 1285, 1364)

0

Total

757

0

711

44

2

Commit Information
---------------------------------------

For Blacksand/Crownbay/Sugarbay/Jasperforest/Qemuarm/mips/ppc/beagleboard/mpc8315e-rdb/routerstationpro:

Tree/Branch: Poky/1.1_M3
Poky Commit id: abdec68876ac7ce1a6d5c223d1757b7e8a14b85f
Meta Branch 1.1_M3
Meta Commit id: da93dc24fd73079b4dbb6811b83e44a2036d54ef

For Emenlow:

Tree/Branch: Poky/1.1_M3
Poky Commit id: abdec68876ac7ce1a6d5c223d1757b7e8a14b85f
Meta Branch 1.1_M3
Meta Commit id: 09e70dff36a1c204f76fe07c08a4f37f526728fe

For Toolchain/Qemux86/Qemux86-64：

Tree/Branch: Poky/1.1_M3
Poky Commit id: 1580d1624647bc07ffd4997b6c8cfbccd8040fc5

Issue Summary
---------------------------------------

Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 503 - [emenlow] system cannot enter S3 standby mode

1.1

Bug 883 - [Sugarbay] GFX 3D game test fail to run with sugarbay BSP image due to libsdl.so

1.1

Bug 1174: [zypper/rpm] package install/removal costs lots of disk space

1.1 M2

Bug 1234: No response when I click the 'Install/Remove Software' icon

1.1 M3

Bug 1352: [qemuarm] RPM package can not be installed with 20110806 build

1.1 M4

Other

Bug 310 - [eMenlow] i2c_transfer error on e-Menlow

1.1

Bug 1188 - [japerforest] I/OAT DMA engine init failed

1.1

Bug 1236 - Broken ldd due to wrong path for ld.so

1.1 M3

Bug 1258 -[crownbay] Xorg eats lots of CPU time after standby

1.1 M4

Core Build System

Bug 1165 - Skeleton initscript can not start with minimal image

1.1 M3

Bug 1210: Some commands run failed on minimal images according to steps on minimal image wiki

1.1 M4

New! Bug 1358 - do_package_write_rpm failed for sysvinit-inittab and update-rc.d on Fedora 15

---

New! Bug 1361 - empty.c: code model not supported in 32bit mode error with lib32 image build

1.1

New! Bug 1362 - gcc-cross-intermediate build failure in lib64 multilib case

1.1 M4

Power/Performance

Power consumption of sugarbay and crownbay are 34.26W and 23.30W respectively

Compliance

LTP test result is on https://wiki.pokylinux.org/wiki/LTP_result
POSIX test result is on https://wiki.pokylinux.org/wiki/Posix_result

Stress

Helltest and Crashme could pass 24 hours testing on Jasperforest. Crashme could pass 24 hours testing on Beagleboard also. But LTP stress is running

ADT

Bug 414: [PPC] kernel panic when booting poky-image-sdk-qemuppc through UNFS

1.1 M3

HOB

Bug 1281 - packages not reload correctly when changing Machine type

1.1

Bug 1285 - User could not build other package/image after one build finished

1.1

New! Bug 1359 - [HOB] package number is not consistent with user customized bb file

1.1

New! Bug 1360 - [HOB] user customized bb file has no machine information

1.1

New! Bug 1364 - [HOB] image do_rootfs build fail with packages deselected against base image

1.1

There remains 18 open bugs for hob now, refer to @ Bugzilla

Verified Fixed Bug:
---------------------------------------

1.     Bug 1211<http://bugzilla.pokylinux.org/show_bug.cgi?id=1211> - [Blacksand] Psplash failed when boot up Yocto

2.     Bug 1257<http://bugzilla.pokylinux.org/show_bug.cgi?id=1257> - [crownbay] broken grub due to wrong root path

3.     Bug 1317<http://bugzilla.pokylinux.org/show_bug.cgi?id=1317> - [Qemux86-64]sato and sato-sdk images boot failed

4.     Bug 1318<http://bugzilla.pokylinux.org/show_bug.cgi?id=1318> - [Toolchain] wrong path to ld.so for x86_64 toolchain

5.     Bug 1351<http://bugzilla.pokylinux.org/show_bug.cgi?id=1351> - [emenlow] hdd image not found

6.     Bug 1314<http://bugzilla.pokylinux.org/show_bug.cgi?id=1314> - toolchain do_populate_sdk failed on autobuilder for arm/mips/ppc with 20110730 build

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110812/0dc7101a/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Yocto 1.1 M3 RC3 detail_testreport-fullpass.ods
Type: application/oleobject
Size: 22842 bytes
Desc: Yocto 1.1 M3 RC3 detail_testreport-fullpass.ods
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110812/0dc7101a/attachment.bin>