[yocto] Fullpass Test Report for Yocto 1.1 M4 RC3 20110923 Build

Fri Sep 30 08:14:01 PDT 2011

Hi All,
       This is the fullpass test report for Yocto 1.1 M4 20110923 build. There are 2 new bugs found. x32 build could not work due to kernel.org fetch failure. All lib32/lib64 build against qemux86/qemux86-64 could not work, which should be fixed in master. Hob does not work stable with ipk/deb switching. There is no regression issue found for performance testing. Both Crashme/Helltest testing on Jasperforest and LTP testing on Beagleboard could pass 24 hours stress testing.
Note：For different images, they are built against different commit/branch on autobuilder. You can refer to “Commit Information” section for detailed information. The test report is archived @https://wiki.pokylinux.org/wiki/Yocto_1.1_Milestone_Test_Report

Test Summary:
---------------------------------------
Test Result Summary

Component

Target

Status

Comments

BSP

eMenlow

GOOD

I2C_transfer error; Standby failed;

Blacksand

GOOD

Everything runs well

Crownbay-emgd

GOOD

Xorg eat lots of cup's resource after standby

Sugarbay

GOOD

Everything runs well

Jasperforest-lsb

GOOD

I/OAT DMA engine init failed;

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

QEMU

qemux86

GOOD

Everything runs well

qemux86-64

GOOD

Everything runs well

qemuarm

GOOD

Everything runs well

qemuppc

GOOD

Everything runs well

qemumips

GOOD

Everything runs well

ADT

GOOD

Everything runs well

Core build system

BUGGY

Multilib could not work; lib32/lib64 build against qemux86/qemux86-64 could not work; x32 build not work due to broken source URL.

Power/Performance

GOOD

Power consumption of sugarbay and crownbay are 42.91W and 23.82W respectively
Build time for a sato image on Core i7 machine is 127 minutes.

Compliance

GOOD

No regression for LTP and POSIX

Stress

GOOD

Both Crashme/Helltest testing on Jasperforest and LTP testing on Beagleboard could pass 24 hours stress testing.

HOB

BUGGY

Switching package format in hob is unstable;

Critical bugs, more than 50% test cases are blocked

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

Normal, Major and Critical bugs, and more than 10% test cases failed

Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

eMenlow Sato-SDK

63

0

61

2 (bug 310, 503)

0

n450 Sato-SDK

73

0

73

0

0

Crownbay-Sato-SDK

74

0

73

1 (bug 1258)

0

Sugarbay Sato-SDK

67

0

67

0

0

Jasperforest lsb-SDK

32

0

31

1 (bug 1188)

0

Beagleboard Sato-SDK

39

0

39

0

0

Routerstationpro Sato-SDK

33

0

33

0

0

Mpc8315e-rdb Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

29

0

28

1 (bug 1174)

0

Qemux86-64 Sato-SDK

34

0

33

1 (bug 1174)

0

Qemux86 Sato

29

0

28

1 (bug 1174)

0

Qemux86 Sato-SDK

34

0

33

1 (bug 1174)

0

Qemuarm Sato

29

0

29

0

0

Qemuarm Sato-SDK

34

0

34

0

0

Qemumips Sato

29

0

29

0

0

Qemumips Sato-SDK

34

0

34

0

0

Qemuppc Sato

21

0

21

0

0

Qemuppc Sato-SDK

26

0

26

0

0

ADT

6

0

6

0

0

Core build system

31

0

22

9 (bug 1496, 1497, 1498, 1519, 1522, 1527, 1529)

0

Power & Performance

5

0

5

0

0

Compliance

2

0

2

0

0

Stress

3

0

3

0

0

HOB

26

0

24

2 (bug 1521)

0

Total

789

0

770

17

0

Commit Information
---------------------------------------

For Crownbay:
Tree/Branch: Poky/Edison
Commit id: 0e9784d26df51bd564b8f23bd40a6c36969abd5c
Meta branch: Edison
Commit id: 7eb193fc4994b880ce115fc00fb52b4d9cda530e

For eMenlow/Blacksand/Sugarbay/Jasperforest/Qemex86-64/:
Tree/Branch: Poky-contrib/Edison
Commit id: 0e9784d26df51bd564b8f23bd40a6c36969abd5c
Meta branch: Edison
Commit id: d1e7b21f79d3ecfc6fbdb1d995f0b6e6bff8bea5

For Beagleboard/Routerstationpro/Mpc8315e-rdb/QemuArm/QemuMips/QemuPPC:
Tree/Branch: Poky/edison
Commit id: 41c564fe605fa4685fd27b1721e3424ac8a96db1

Issue Summary
---------------------------------------
Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 503 - [emenlow] system cannot enter S3 standby mode

1.1

Bug 1082 - [x86_64] No icons shown on X desktop with sato image

1.0 M2

Bug 1174: [zypper/rpm] package install/removal costs lots of disk space

1.1 M3

Other

Bug 310 - [eMenlow] i2c_transfer error on e-Menlow

1.1

Bug 1188 - [japerforest] I/OAT DMA engine init failed

post 1.1

Bug 1258 -[crownbay] Xorg eats lots of CPU time after standby

1.1 M4

Core build system

New! Bug 1527 - [multilib] lib64 build against qemux86-64 failed during do_rootfs

1.1

New! Bug 1529 - [x32] x32 build broken due to kernel.org fetch failure

1.1

Bug 1496 - [multilib] no lib32-task-core-ssh-dropbear found for lib32 image build

1.1

Bug 1497 - [multilib] lib32 build against qemux86-64 failed during do_rootfs

1.1

Bug 1498 - [multilib] lib64 build against qemux86 failed during do_rootfs

1.1

Bug 1519 - [multilib/rpm] X not start up with lib32 build with connman against qemux86-64

Bug 1522 - [multilib/ipk] /var/lib/opkg/status changed after the 1st boot

Bug 1502 - [multilib] lib64-dpkg is unbuildable for lib64 build

post 1.1

Power & Performance

Power consumption of sugarbay and crownbay are 42.91W and 23.82W respectively.
Build time for a sato image on Core i7 machine is 127 minutes. Detailed result on https://wiki.yoctoproject.org/wiki/Performance_Test.

Compliance

LTP result: https://wiki.yoctoproject.org/wiki/LTP_result
POSIX result: https://wiki.pokylinux.org/wiki/Posix_result

Stress

Both Crashme and Helltest testing on Jasperforest could pass 24 hours stress testing.

Hob

Bug 1521 - Switching package format in hob is unstable

1.1

Verified Fixed Bug:
---------------------------------------

1.     Bug 1493<http://bugzilla.pokylinux.org/show_bug.cgi?id=1493> - gcc-cross-canadian set to 4.6 when GCCVERSION is 4.5.1

2.     Bug 1480<http://bugzilla.pokylinux.org/show_bug.cgi?id=1480> - [HOB] Could not trigger another build after stop build

3.     Bug 1492<http://bugzilla.pokylinux.org/show_bug.cgi?id=1492> - non-GPLv3 build broken with incompatible license for gcc-crosssdk-intermediate

4.     Bug 1495<http://bugzilla.pokylinux.org/show_bug.cgi?id=1495> - [x32] No tclibc-glibc.inc found for x32 build

5.     Bug 1493<http://bugzilla.pokylinux.org/show_bug.cgi?id=1493> - gcc-cross-canadian set to 4.6 when GCCVERSION is 4.5.1

Best Regards,

Jiajun
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110930/ef9ebe60/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Yocto 1.1 M4 RC3 - 20110923 detail_testreport-fullpass.ods
Type: application/oleobject
Size: 21223 bytes
Desc: Yocto 1.1 M4 RC3 - 20110923 detail_testreport-fullpass.ods
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110930/ef9ebe60/attachment.bin>