[yocto] Fullpass Test Report for Yocto 1.1 M4 RC2 20110914 Build

[Xu, Jiajun]

Hi All,
       This is the fullpass test report for Yocto 1.1 M4 RC2 build. There are 7 new bugs found in this testing. Sugarbay testing is blocked due to sato-sdk image not copied to sharing folder on autobuilder. Most multilib function could not work. non-GPLv3 build reports error when building core-image-basic. Basic functions of hob work well, except for the issues that 2nd build could not work after force stop 1st build and non-GPLv3 de-selection not work issue. x32 build could not work, meanwhile Nitin has fixed the issue in latest commit. Xorg eats lots of CPU’s resource issue still exists on crownbay. Both Crashme/Helltest testing on Jasperforest and LTP testing on Beagleboard could pass 24 hours stress testing.
       Note: for different image they are against different commit/branch information, you can refer to ‘Commit Information’ section for detail information. This test result is archived @ https://wiki.pokylinux.org/wiki/Yocto_1.1_Milestone_Test_Report


Test Summary:
---------------------------------------
Test Result Summary

Component

Target

Status

Comments

BSP

eMenlow

GOOD

I2C_transfer error; Standby failed;

Blacksand

GOOD

Everything runs well

Crownbay-emgd

GOOD

Xorg eat lots of cup's resource after standby

Sugarbay

GOOD

Everything runs well

Jasperforest-lsb

GOOD

I/OAT DMA engine init failed;

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

QEMU

qemux86

GOOD

Everything runs well

qemux86-64

GOOD

Everything runs well

qemuarm

GOOD

Everything runs well

qemuppc

GOOD

Everything runs well

qemumips

GOOD

Everything runs well

ADT

　

GOOD

Everything runs well

Core build system

　

BUGGY

Multilib could not work; non-GPLv3 could not work

Power/Performance

　

GOOD

Power consumption of sugarbay and crownbay are 34.81W and 28.11W respectively
Build time for a sato image on Core i7 machine is 124 minutes.

Compliance

　

GOOD

No regression for LTP and POSIX

Stress

　

GOOD

Both Crashme/Helltest testing on Jasperforest and LTP testing on Beagleboard could pass 24 hours stress testing.

HOB

　

BUGGY

Could not trigger 2nd build after stop one build; non-GPLv3 deselection not work


　

Critical bugs, more than 50% test cases are blocked

　

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

　

Normal, Major and Critical bugs, and more than 10% test cases failed



Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

eMenlow Sato-SDK

58

0

56

2 (bug 310, 503)

0

n450 Sato-SDK

58

0

58

0

0

Crownbay-Sato-SDK

58

0

58

0

0

Sugarbay Sato-SDK

61

0

61

0

0

Jasperforest lsb-SDK

32

0

31

1 (bug 1188)

0

Beagleboard Sato-SDK

39

0

39

0

0

Routerstationpro Sato-SDK

33

0

33

0

0

Mpc8315e-rdb Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

29

0

28

1 (bug 1174)

0

Qemux86-64 Sato-SDK

34

0

33

1 (bug 1174)

0

Qemux86 Sato

28

0

27

1 (bug 1174)

0

Qemux86 Sato-SDK

34

0

33

1 (bug 1174)

0

Qemuarm Sato

29

0

29

0

0

Qemuarm Sato-SDK

34

0

34

0

0

Qemumips Sato

29

0

29

0

0

Qemumips Sato-SDK

34

0

34

0

0

Qemuppc Sato

21

0

21

0

0

Qemuppc Sato-SDK

26

0

26

0

0

ADT

6

0

5

1 (bug 1466)

0

Core build system

32

0

20

12 (bug 1492, 1493, 1496, 1497, 1498, 1502，1495)

0

Power & Performance

5

0

5

0

0

Compliance

2

0

2

0

0

Stress

3

0

3

0

0

HOB

23

0

22

1 (bug 1480)

0

Total

744

0

723

21

0



Commit Information
---------------------------------------

For Qemux86/Qemux86-64:

Tree/Branch: Poky-contrib/Master_under_test
Commit id: 0e9784d26df51bd564b8f23bd40a6c36969abd5c
Meta Branch: Master-under_test
Commit id: 6e19ec6948f012b588016842d991b336dc848163

For eMenlow/Crownbay/Sugarbay:

Tree/Branch: Poky/1.1_M4
Commit id: bb4a5c44da23a1bb363f1f081cf1644fd7975957
Meta Branch: 1.1_M4
Commit id: 49277afd9e5e510f7b1f82fd8cd10732e3bf2633

For Blacksand/Jasperforest:

Tree/Branch: Poky/Master
Commit id: 92518c5017945d29099b029a7c2bf80261287d6e
Meta Branch: Master
Commit id: 49277afd9e5e510f7b1f82fd8cd10732e3bf2633


For QemuArm/QemuMips/QemuPPC/Beagleboard/Routerstationpro/Mpc8315-rdb:

Tree/Branch: poky-contrib/rc2
Poky Commit: 6e19ec6948f012b588016842d991b336dc848163



Issue Summary
---------------------------------------
Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 503 - [emenlow] system cannot enter S3 standby mode

1.1

Bug 1082 - [x86_64] No icons shown on X desktop with sato image

1.0 M2

Bug 1174: [zypper/rpm] package install/removal costs lots of disk space

1.1 M3

Other

Bug 310 - [eMenlow] i2c_transfer error on e-Menlow

1.1

Bug 1188 - [japerforest] I/OAT DMA engine init failed

post 1.1

Bug 1258 -[crownbay] Xorg eats lots of CPU time after standby

1.1 M4

Core build system

New!  Bug 1492 - non-GPLv3 build broken with incompatible license for gcc-crosssdk-intermediate

1.1

New! Bug 1495 - [x32] No tclibc-glibc.inc found for x32 build

post 1.1

New! Bug 1496 - [multilib] lib32 build against qemux86 failed during do_rootfs

1.1

New! Bug 1497 - [multilib] lib32 build against qemux86-64 failed during do_rootfs

1.1

New! Bug 1498 - [multilib] lib64 build against qemux86 failed during do_rootfs

1.1

New! Bug 1502 - [multilib] lib64-dpkg is unbuildable for lib64 build

post 1.1

New! Bug 1493 -  gcc-cross-canadian set to 4.6 when GCCVERSION is 4.5.1

1.1

Power & Performance

Power consumption of sugarbay and crownbay are 34.81W and 28.11W respectively
Build time for a sato image on Core i7 machine is 124 minutes. Detailed result on https://wiki.yoctoproject.org/wiki/Performance_Test.

　

Compliance

LTP result: https://wiki.pokylinux.org/wiki/LTP_result
POSIX result: https://wiki.pokylinux.org/wiki/Posix_result

　

Stress

Both Crashme/Helltest testing on Jasperforest and LTP testing on Beagleboard could pass 24 hours stress testing.

　

HOB

Bug 1479 - [HOB] deselect non-GPLv3 option not work

1.1

Bug 1480 - [HOB] Could not trigger another build after stop build

1.1



Verified Fixed Bug:
---------------------------------------


1.     Bug 1444<http://bugzilla.pokylinux.org/show_bug.cgi?id=1444> - There is no emgd driver when build Crownbay images.


Best Regards,

Jiajun

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110922/fb2bd218/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Yocto 1 1 M4 RC2 detail_testreport-fullpass.ods
Type: application/oleobject
Size: 21924 bytes
Desc: Yocto 1 1 M4 RC2 detail_testreport-fullpass.ods
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110922/fb2bd218/attachment.bin>