[yocto] Fullpass Test Report for Yocto 1.2 M1 RC2 Build

Wed Dec 21 06:35:15 PST 2011

Hi All,
       This is the fullpass test report for Yocto 1.2 M1 RC2 build. There are 5 new bugs found with fullpass testing, while there are 15 open bugs for this build. All BSP and QEMU targets work well with some minor bugs. toolchain build has one failure with mpc8315e-rdb. For core build feature - hob2 could work with only one minor issue with layer selection. Multilib, x32 and non-GPLv3 build are found not workable with RC2 commit. For build performance, one qemux86 sato build on a Core i7 machine costs 104 minutes, which save 18% time compared with 1.1 M4 RC4 build(127 minutes).
Note: The test report is archived @ https://wiki.yoctoproject.org/wiki/Yocto_1.2_Milestone_Test_Report.

Test Summary:
---------------------------------------
Test Result Summary

Component

Target

Status

Comments

BSP

eMenlow

GOOD

I2C_transfer error; gsettings-data-convert segfault

Blacksand

GOOD

gsettings-data-convert segfault; glxgear fails to run

Crownbay-emgd

GOOD

gsettings-data-convert segfault;Xorg eat lots of cpu's resource after standby

Sugarbay

GOOD

gsettings-data-convert segfault;

Jasperforest-lsb

GOOD

Everything runs well

Beagleboard

GOOD

syslogd can not startup

Routerstationpro

GOOD

syslogd can not startup

Mpc8315e-rdb

GOOD

syslogd can not startup

QEMU

qemux86

GOOD

gsettings-data-convert segfault

qemux86-64

GOOD

gsettings-data-convert segfault

qemuarm

GOOD

syslogd can not startup

qemuppc

GOOD

syslogd can not startup

qemumips

GOOD

syslogd can not startup

ADT

GOOD

toolchain build has one failure with mpc8315e-rdb

Core build system

BUGGY

multilib, x32 and non-GPLv3 buld could not work

Power/Performance

GOOD

Power consumption of sugarbay and crownbay are 43.34W and 19.39W respectively

Compliance

GOOD

No regression issue with LTP and POSIX

Stress

GOOD

Both Crashme and Helltest on Jasperforest and both Crashme and LTP on Beagleboard could pass 24 hours stress testing.

HOB

GOOD

Hob hang if no meta-intel layer added for BSP build

Critical bugs, more than 50% test cases are blocked

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

Normal, Major and Critical bugs, and more than 10% test cases failed

Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

eMenlow Sato-SDK

64

0

63

1 (bug 310, 1779)

0

n450 Sato-SDK

64

0

62

2 (bug 1779, 1840)

0

Crownbay-Sato-SDK

64

0

62

2 (bug 1779, 1258)

0

Sugarbay Sato-SDK

67

0

66

1 (bug 1779)

0

Jasperforest lsb-SDK

32

0

32

0

0

Beagleboard Sato-SDK

40

0

40

0

0

Routerstationpro Sato-SDK

33

0

33

0

0

Mpc8315e-rdb Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

30

0

30

0

0

Qemux86-64 Sato-SDK

35

0

34

1 (bug 1779)

0

Qemux86 Sato

30

0

30

0

0

Qemux86 Sato-SDK

35

0

34

1 (bug 1779)

0

Qemuarm Sato

30

0

30

0

0

Qemuarm Sato-SDK

35

0

35

0

0

Qemumips Sato

30

0

30

0

0

Qemumips Sato-SDK

35

0

35

0

0

Qemuppc Sato

21

0

21

0

0

Qemuppc Sato-SDK

26

0

26

0

0

ADT

6

0

6

0

0

Core build system

32

0

22

10 (bug 1835, 1849, 1854)

0

Power & Performance

5

0

5

0

0

Compliance

2

0

2

0

0

Stress

3

0

3

0

0

HOB

13

0

12

1 (bug 1842)

0

Total

768

0

749

19

0

Commit Information
---------------------------------------
Tree/Branch: Poky/1.2_M1
Commit id: b806f726b1db2cb605869c1022ef727c1110255b
Meta branch: master
Commit id: b6d5d9a3b06caf578103a04dc5fcf5e476343205

Issue summary
--------------------------------------
Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 310 - [eMenlow] i2c_transfer error on e-Menlow

1.1

New! Bug 1848 - syslogd can not startup with 1.2 M1 20111213 build

1.2 M2

Bug 1779 - gsettings-data-convert segfault on sdk image

1.2 M1

Bug 1823 - [Bealgeboard C4] keyboard could not work with 20111207 build

1.2 M2

Bug 1825: Application 'Dates' can not be launched with 20111207 build

Bug 1840 - glxgears fail to run on Blacksand

1.2 M2

New! Bug 1843 - Error screen when I input "clear" in the terminal

1.2 M2

Bug 1258 -[crownbay] Xorg eats lots of CPU time after standby

Bug 1826: [HuronRiver] only 3/4 screen is used when psplash loading

1.2 M2

Core Build System

Bug 1835 - [multilib] no provider for lib32-shadow-sysroot

1.2 M2

New! Bug 1849 - gnutls 2.12.14 fails to compile due to gexttext mismatch

New! Bug 1855 - [bitbake-layers] no attribute 'fetch2' error with a new working dir

New! Bug 1854 - [x32] openssl do_configure fail for x32 build

ADT

Bug 1841 - 1.2_M1 build broken for meta-toolchain-sdk

　1.2 M2

Compliance

LTP result: https://wiki.yoctoproject.org/wiki/LTP_result
POSIX result: https://wiki.pokylinux.org/wiki/Posix_result

Hob2

Bug 1842 - [Hob2] there should be a warning when meta-intel layer not added for BSP build

1.2

Stress

Both Crashme and Helltest on Jasperforest and both Crashme and LTP on Beagleboard could pass 24 hours stress testing.

Power & Performance

Power consumption of sugarbay and crownbay are 43.34W and 19.39W respectively.
Build time for a sato image on Core i7 machine is 104 minutes. Detailed result on https://wiki.yoctoproject.org/wiki/Performance_Test.

Best Regards,

Jiajun

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20111221/7c80653a/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Yocto 1.2 M1 RC2 detail_testreport-fullpass.ods
Type: application/oleobject
Size: 24785 bytes
Desc: Yocto 1.2 M1 RC2 detail_testreport-fullpass.ods
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20111221/7c80653a/attachment.bin>