[yocto] Fullpass Test Report for Yocto 1.1 M4 RC4 Build

Fri Oct 14 10:50:09 PDT 2011

Hi All,
       This is the fullpass test report for Yocto 1.1 M4 RC4 build. There is no new bug found except for the 4 bugs found in weekly testing. There is no open major bugs for 1.1 now. Basic functions of all components, including hob and multilib, could work well. There is no distribution specific issue found against N+1 distros for Fedora, Opensuse and Ubuntu. Texinfo build could not pass, which blocks world build for all distributions. QA verified the new emenlow image from autobuilder, and the glx commands segfault issue is fixed in this build. LTP testing on Sugarbay and Blacksand is still on-going, which will be finished next Monday.
Note: for difference image build against difference commit/branch, please refer to ‘commit information’ section for detail information. The test report is archived @ https://wiki.pokylinux.org/wiki/Yocto_1.1_Milestone_Test_Report

Test Summary:
---------------------------------------
Test Result Summary

Component

Target

Status

Comments

BSP

eMenlow

GOOD

I2C_transfer error; Standby failed;

Blacksand

GOOD

Everything runs well

Crownbay-emgd

GOOD

Xorg eat lots of cup's resource after standby

Sugarbay

GOOD

Everything runs well

Jasperforest-lsb

GOOD

I/OAT DMA engine init failed;

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

QEMU

qemux86

GOOD

Everything runs well

qemux86-64

GOOD

Everything runs well

qemuarm

GOOD

Everything runs well

qemuppc

GOOD

Everything runs well

qemumips

GOOD

Everything runs well

ADT

GOOD

Everything runs well

Distribution Support

GOOD

No distribution specific issue. texinfo build blocks world build

Core build system

BUGGY

opkg package information not show multilib installed packages; x32 build couldn't work due to broken source URL

Power/Performance

GOOD

Power consumption of sugarbay and crownbay are 40.21W and 18.73W respectively

Compliance

in process

LTP testing on Sugarbay and Blacksand is on-going.

Stress

GOOD

Both Crashme and Helltest on Jasperforest and both Crashme and LTP on Beagleboard could pass 24 hours stress testing.

HOB

GOOD

Deb/ipk build not proceed by showing some packages being built; hob crash when opening customized bb file with Ubuntu 10.10.

Critical bugs, more than 50% test cases are blocked

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

Normal, Major and Critical bugs, and more than 10% test cases failed

Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

eMenlow Sato-SDK

63

0

61

2 (bug 310, 503)

0

n450 Sato-SDK

63

0

63

0

0

Crownbay-Sato-SDK

64

0

64

0

0

Sugarbay Sato-SDK

67

0

67

0

0

Jasperforest lsb-SDK

32

0

31

1 (bug 1188)

0

Beagleboard Sato-SDK

39

0

39

0

0

Routerstationpro Sato-SDK

33

0

33

0

0

Mpc8315e-rdb Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

29

0

28

1 (bug 1174)

0

Qemux86-64 Sato-SDK

34

0

33

1 (bug 1174)

0

Qemux86 Sato

28

0

27

1 (bug 1174)

0

Qemux86 Sato-SDK

34

0

33

1 (bug 1174)

0

Qemuarm Sato

29

0

29

0

0

Qemuarm Sato-SDK

34

0

34

0

0

Qemumips Sato

29

0

29

0

0

Qemumips Sato-SDK

34

0

34

0

0

Qemuppc Sato

21

0

21

0

0

Qemuppc Sato-SDK

26

0

26

0

0

ADT

6

0

6

0

0

Core build system

30

0

27

3 (bug 1522, 1529)

0

Power & Performance

5

0

5

0

0

Compliance

2

0

2

0

0

Stress

3

0

3

0

0

HOB

26

0

24

2 (bug 1665)

0

Total

767

0

755

12

0

Commit Information
---------------------------------------

For Blacksand/Crownbay/Sugarbay/Jasperforest/Qemux86/toolchain:

Tree/Branch: Poky/Edison
Commit id: bc885cd8d343ad003391222429222526dba175ad
Meta branch: Edison
Commit id: fd7eee18e38ae45efaa299f015aedd4dc3257e6d

For eMenlow:

Tree/Branch: Poky/Edison
Commit id: 5ed59ae0f25bf673d514df2371da7e0415b62bb2
Meta branch: Edison
Commit id: c3e12aa981e97261093abee05bb0301c35f54c23

For QemuArm/QemuMips/QemuPPC/Beagleboard/Routerstationpro/Mpc8315e-rdb/toolchain:

Tree/Branch: poky/edison
Poky Commit: e02d553b45808b788c721c0722379d6b37c0b7d8

Issue summary
--------------------------------------

Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 503 - [emenlow] system cannot enter S3 standby mode

1.2

Bug 1082 - [x86_64] No icons shown on X desktop with sato image

1.0 M2

Bug 1174: [zypper/rpm] package install/removal costs lots of disk space

1.2

Other

Bug 310 - [eMenlow] i2c_transfer error on e-Menlow

1.1

Bug 1188 - [japerforest] I/OAT DMA engine init failed

1.2

Bug 1258 -[crownbay] Xorg eats lots of CPU time after standby

1.1 M4

Bug 1664 - texinfo do_compile fail due to makedoc binary not executable

1.2

Core build system

Bug 1529 - [x32] x32 build broken due to kernel.org fetch failure

1.1

Bug 1538 - [multilib]: X window doesn't startup in multilib image randomly

1.2

Bug 1522 - [multilib/ipk] /var/lib/opkg/status changed after the 1st boot

1.2

Bug 1502 - [multilib] lib64-dpkg is unbuildable for lib64 build

1.2

Power & Performance

Power consumption of sugarbay and crownbay are 40.21W and 18.73W respectively.
Build time for a sato image on Core i7 machine is 119 minutes. Detailed result on https://wiki.yoctoproject.org/wiki/Performance_Test.

Compliance

LTP result: https://wiki.pokylinux.org/wiki/LTP_result
POSIX result: https://wiki.pokylinux.org/wiki/Posix_result

Stress

Both Crashme and Helltest on Jasperforest and both Crashme and LTP on Beagleboard could pass 24 hours stress testing.

HOB

Bug 1663 - [HOB] hob crash when opening customized bb file with Ubuntu 10.10

---

Bug 1665 - [HOB] deb/ipk build not proceed by showing some packages being built

1.2

Distribution test summary:
--------------------------------------
Distribution

Host Arch

Target Machine

world build

core-sato-sdk build

Fedora 15

x86_64

qemux86

FAIL(bug 1664)

　PASS

Ubuntu 11.04

x86_64

qemuarm

FAIL(bug 1664)

　PASS

Opensuse 11.4

x86_64

qemuppc

FAIL(bug 1664)

　PASS

Fedora 16 Alpha

x86_64

qemumips

FAIL(bug1664))

　PASS

Ubuntu 11.10 Alpha3

x86_64

qemuarm

FAIL(bug 1664)

　PASS

Opensuse 12.1 M5

x86_64

qemumips

FAIL(bug 1664)

　PASS

Verify bug list
--------------------------------------

1.     bug 1496 - [multilib] lib32 build against qemux86 failed during do_rootfs

2.     bug 1497 - [multilib] lib32 build against qemux86-64 failed during do_rootfs

3.     bug 1498 - [multilib] lib64 build against qemux86 failed during do_rootfs

4.     bug 1527 - [multilib] lib64 build against qemux86-64 failed during do_rootfs

5.     bug 1235- [Emenlow] Running glxinfo and glxgears commands failed.

Best Regards,

Jiajun

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20111015/33a038b4/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Yocto 1.1 M4 RC4 detail_testreport-fullpass.ods
Type: application/oleobject
Size: 21042 bytes
Desc: Yocto 1.1 M4 RC4 detail_testreport-fullpass.ods
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20111015/33a038b4/attachment.bin>