[yocto] Fullpass Test Report for Yocto M4 Gold Build 20110318

Fri Mar 25 06:45:22 PDT 2011

Hi all,

       This is the fullpass test report for Gold Build 20110318. QA finished all functionality testing and now only stress testing is still on-going. 2 new bugs are found after last test report, and there are totally 5 new bugs found in Gold build testing. RPM query could not work with non-root user. Package information may be messed with GPLv3/non-GPLv3 building happened in same folder. Only 17 of total 542 cases are failed or blocked in our testing, with totally 8 open bugs. The two video performance bugs on n450 and crownbay noemgd are marked as WONTTFIX and NOTABUG.

For bug fixing, there are 17 bugs are verified as fixed. The good news is that we have verified all zypper/rpm bugs fixed in this build, except for only one zypper issue on qemuarm(bug 827). All the images and toolchain tarballs are built out. Audio/video come to work on blacksand again. There is no critical/major bug on both real hardware and qemu targets. 2D & 3D graphics benchmark on sugarbay shows a similar score with the result of Intel Graphics 2010Q4 release(Check the attached result for detailed score). non-GPLv3 build and sstate could work in QA testing now. Crownbay emgd and noemgd image could work with only one S3 bug. N450 also has 2 non-critical bugs, which have minor impacts. Jasperforest, as well as routerstationpro and mpc8315e-rdb, pass the testing without any failure.

Note: The beagleboard board is broken so we could not perform testing for this build. LSB test result is in attachment as Xiaofeng sent out previously.

Test Summary
---------------------------------------

Test Result Summary

Component

Target

Status

Comments

BSP

SugarBay

GOOD

Everything runs well; 2D & 3D graphics benchmark shows a similar score with Intel Graphics 2010Q4 relase score;

CrownBay

GOOD

S3 does not work;

JasperForest

GOOD

Everything runs well

Blacksand

GOOD

xuser has no privilege to run rpm query; S3 does not work;

Beagleboard

N/A

No test because the board is broken

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

QEMU

qemux86

GOOD

Everything runs well

qemux86-64

GOOD

Everything runs well

qemuarm

GOOD

zypper could only show partial packages installed on system;

qemuppc

GOOD

gcc may segfault;

qemumips

GOOD

Everything runs well

SDK

Buggy

unfs does not work with qemuppc

Documentation

GOOD

Poky handbook is tried and no issue found

Compliance Test

GOOD

Testing is finished, but still needs analysis. No critical bug found till now

Poky

GOOD

non-GPLv3 build and sstate work well now;

Stress Test

GOOD

Testing is not finished yet, has no issue till now

Critical bugs, more than 50% test cases are blocked

Only Normal, Minor or Enhancement bugs, less than 10% test cases failed

Normal, Major and Critical bugs, more than 10% test cases failed

Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Crownbay emgd Sato-SDK

54

0

51

1 (bug 882)

2 (bug 882)

Crownbay noemgd Sato-SDK

50

0

47

1 (bug 882)

2 (bug 882)

Sugarbay Sato-SDK

59

0

59

0

0

Jasperforest LSB-SDK

33

0

33

0

0

n450 Sato-SDK

56

0

52

2 (bug 607, 613)

2 (bug 613)

Routerstationpro Sato-SDK

30

0

30

0

0

Mpc8315e-rdb Sato-SDK

29

0

29

0

0

Qemux86-64 Sato

21

0

21

0

0

Qemux86-64 Sato-SDK

24

0

24

0

0

Qemux86 Sato

21

0

21

0

0

Qemux86 Sato-SDK

24

0

24

0

0

Qemumips Sato

21

0

21

0

0

Qemumips Sato-SDK

24

0

24

0

0

Qemuppc Sato

18

0

18

0

0

Qemuppc Sato-SDK

21

0

19

2 (bug 780)

0

Qemuarm Sato

21

0

19

2 (bug 827)

0

Qemuarm Sato-SDK

24

0

22

2 (bug 827)

0

SDK

3

0

2

1 (bug 414)

0

Poky

8

0

8

0

0

Documentation

1

0

1

0

0

Total

542

0

525

11

6

* You can check the detailed test result in attachment for each target.

** The failed/blocked case number is listed with failed cases’ bug number.

Images
---------------------------------------

Image: http://autobuilder.pokylinux.org/nightly/20110318-3/

Tree/Branch: Poky/Bernard

Commit: 82af8b9fb6d6d1439943fd15b8a75c0e663e4a45

Issue Summary
---------------------------------------

Zypper/RPM:

1.     [zypper] zypper can not search any packages after installed package by rpm on qemuarm

http://bugzilla.pokylinux.org/show_bug.cgi?id=827

Poky:

1.     New! package information messed after building GPLv3/non-GPLv3 for several times

http://bugzilla.pokylinux.org/show_bug.cgi?id=929

Compliance:

1.     New! [POSIX] case pthread_cond_broadcast does not kill itself after finished

http://bugzilla.pokylinux.org/show_bug.cgi?id=927

BSP:

1.     New! [blacksand] it show poor performance with video player  --  Marked as WONTFIX

http://bugzilla.pokylinux.org/show_bug.cgi?id=921

2.     New! [crownbay-noemgd] video player has poor performance when playing video file  -- Marked as NOTABUG since it’s expected

http://bugzilla.pokylinux.org/show_bug.cgi?id=920

3.     New! "rpm -qa" can not run for non-root user: Permission denied

http://bugzilla.pokylinux.org/show_bug.cgi?id=922

4.     [Blacksand]system cannot enter S3 standby mode

http://bugzilla.pokylinux.org/show_bug.cgi?id=613

5.     [crownbay] system could not enter into S3 with crownbay

http://bugzilla.pokylinux.org/show_bug.cgi?id=882

6.     [Sugarbay] GFX 3D game test fail to run with sugarbay BSP image due to libsdl.so

http://bugzilla.pokylinux.org/show_bug.cgi?id=883

7.     [Blacksand] Some error information prompted when run dmesg command

http://bugzilla.pokylinux.org/show_bug.cgi?id=607

SDK:

1.     [PPC] kernel panic when booting poky-image-sdk-qemuppc through UNFS

http://bugzilla.pokylinux.org/show_bug.cgi?id=414

Others:

1.     gcc segfault on qemuppc (nightly build 20110226-1)

http://bugzilla.pokylinux.org/show_bug.cgi?id=780

Verified Fixed Bugs:

1.     [crownbay] emgd crownbay build fail on xserver-xf86-emgd fetch

http://bugzilla.pokylinux.org/show_bug.cgi?id=885

2.     [n450]Blacksand keyboard/mouse do not work on X window

http://bugzilla.pokylinux.org/show_bug.cgi?id=869

3.     matchbox-panel segfault after X startup

http://bugzilla.pokylinux.org/show_bug.cgi?id=738

4.     [autobuilder] i686 toolchain not copied to sharing folder

http://bugzilla.pokylinux.org/show_bug.cgi?id=884

5.     audio mixer on BlackSand is muted on boot

http://bugzilla.pokylinux.org/show_bug.cgi?id=439

6.     [blacksand] no sound even all options in amixer enabled

http://bugzilla.pokylinux.org/show_bug.cgi?id=798

7.     [blacksand] configured audiosink is not working for video player

http://bugzilla.pokylinux.org/show_bug.cgi?id=799

8.     [Connman] xuser must be granted privilege to start connman-applet

http://bugzilla.pokylinux.org/show_bug.cgi?id=779

9.     The bottom icons on Applications and All screen are cut-off in qemu.

http://bugzilla.pokylinux.org/show_bug.cgi?id=658

10.  [zypper] zypper install does not work on qemux86/atom-pc

http://bugzilla.pokylinux.org/show_bug.cgi?id=803

11.  [zypper] zypper lose package information after zypper/rpm install/remove

http://bugzilla.pokylinux.org/show_bug.cgi?id=804

12.  [zypper] installation failure on ppc (nightly build 20110305-4)

http://bugzilla.pokylinux.org/show_bug.cgi?id=841

13.  [zypper] zypper install failed on routerstationpro sdk image

http://bugzilla.pokylinux.org/show_bug.cgi?id=845

14.  rpm remove package error

http://bugzilla.pokylinux.org/show_bug.cgi?id=787

15.  [zypper] package removal failure

http://bugzilla.pokylinux.org/show_bug.cgi?id=491

16.  [sstate] do_configure failed with libtool-cross when local sstate cache used

http://bugzilla.pokylinux.org/show_bug.cgi?id=894

17.  Fail to build non-GPLv3 image

http://bugzilla.pokylinux.org/show_bug.cgi?id=712

Best Regards,

Jiajun
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110325/d9d10dcf/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: M4-Gold_20110318_detail_testreport_fullpass.ods
Type: application/oleobject
Size: 29727 bytes
Desc: M4-Gold_20110318_detail_testreport_fullpass.ods
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110325/d9d10dcf/attachment.bin>
-------------- next part --------------
An embedded message was scrubbed...
From: Xiaofeng Yan <xiaofeng.yan at windriver.com>
Subject: Status for lsb test for yocto 1.1 (2011-03-25)
Date: Fri, 25 Mar 2011 13:31:35 +0800
Size: 74033
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110325/d9d10dcf/attachment.mht>