[yocto] Partial Fullpass Test Report for Yocto M4 Gold Build 20110318

Tue Mar 22 06:27:17 PDT 2011

Hi all,

       This is the partial fullpass test report for Gold Build 20110318. QA finished most functionality testing in images. 3 new bugs are reported for multimedia and rpm query with rootless X. We found the performance of video playing is poor with n450 and crownbay noemgd images. Rpm query with non-root user could not work. Till now, only 12 of total 477 cases are failed or blocked in our testing, with totally 9 open bugs.

For bug fixing, there are 14 bugs are verified as fixed. The good news is that we have verified all zypper/rpm bugs fixed in this build, except for only one zypper issue on qemuarm(bug 827). All the images and toolchain tarballs are built out. Audio/video come to work on blacksand again. Till now, both real and qemu targets could work well without critical/major bugs. 2D & 3D graphics benchmark on sugarbay shows a similar score with the result of Intel Graphics 2010Q4 release(Check the attached result for detailed score). Crownbay emgd and noemgd image could work with only 2 non-critical bugs. N450 also has 3 non-critical bugs, which have minor impacts. Jasperforest, as well as routerstationpro and mpc8315e-rdb, pass the testing without any failure.

Note: The beagleboard board is broken so we could not perform testing for this build. Testing result for other components, like documentation, compliance, etc, will be covered in the final fullpass testing report.

Test Summary
---------------------------------------

Test Result Summary

Component

Target

Status

Comments

BSP

SugarBay

GOOD

Everything runs well; 2D & 3D graphics benchmark shows a similar score with RC2;

CrownBay

GOOD

S3 does not work; Low performance when playing video on noemgd image;

JasperForest

GOOD

Everything runs well

Blacksand

GOOD

xuser has no privilege to run rpm query; S3 does not work; Low performance when playing video;

Beagleboard

N/A

No test because the board is broken

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

QEMU

qemux86

GOOD

Everything runs well

qemux86-64

GOOD

Everything runs well

qemuarm

GOOD

zypper could only show partial packages installed on system;

qemuppc

GOOD

Everything runs well

qemumips

GOOD

Everything runs well

SDK

Buggy

unfs does not work with qemuppc

Documentation

N/A

Testing is not started yet

Compliance Test

N/A

Testing is not started yet

Poky

N/A

Testing is not started yet

Stress Test

N/A

Testing is not started yet

Critical bugs, more than 50% test cases are blocked

Only Normal, Minor or Enhancement bugs, less than 10% test cases failed

Normal, Major and Critical bugs, more than 10% test cases failed

Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Crownbay emgd Sato-SDK

54

0

51

1 (bug 882)

2 (bug 882)

Crownbay noemgd Sato-SDK

50

0

47

1 (bug 882)

2 (bug 882)

Sugarbay Sato-SDK

59

0

59

0

0

Jasperforest LSB-SDK

33

0

33

0

0

n450 Sato-SDK

56

0

52

2 (bug 607, 613)

2 (bug 613

Routerstationpro Sato-SDK

20

0

20

0

0

Mpc8315e-rdb Sato-SDK

19

0

19

0

0

Qemux86-64 Sato

21

0

21

0

0

Qemux86-64 Sato-SDK

24

0

24

0

0

Qemux86 Sato

21

0

21

0

0

Qemux86 Sato-SDK

24

0

24

0

0

Qemumips Sato

15

0

15

0

0

Qemumips Sato-SDK

18

0

16

0

0

Qemuppc Sato

12

0

12

0

0

Qemuppc Sato-SDK

15

0

14

1 (bug 780)

0

Qemuarm Sato

15

0

15

0

0

Qemuarm Sato-SDK

18

0

18

0

0

SDK

3

0

2

1 (bug 414)

0

Total

477

0

463

6

6

* You can check the detailed test result in attachment for each target.

** The failed/blocked case number is listed with failed cases’ bug number.

Images
---------------------------------------

Image: http://autobuilder.pokylinux.org/nightly/20110318-3/

Tree/Branch: Poky/Bernard

Commit: 82af8b9fb6d6d1439943fd15b8a75c0e663e4a45

Issue Summary
---------------------------------------

Zypper/RPM:

1.     [zypper] zypper can not search any packages after installed package by rpm on qemuarm

http://bugzilla.pokylinux.org/show_bug.cgi?id=827

BSP:

1.     New! [blacksand] it show poor performance with video player

http://bugzilla.pokylinux.org/show_bug.cgi?id=921

2.     New! [crownbay-noemgd] video player has poor performance when playing video file

http://bugzilla.pokylinux.org/show_bug.cgi?id=920

3.     New! "rpm -qa" can not run for non-root user: Permission denied

http://bugzilla.pokylinux.org/show_bug.cgi?id=922

4.     [Blacksand]system cannot enter S3 standby mode

http://bugzilla.pokylinux.org/show_bug.cgi?id=613

5.     [crownbay] system could not enter into S3 with crownbay

http://bugzilla.pokylinux.org/show_bug.cgi?id=882

6.     [Sugarbay] GFX 3D game test fail to run with sugarbay BSP image due to libsdl.so

http://bugzilla.pokylinux.org/show_bug.cgi?id=883

7.     [Blacksand] Some error information prompted when run dmesg command

http://bugzilla.pokylinux.org/show_bug.cgi?id=607

Others:

1.     gcc segfault on qemuppc (nightly build 20110226-1)

http://bugzilla.pokylinux.org/show_bug.cgi?id=780

Verified Fixed Bugs:

1.     [crownbay] emgd crownbay build fail on xserver-xf86-emgd fetch

http://bugzilla.pokylinux.org/show_bug.cgi?id=885

2.     [n450]Blacksand keyboard/mouse do not work on X window

http://bugzilla.pokylinux.org/show_bug.cgi?id=869

3.     matchbox-panel segfault after X startup

http://bugzilla.pokylinux.org/show_bug.cgi?id=738

4.     [autobuilder] i686 toolchain not copied to sharing folder

http://bugzilla.pokylinux.org/show_bug.cgi?id=884

5.     audio mixer on BlackSand is muted on boot

http://bugzilla.pokylinux.org/show_bug.cgi?id=439

6.     [blacksand] no sound even all options in amixer enabled

http://bugzilla.pokylinux.org/show_bug.cgi?id=798

7.     [blacksand] configured audiosink is not working for video player

http://bugzilla.pokylinux.org/show_bug.cgi?id=799

8.     [Connman] xuser must be granted privilege to start connman-applet

http://bugzilla.pokylinux.org/show_bug.cgi?id=779

9.     The bottom icons on Applications and All screen are cut-off in qemu.

http://bugzilla.pokylinux.org/show_bug.cgi?id=658

10.  [zypper] zypper install does not work on qemux86/atom-pc

http://bugzilla.pokylinux.org/show_bug.cgi?id=803

11.  [zypper] zypper lose package information after zypper/rpm install/remove

http://bugzilla.pokylinux.org/show_bug.cgi?id=804

12.  [zypper] installation failure on ppc (nightly build 20110305-4)

http://bugzilla.pokylinux.org/show_bug.cgi?id=841

13.  [zypper] zypper install failed on routerstationpro sdk image

http://bugzilla.pokylinux.org/show_bug.cgi?id=845

Best Regards,

Jiajun
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110322/91101e2d/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: M4-Gold_20110318_detail_testreport_fullpass.ods
Type: application/oleobject
Size: 31185 bytes
Desc: M4-Gold_20110318_detail_testreport_fullpass.ods
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20110322/91101e2d/attachment.bin>