[yocto] 1.3 RC3 full pass test reports

[Liu, Song]

Hi Laurentiu,

Thanks a lot for the full test report. Great work!

Here’s a quick summary of the bugs in this report:


*         Resolved:  3142, 3186, 3201 ,3203

*         Release note candidate: 3080, 3100, 2694

*         Patch Review: 3199

*         3233: might be a QA machine setup issue. Tom/Jessica cannot recreate. Needs QA verification/feedback

*         3007: it's an enhancement, not a bug.

*         3116: patch merged, needs to be marked as resolved and QA verification.

*         All others (2878 2918 3125 and others) are still being worked on. 2878 seems widespread, I’ll check with Mark Hatle. Others don't seem to indicate any special concern, especially for the release at this point.

Please make sure we verify all the resolved bugs here in M4 build and work with Tom/Jessica to clarify 3233.

Thanks!
Song

From: yocto-bounces at yoctoproject.org [mailto:yocto-bounces at yoctoproject.org] On Behalf Of Serban, Laurentiu
Sent: Wednesday, October 10, 2012 1:12 PM
To: yocto at yoctoproject.org
Subject: [yocto] 1.3 RC3 full pass test reports

Hello guys,

Here are the test results for the 1.3 RC3 full pass.
The commit id is: 86c9aa8081f107420cd3763d0566d779daddc2b1

For the performance tests: the build for sato x86 took 88 minutes (a slight decrease in perfomance)

The following issue are encountered. I also updated with comments from Jessica and Saul:

-          For the BSPs:

o   For qemu x86_64 images - the zypper refresh fails (2694),

o   For all the boards there is commos n issue with the Sudoku-savant application (2878)

o   Dmesg errors on e-menlow sato image (2866)

o   An old problem shutting down and arm qemu machine (684)

-          For core build system:

o   There are still errors with the do_rootfs fails for lib64-core-image-sato-sdk (2918), there is a small issue with the sstate-cache-management.sh (3116) and there is a problem related to meta-intel BSP creation using yocto-bsp (3142).

o   Also there is an issue with dash vs. x32 on Ubuntu (3080) [SW] bash vs dash issue on Ubuntu

-          For ADT

o   There are issues with the lttng (3203) and meta-toolchain-support (3100). [JZ] This one is the only one that remains as an issue

o   There is an issue using the standalone toolchain for ARM and x86 (3201) [JZ] resolved

o   An error occurs when selecting kernel 3.4 in Yocto-bsp tool (3233) [JZ] need confirmation for AlexG, maybe a sighting? since both Tom and I can’t reproduce from commandline and eclipse plugin

o   iptables 1.4.15 compile failed on qemux86,qemuarm i686 gmae-toolchain (3125)

-          For HOB:

o   Choosing another toolchain host than x86_64 produces an hob-toolchain error (3199)

o   Improve bblayers-hob.conf (3007)


Test Result Summary

Component

Target

Status

Comments

Boards

p1022ds

GOOD

Sudoku-savant issue (2878)

Beagleboard

GOOD

Sudoku-savant issue (2878, 3186)

Routerstationpro

GOOD

Sudoku-savant issue (2878)

Mpc8315e-rdb

GOOD

Sudoku-savant issue (2878)

eMenlow-sato-sdk

BUGGY

Sudoku-savant issue (2878)
dmesg errors on emenlow sato image (2866)

Blacksand-sato-sdk

GOOD

Sudoku-savant issue (2878)

Sugarbay sato-sdk

GOOD

Sudoku-savant issue (2878)

Crownbay-emgd-sato-sdk

GOOD

Sudoku-savant issue (2878)

FRI2-sato

GOOD

Sudoku-savant build issue (2878)

HuronRiver-sato

GOOD

Sudoku-savant issue (2878)

Jasperforest-lsb

GOOD

Sudoku-savant issue (2878), zypper is not installed in core-image-lsb-sdk (3098)

QEMU




Qemuarm

GOOD

Everything runs well

Qemuppc

GOOD

Everything runs well

Qemumips

GOOD

Everything runs well

qemux86

GOOD

Everything runs well

qemux86-64

BUGGY

Zypper issue (2694)

Core build system

　

BUGGY

incremental RPM generation (3047),
lib64-core-image-sato-sdk fails due to do_rootfs issue (2918)
sstate-cache-management.sh prints some error message when running (3116)
[meta-x32] x32 image fails to build due to no recipes available for eglib_2.15 (3080)

HOB

　

GOOD

[HOB]toolchain arch in settings is not saved (3199)
Improve bblayers-hob.conf (3007)

ADT

　

BUGGY

autoreconf run failed on x86-64 gmae-toolchain (3100)
cannot build Hello World Ansi C project using standalone Toolchain for ARM and X86 (3201)
kernel trace type not available in the lttng project (3203)
error when selecting kernel version 3.4 in yocto bsp tool (3233)
iptables 1.4.15 compile failed on qemux86,qemuarm i686 gmae-toolchain (3125)

Stress Testing

GOOD

Both Crashme and Helltest on Jasperforest could pass 24 hours stress testing

Distribution Support

GOOD

Everything runs well for Ubuntu 12.04, Ubuntu 12.10 - nightly, OpenSuse 12.1, OpenSuse 12.2 RC2, Fedora 17, CentOs 6.3, Fedora 16

Power and Performance

GOOD

one qemux86 sato build on a Core i7 machine costs 88 minutes with the packages previously fetched.

Compliance

GOOD

Tests on Huron River and BlackSand passed

Build Appliance

GOOD

Everything runs well on VMWare Player (on Ubuntu). The relevant tests were performed also for qemu-kvm on Fedora 17 libvirt and
VMWare Workstation.(Ubuntu)



Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Beagleboard Sato-SDK

42

0

37

5(2878, 3186)

0

Routerstationpro Sato-SDK

35

0

34

1(2878)

0

p1022ds-sato-sdk

37

0

36

1(2878)

0

Mpc8315e-rdb Sato-SDK

37

0

36

1(2878)

0

eMenlow Sato-sdk

67

0

64

3 (bug 2878,3091)

0

n450 Sato-sdk

67

0

66

1 (bug 2878)

0

Crownbay-Sato-sdk

65

0

62

3 (2878, 2792, 2386, 1258)

0

FRI2 Sato-sdk

85

0

84

1 (2878)

0

HuronRiver Sato-sdk

68

0

67

1 (2878)

0

Sugarbay sato-sdk

68

0

67

1 (2878)

0

Jasperforest lsb-sdk

34

0

26

8 (2878,3098)

0

Qemuarm Sato

31

0

31

0

0

Qemuarm Sato-SDK

36

0

36

0

0

Qemumips Sato

31

0

31

0

0

Qemumips Sato-SDK

36

0

36

0

0

Qemuppc Sato

31

0

31

0

0

Qemuppc Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

30

0

27

3 (bug 2694)

0

Qemux86-64 Sato-SDK

36

0

32

4 (bug 2694)

0

Qemux86 Sato

30

0

30

0

0

Qemux86 Sato-SDK

36

0

36

0

0

Core build system

64

0

57

7 (3142, 2918, 3116,3080)

0

HOB

39

0

37

2(3199,3007 )

0

ADT

53

0

40

13(3201, 3203, 3100)

0

Build Appliance

14

0

13

1 (3243)

0

Total

1108

0

1052

56

0



Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 2878 pkgconfig is missing from sato-sdk image - installing and then trying to removing it leads to rpm crashes/assertions

Bug 2694 [QEMU-X86_64]zypper refresh fail
Bug 3186 BeagleBoard: rpm query package failed due to glibc realloc() error

Core build system

Bug 3142 [yocto-bsp] kernel panic message for yocto-bsp based images.

Bug  3116 sstate-cache-management.sh prints some error message when running
Bug 3080 [meta-x32] x32 image fails to build due to no recipes available for eglib_2.15
Bug 2918  lib64-core-image-sato-sdk fails due to do_rootfs issue.

ADT

Bug 3100 autoreconf run failed on x86-64 gmae-toolchain
Bug 3201 cannot build Hello World Ansi C project using standalone Toolchain for ARM and X86
Bug 3203  kernel trace type not available in the lttng project
Bug 3233 error when selecting kernel version 3.4 in yocto bsp tool
Bug 3125 iptable 1.4.15 compile failed on qemux86,qemuarm i686 gmae-toolchain

HOB

Bug 3199 Choosing another toolchain host than x86_64 produces an hob-toolchain error
Bug 3007 Improve bblayers-hob.conf





Best regards,
Laurentiu Serban
QA Engineer
Open Source Technology Center
System Software Division Romania
Desk: +40 31 8604742
iNET: 88451042

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20121010/564d5bed/attachment.html>