[yocto] Fullpass Test Report for Yocto 1.4 M3 RC2 20130131 Build

Thu Feb 7 09:41:41 PST 2013

Hello,

Here is the fullpass test report for Yocto 1.4 M3 RC2 20130131 build. Although the image for p1022ds built out, the system can't boot up, so the testings is blocked.
For other qemu and BSPs, there is no new bug found in this testing.
There was a problem with qemux86 starting up, but the bug (3850) was set to invalid. Tomorrow we will provide the results for this platform.

Test Summary
-------------------------
Test Result Summary

Component

Target

Status

Comments

BSP

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

P1022DS

BLOCK

The system can not boot up

FRI2

GOOD

Standby and 3G connectivity issues

Jasperforest

BUGGY

Smart command isn’t available

emenlow

GOOD

Everything runs well

Sugarbay

GOOD

Everything runs well

QEMU

qemuarm

GOOD

connman offline mode doesn't work

qemux86-64

GOOD

connman offline mode doesn't work

qemuppc

GOOD

connman offline mode doesn't work

qemumips

GOOD

connman offline mode doesn't work

HOB

BUGGY

Toolchain build issue, package size is incorrect, hob recipe build from command line fails.

Core Build System

BUGGY

missing pam_systemd.so;Bitbake remake/remake-native check; Crosstap script check fails, do_rootfs fails for lib64 core-image-sato and core-image-sato-sdk

ADT Toolchain

BUGGY

gtk+-2.0 missing from the userbuilt toolchain; autoreconf run failed

Compliance

GOOD

LTP result: https://wiki.pokylinux.org/wiki/LTP_result
POSIX result: https://wiki.pokylinux.org/wiki/Posix_result

Build Appliance

GOOD

Everything runs well

Stress

Beagleboard

GOOD

Crashme and LTP stress could pass 24 hours testing

BLOCK

Critical bugs, more than 50% test cases are blocked

GOOD

Only Normal, Minor or Enhancement bugs, less than 10% test cases failed

BUGGY

Normal, Major and Critical bugs, more than 10% test cases failed

Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Beagleboard Sato-SDK

66

0

66

0

0

Routerstationpro Sato-SDK

43

0

43

0

0

Mpc8315e-rdb Sato-SDK

45

0

45

0

0

P1022DS

42

42

0

0

42 (bug 3837)

Crownbay - noemgd

77

1

74

2(2792)

1

Beagleboard

66

0

66

0

0

Jasperforest

47

16

30

1(3098)

16

FRI2

87

6

78

3(2037,2415,2646)

6

Emenlow

77

0

77

0

0

Sugarbay

77

0

77

0

0

Qemuarm Sato

42

0

41

1 (bug 3804)

0

Qemux86-64

39

0

38

1(bug 3804)

0

Qemuarm Sato-SDK

47

0

46

1 (bug 3804)

0

Qemumips Sato

42

0

41

1 (bug 3804)

0

Qemumips Sato-SDK

47

0

46

1 (bug 3804)

0

Qemuppc Sato

42

0

41

1 (bug 3804)

0

Qemuppc Sato-SDK

47

0

46

1 (bug 3804)

0

Core Build System

81

2

75

4 (bug 3756,2918,3745)

2

ADT Toolchain

389

0

355

34 (bug 3338, 3758, 2938)

0

Compliance

2

0

2

0

0

Stress

2

0

2

0

0

BuildAppliance

4

0

4

0

0

HOB

38

0

35

3(2618,3001,3199)

0

Total

1449

67

1328

54

67

* You can check the detailed test result in attachment for each target.
** The failed/blocked case number is listed with failed cases’ bug number.

Commit information
--------------------------------
Location: http://autobuilder.yoctoproject.org/pub/nightly/20130131-4/
Tree/Branch: 1.4_M3
Commit: 3ae1a4ba972cfc17ff3f2fda632da8ecc3414885

Issue Summary
-----------------------------------
Component

Bug Number

Target Milestone

System & Core OS

System Usage

3805 PAM support: missing pam_systemd.so
3804 connman offline mode doesn't work on qemu images
3768 smart: --yaml option doesn't work
3656 rpm2cpio: Segmentation fault
3098 smart command doesn’t exist for jasperforest image

1.4 M4
1.4 M4
1.4 M4
1.4
1.4

Others

New! 3837 [p1022ds] System can not boot via nfs

---

Core Build System

Bug 3745 Bitbake remake/remake-native check error
Bug 2918 lib64 sato and sato-sdk do_rootfs fails
Bug 3756 Crosstap script fails

1.4
1.4
1.4 M4

ADT Toolchain

Bug 3338 iptables-1.4.15: autoreconf run failed on gmae-toolchain
Bug 3758 Package gtk+-2.0 missing from the userbuilt toolchain

1.4 M5
1.4 M4

Compliance

Compliance testing is finished.
LTP test result is on https://wiki.pokylinux.org/wiki/LTP_result
POSIX test result is on https://wiki.pokylinux.org/wiki/Posix_result

Stress

Crashme and LTP stress could pass 24 hours testing on beagleboard.

Verified Bugs
-----------------------------------

Br,
--
Alexandru Palalau
QA Contractor @ Yocto Project
Open-source Technology Center Romania
System Software Division

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20130207/61242310/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 1.4_20130131_detail_testreport_fullpass.xlsx
Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Size: 98653 bytes
Desc: 1.4_20130131_detail_testreport_fullpass.xlsx
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20130207/61242310/attachment.xlsx>