[yocto] 1.3 RC4 full pass results

[Serban, Laurentiu]

Hello guys,

Here are the test results for the 1.3 RC4 full pass.
The commit id is:  1b1b83651af33ffcb204031e2790719e3b0b45bb

For the performance tests: the build for sato x86 took 88 minutes (same as for RC3)

The following issue are encountered. I also updated with comments from Jessica and Saul:

-          For the BSPs:

o   For qemu x86_64 images - the zypper refresh fails (2694),

-          For core build system:

o   There are still errors with the do_rootfs fails for lib64-core-image-sato-sdk (2918)

-          For ADT

o   ADT couldn't be installed properly for RC4 because sato sdk for qemuarm does not exist (3290)

o   GL support still available on qemuarm (3287)



Test Result Summary

Component

Target

Status

Comments

Boards

p1022ds

GOOD

Everything runs well

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Sudoku-savant issue (2878)

eMenlow-sato-sdk

BUGGY

Usb mount fails (2643)

Blacksand-sato-sdk

GOOD

Everything runs well

Sugarbay sato-sdk

GOOD

Everything runs well

Crownbay-emgd-sato-sdk

GOOD

Standby fails (2792), Xorg issue (1258),

FRI2-sato

BUGGY

Blocked (3294)

HuronRiver-sato

GOOD

Everything runs well

Jasperforest-lsb

BUGGY

zypper is not installed in core-image-lsb-sdk (3098)

QEMU




Qemuarm

GOOD

Everything runs well

Qemuppc

GOOD

Everything runs well

Qemumips

GOOD

Everything runs well

qemux86

GOOD

Everything runs well

qemux86-64

BUGGY

Zypper issue (2694)

Core build system

　

BUGGY

lib64-core-image-sato-sdk fails due to do_rootfs issue (2918)

HOB

　

GOOD

Everything runs well

ADT

　

BUGGY

ADT couldn't be installed properly for RC4 because sato sdk for qemuarm does not exist (3290)
GL support still available on qemuarm (3287)

Stress Testing

GOOD

Both Crashme and Helltest on Jasperforest could pass 24 hours stress testing

Distribution Support

GOOD

Everything runs well for Ubuntu 12.04, Ubuntu 12.10 - nightly, OpenSuse 12.1, OpenSuse 12.2 RC2, Fedora 17, CentOs 6.3, Fedora 16

Power and Performance

GOOD

one qemux86 sato build on a Core i7 machine costs 88 minutes with the packages previously fetched.

Compliance

GOOD

Tests on Huron River and BlackSand passed

Build Appliance

GOOD

Everything runs well on VMWare Player (on Ubuntu). The relevant tests were performed also for qemu-kvm on Fedora 17 libvirt and
VMWare Workstation.(Ubuntu)



Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Beagleboard Sato-SDK

42

0

42

0

0

Routerstationpro Sato-SDK

35

0

35

0

0

p1022ds-sato-sdk

37

0

37

0

0

Mpc8315e-rdb Sato-SDK

37

0

37

0

0

eMenlow Sato-sdk

67

0

66

1 (bug 2643)

0

n450 Sato-sdk

67

0

67

0

0

Crownbay-Sato-sdk

65

0

62

2 (1258, 2792)

1 (2792)

FRI2 Sato-sdk

85

0

0

0

            85 (3294)

HuronRiver Sato-sdk

68

0

68

0

0

Sugarbay sato-sdk

68

0

68

0

0

Jasperforest lsb-sdk

34

0

27

7 (3098)

0

Qemuarm Sato

31

0

31

0

0

Qemuarm Sato-SDK

36

0

36

0

0

Qemumips Sato

31

0

31

0

0

Qemumips Sato-SDK

36

0

36

0

0

Qemuppc Sato

31

0

31

0

0

Qemuppc Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

30

0

27

3 (bug 2694)

0

Qemux86-64 Sato-SDK

36

0

32

4 (bug 2694)

0

Qemux86 Sato

30

0

30

0

0

Qemux86 Sato-SDK

36

0

36

0

0

Core build system

59

0

57

2 (2918)

0

HOB

38

0

38

0

0

ADT

52

0

45

7(3290, 3287)

0

Build Appliance

42

0

34

7 (3290)

1 (centos gtk issue)

Total

1129

0

1009

33

87



Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 2694 [QEMU-X86_64]zypper refresh fail

Core build system

Bug 2918  lib64-core-image-sato-sdk fails due to do_rootfs issue.

ADT

Bug 3287  GL support still available on qemuarm
Bug 3290 ADT couldn't be installed properly for RC4 because sato sdk for qemuarm does not exist





Laurentiu Serban
QA Engineer
Open Source Technology Center
System Software Division Romania
Desk: +40 31 8604742
iNET: 88451042

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20121017/ef768b81/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 1.3_RC4_FullPass_TR.xlsx
Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Size: 73929 bytes
Desc: 1.3_RC4_FullPass_TR.xlsx
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20121017/ef768b81/attachment.xlsx>