[yocto] 1.3 RC4 full pass results

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Tue Oct 23 06:53:36 PDT 2012


And the updated XLS file attached.

--
Alexandru Georgescu
QA Engineer

From: yocto-bounces at yoctoproject.org [mailto:yocto-bounces at yoctoproject.org] On Behalf Of Georgescu, Alexandru C
Sent: Tuesday, October 23, 2012 16:51
To: Serban, Laurentiu; Flanagan, Elizabeth; Zhang, Jessica
Cc: yocto at yoctoproject.org
Subject: Re: [yocto] 1.3 RC4 full pass results

Hello again :),
I have updated the test results for 1.3 M5 rc4, and they are also available on our wiki: https://wiki.yoctoproject.org/wiki/Yocto_1.3_Milestone_Test_Report#Yocto_1.3_M5_Build_Test_Report


The commit id is c9de24d3f4845251b01e2eab0aeeb7472badc5bb


The following issues are encountered. I also updated with comments from Jessica and Saul:



-          For the BSPs:



o   For qemu x86_64 images - the zypper refresh fails (2694),



-          For core build system:



           o   There are still errors with the do_rootfs fails for lib64-core-image-sato-sdk (2918)



-          For ADT



           o   GL support still available on qemuarm (3287)



Test Result Summary

Component

Target

Status

Comments

Boards

p1022ds

GOOD

Everything runs well

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

eMenlow-sato-sdk

BUGGY

Usb mount fails (2643)

Blacksand-sato-sdk

GOOD

Everything runs well

Sugarbay sato-sdk

GOOD

Everything runs well

Crownbay-emgd-sato-sdk

GOOD

Standby fails (2792), Xorg issue (1258),

FRI2-sato

BUGGY

Blocked (3294)

HuronRiver-sato

GOOD

Everything runs well

Jasperforest-lsb

BUGGY

zypper is not installed in core-image-lsb-sdk (3098)

QEMU




Qemuarm

GOOD

Everything runs well

Qemuppc

GOOD

Everything runs well

Qemumips

GOOD

Everything runs well

qemux86

GOOD

Everything runs well

qemux86-64

BUGGY

Zypper issue (2694)

Core build system

 

BUGGY

lib64-core-image-sato-sdk fails due to do_rootfs issue (2918)

HOB

 

GOOD

Everything runs well

ADT

 

GOOD

GL support still available on qemuarm (3287)

Stress Testing

GOOD

Both Crashme and Helltest on Jasperforest could pass 24 hours stress testing

Distribution Support

GOOD

Everything runs well for Ubuntu 12.04, Ubuntu 12.10, OpenSuse 12.1, OpenSuse 12.2, Fedora 17, Fedora 16, CentOs 6.3 (CentOS does not pass gtk and pygtk requirements for HOB)

Power and Performance

GOOD

one qemux86 sato build on a Core i7 machine costs 88 minutes with the packages previously fetched.

Compliance

GOOD

Tests on Huron River and BlackSand passed

Build Appliance

GOOD

Everything runs well on VMWare Player (on Ubuntu). The relevant tests were performed also for qemu-kvm on Fedora 17 libvirt and
VMWare Workstation.(Ubuntu)



Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

Beagleboard Sato-SDK

42

0

42

0

0

Routerstationpro Sato-SDK

35

0

35

0

0

p1022ds-sato-sdk

37

0

37

0

0

Mpc8315e-rdb Sato-SDK

37

0

37

0

0

eMenlow Sato-sdk

67

0

66

1 (bug 2643)

0

n450 Sato-sdk

67

0

67

0

0

Crownbay-Sato-sdk

65

0

62

2 (1258, 2792)

1 (2792)

FRI2 Sato-sdk

85

0

0

0

            85 (3294)

HuronRiver Sato-sdk

68

0

68

0

0

Sugarbay sato-sdk

68

0

68

0

0

Jasperforest lsb-sdk

34

0

27

7 (3098)

0

Qemuarm Sato

31

0

31

0

0

Qemuarm Sato-SDK

36

0

36

0

0

Qemumips Sato

31

0

31

0

0

Qemumips Sato-SDK

36

0

36

0

0

Qemuppc Sato

31

0

31

0

0

Qemuppc Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

30

0

27

3 (bug 2694)

0

Qemux86-64 Sato-SDK

36

0

32

4 (bug 2694)

0

Qemux86 Sato

30

0

30

0

0

Qemux86 Sato-SDK

36

0

36

0

0

Core build system

74

0

72

2 (2918)

0

HOB

41

0

41

0

0

ADT

54

0

48

6( 3287)

0

Distribution Support

42

1

41

0

1 (HOB-centos gtk too old)

Build Appliance

12

0

12

0

0

Total

1161

0

1049

25

87



Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 2694 [QEMU-X86_64]zypper refresh fail

Core build system

Bug 2918  lib64-core-image-sato-sdk fails due to do_rootfs issue.

ADT

Bug 3287  GL support still available on qemuarm


Thanks,
--
Alexandru Georgescu
QA Engineer
SSG/SSD Open Source Technology Center Romania





-----Original Message-----
From: Flanagan, Elizabeth [mailto:elizabeth.flanagan at intel.com]<mailto:[mailto:elizabeth.flanagan at intel.com]>
Sent: Thursday, October 18, 2012 12:43 AM
To: Zhang, Jessica
Cc: Serban, Laurentiu; yocto at yoctoproject.org<mailto:yocto at yoctoproject.org>
Subject: Re: [yocto] 1.3 RC4 full pass results



On Wed, Oct 17, 2012 at 1:52 PM, Zhang, Jessica <jessica.zhang at intel.com<mailto:jessica.zhang at intel.com>> wrote:

>

> As to sato-sdk for qemuarm issue (3290), I think Beth has regenerated it.  Can we have a quick check to ensure it’s working now?



Yes, this was due to us needing to regenerate qemuarm. Only the main builder populates the adtrepo. As the images for the first run were incorrectly generated for qemuarm, they had to be done by hand. This was finished yesterday and the bug report updated.



-b



>

>

>

> Thanks,

>

> Jessica

>

>

>

> From: yocto-bounces at yoctoproject.org<mailto:yocto-bounces at yoctoproject.org>

> [mailto:yocto-bounces at yoctoproject.org] On Behalf Of Serban, Laurentiu

> Sent: Wednesday, October 17, 2012 12:48 PM

> To: yocto at yoctoproject.org<mailto:yocto at yoctoproject.org>

> Subject: [yocto] 1.3 RC4 full pass results

>

>

>

>

>

> Hello guys,

>

>

>

> Here are the test results for the 1.3 RC4 full pass.

>

> The commit id is:  1b1b83651af33ffcb204031e2790719e3b0b45bb

>

>

>

> For the performance tests: the build for sato x86 took 88 minutes

> (same as for RC3)

>

>

>

> The following issue are encountered. I also updated with comments from Jessica and Saul:

>

> -          For the BSPs:

>

> o   For qemu x86_64 images - the zypper refresh fails (2694),

>

> -          For core build system:

>

> o   There are still errors with the do_rootfs fails for lib64-core-image-sato-sdk (2918)

>

> -          For ADT

>

> o   ADT couldn't be installed properly for RC4 because sato sdk for qemuarm does not exist (3290)

>

> o   GL support still available on qemuarm (3287)

>

>

>

>

>

>

>

> Test Result Summary

>

> Component

>

> Target

>

> Status

>

> Comments

>

> Boards

>

> p1022ds

>

> GOOD

>

> Everything runs well

>

> Beagleboard

>

> GOOD

>

> Everything runs well

>

> Routerstationpro

>

> GOOD

>

> Everything runs well

>

> Mpc8315e-rdb

>

> GOOD

>

> Sudoku-savant issue (2878)

>

> eMenlow-sato-sdk

>

> BUGGY

>

> Usb mount fails (2643)

>

> Blacksand-sato-sdk

>

> GOOD

>

> Everything runs well

>

> Sugarbay sato-sdk

>

> GOOD

>

> Everything runs well

>

> Crownbay-emgd-sato-sdk

>

> GOOD

>

> Standby fails (2792), Xorg issue (1258),

>

> FRI2-sato

>

> BUGGY

>

> Blocked (3294)

>

> HuronRiver-sato

>

> GOOD

>

> Everything runs well

>

> Jasperforest-lsb

>

> BUGGY

>

> zypper is not installed in core-image-lsb-sdk (3098)

>

> QEMU

>

>

>

>

>

>

>

> Qemuarm

>

> GOOD

>

> Everything runs well

>

> Qemuppc

>

> GOOD

>

> Everything runs well

>

> Qemumips

>

> GOOD

>

> Everything runs well

>

> qemux86

>

> GOOD

>

> Everything runs well

>

> qemux86-64

>

> BUGGY

>

> Zypper issue (2694)

>

> Core build system

>

>

>

> BUGGY

>

> lib64-core-image-sato-sdk fails due to do_rootfs issue (2918)

>

> HOB

>

>

>

> GOOD

>

> Everything runs well

>

> ADT

>

>

>

> BUGGY

>

> ADT couldn't be installed properly for RC4 because sato sdk for

> qemuarm does not exist (3290)

>

> GL support still available on qemuarm (3287)

>

> Stress Testing

>

> GOOD

>

> Both Crashme and Helltest on Jasperforest could pass 24 hours stress

> testing

>

> Distribution Support

>

> GOOD

>

> Everything runs well for Ubuntu 12.04, Ubuntu 12.10 - nightly,

> OpenSuse 12.1, OpenSuse 12.2 RC2, Fedora 17, CentOs 6.3, Fedora 16

>

> Power and Performance

>

> GOOD

>

> one qemux86 sato build on a Core i7 machine costs 88 minutes with the packages previously fetched.

>

> Compliance

>

> GOOD

>

> Tests on Huron River and BlackSand passed

>

> Build Appliance

>

> GOOD

>

> Everything runs well on VMWare Player (on Ubuntu). The relevant tests

> were performed also for qemu-kvm on Fedora 17 libvirt and

>

> VMWare Workstation.(Ubuntu)

>

>

>

>

>

> Detailed Test Result for each component

>

> Target

>

> Total TCs

>

> Not Run

>

> Passed

>

> Failed

>

> Not testable (Blocked)

>

> Beagleboard Sato-SDK

>

> 42

>

> 0

>

> 42

>

> 0

>

> 0

>

> Routerstationpro Sato-SDK

>

> 35

>

> 0

>

> 35

>

> 0

>

> 0

>

> p1022ds-sato-sdk

>

> 37

>

> 0

>

> 37

>

> 0

>

> 0

>

> Mpc8315e-rdb Sato-SDK

>

> 37

>

> 0

>

> 37

>

> 0

>

> 0

>

> eMenlow Sato-sdk

>

> 67

>

> 0

>

> 66

>

> 1 (bug 2643)

>

> 0

>

> n450 Sato-sdk

>

> 67

>

> 0

>

> 67

>

> 0

>

> 0

>

> Crownbay-Sato-sdk

>

> 65

>

> 0

>

> 62

>

> 2 (1258, 2792)

>

> 1 (2792)

>

> FRI2 Sato-sdk

>

> 85

>

> 0

>

> 0

>

> 0

>

>             85 (3294)

>

> HuronRiver Sato-sdk

>

> 68

>

> 0

>

> 68

>

> 0

>

> 0

>

> Sugarbay sato-sdk

>

> 68

>

> 0

>

> 68

>

> 0

>

> 0

>

> Jasperforest lsb-sdk

>

> 34

>

> 0

>

> 27

>

> 7 (3098)

>

> 0

>

> Qemuarm Sato

>

> 31

>

> 0

>

> 31

>

> 0

>

> 0

>

> Qemuarm Sato-SDK

>

> 36

>

> 0

>

> 36

>

> 0

>

> 0

>

> Qemumips Sato

>

> 31

>

> 0

>

> 31

>

> 0

>

> 0

>

> Qemumips Sato-SDK

>

> 36

>

> 0

>

> 36

>

> 0

>

> 0

>

> Qemuppc Sato

>

> 31

>

> 0

>

> 31

>

> 0

>

> 0

>

> Qemuppc Sato-SDK

>

> 36

>

> 0

>

> 36

>

> 0

>

> 0

>

> Qemux86-64 Sato

>

> 30

>

> 0

>

> 27

>

> 3 (bug 2694)

>

> 0

>

> Qemux86-64 Sato-SDK

>

> 36

>

> 0

>

> 32

>

> 4 (bug 2694)

>

> 0

>

> Qemux86 Sato

>

> 30

>

> 0

>

> 30

>

> 0

>

> 0

>

> Qemux86 Sato-SDK

>

> 36

>

> 0

>

> 36

>

> 0

>

> 0

>

> Core build system

>

> 59

>

> 0

>

> 57

>

> 2 (2918)

>

> 0

>

> HOB

>

> 38

>

> 0

>

> 38

>

> 0

>

> 0

>

> ADT

>

> 52

>

> 0

>

> 45

>

> 7(3290, 3287)

>

> 0

>

> Build Appliance

>

> 42

>

> 0

>

> 34

>

> 7 (3290)

>

> 1 (centos gtk issue)

>

> Total

>

> 1129

>

> 0

>

> 1009

>

> 33

>

> 87

>

>

>

>

>

> Component

>

> Bug Number

>

> Target Milestone

>

> System & Core OS

>

> System Usage

>

> Bug 2694 [QEMU-X86_64]zypper refresh fail

>

> Core build system

>

> Bug 2918  lib64-core-image-sato-sdk fails due to do_rootfs issue.

>

> ADT

>

> Bug 3287  GL support still available on qemuarm

>

> Bug 3290 ADT couldn't be installed properly for RC4 because sato sdk

> for qemuarm does not exist

>

>

>

>

>

>

>

>

>

> Laurentiu Serban

>

> QA Engineer

>

> Open Source Technology Center

>

> System Software Division Romania

>

> Desk: +40 31 8604742

>

> iNET: 88451042

>

>

>

>

> _______________________________________________

> yocto mailing list

> yocto at yoctoproject.org<mailto:yocto at yoctoproject.org>

> https://lists.yoctoproject.org/listinfo/yocto

>







--

Elizabeth Flanagan

Yocto Project

Build and Release
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20121023/01f5f0af/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 1 3_M5_RC4_FullPass_TR_updated_v2.xlsx
Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Size: 76503 bytes
Desc: 1 3_M5_RC4_FullPass_TR_updated_v2.xlsx
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20121023/01f5f0af/attachment.xlsx>


More information about the yocto mailing list