[yocto] Yocto 1.8_M4.rc1 Full Pass test report.

Georgescu, Alexandru C alexandru.c.georgescu at intel.com
Thu Apr 2 09:42:01 PDT 2015


Hello,

Here is the Full pass test report for Yocto 1.8_M4.rc1.
Below you can view the summary report. The full pass test report is available on the wiki: https://wiki.yoctoproject.org/wiki/WW13_-_2015-03-25_-_Full_Pass_1.8_M4.rc1 including the Distro test results and build performance test.


Testing data

 Test type:  Full Pass Release Test
 Branch: master
 Build name: 1.8_M4.rc1
 poky commit: 8b3d3e7c957ad06c390886487f69aeb8e145da6a
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.8_M4.rc1/
 Distributions tested: Ubuntu 14.04 64bit, Fedora 21 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit


Test Run Summary Report
Testing Summary Report

Test Run        Test Plan       Environment     Passed  Other issues    Failed  Failing bugs    Blocked Blocking bugs   Complete
3645<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3645> 3646<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3646> ADT: master branch      Fedora 21 i686  98.5%   none    1.5%    7536<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7536> 7545<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7545>       0.0%    none    100.0%
3647<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3647> 3648<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3648> ADT: master branch      Ubuntu 14.04 x86_64     98.5%   none    1.5%    7536<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7536> 7545<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7545>       0.0%    none    100.0%
3651<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3651> 3652<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3652> BSP/QEMU: master branch Beaglebone Black        98.7%   none    1.3%    7543<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7543>    0.0%    none    100.0%
3657<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3657> 3658<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3658> BSP/QEMU: master branch EdgeRouter      100.0%  none    0.0%    none    0.0%    none    100.0%
3632<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3632> 3633<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3633> BSP/QEMU: master branch generic-x86 on AtomPC   98.8%   none    1.2%    7532<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7532>    0.0%    none    100.0%
3630<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3630> 3631<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3631> BSP/QEMU: master branch genericx86-64 on Sugarbay       100.0%  none    0.0%    none    0.0%    none    100.0%
3659<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3659> 3660<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3660> BSP/QEMU: master branch MPC8315e-rdb    100.0%  none    0.0%    none    0.0%    none    100.0%
3653<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3653> 3655<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3655> BSP/QEMU: master branch P1022ds 100.0%  none    0.0%    none    0.0%    none    100.0%
3634<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3634> 3635<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3635> BSP/QEMU: master branch qemu-x86        100.0%  none    0.0%    none    0.0%    none    100.0%
3638<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3638> 3639<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3639> BSP/QEMU: master branch qemuarm 100.0%  none    0.0%    none    0.0%    none    100.0%
3640<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3640> 3641<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3641> BSP/QEMU: master branch qemumips        100.0%  none    0.0%    none    0.0%    none    100.0%
3642<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3642> 3643<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3643> BSP/QEMU: master branch qemuppc 100.0%  7236<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7236>    0.0%    none    0.0%    none    100.0%
3636<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3636> 3637<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3637> BSP/QEMU: master branch qemux86-64      100.0%  none    0.0%    none    0.0%    none    100.0%
3625<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3625>     Eclipse Plugin: master branch   Fedora 21 x86_64        33.3%   7530<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7530>    3.0%    5163<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5163> 7530<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7530>       63.6%   7530<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7530>    100.0%
3649<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3649> 3650<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3650> Meta-yocto: master branch       Ubuntu 14.04 x86_64     100.0%  6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>    0.0%    none    0.0%    none    100.0%
3622<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3622> 3623<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3623> Hob: master branch      Ubuntu 14.10 x86_64     95.6%   none    0.0%    none    4.4%    none    100.0%
3616<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3616> 3617<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3617> 3618<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3618>3619<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3619>  Toaster: master branch  Ubuntu 14.10 x86_64     90.5%   7025<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7025>    7.8%    5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187> 7537<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7537> 7026<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7026>7198<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7198>      1.7%    none    100.0%
3626<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3626> 3627<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3627> OE-Core: master branch  Ubuntu 14.10 x86_64     96.6%   none    3.4%    7522<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7522>    0.0%    none    100.0%
3628<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3628> 3629<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3629> BitBake: master branch  Ubuntu 14.10 x86_64     97.4%   none    0.0%    none    2.6%    none    100.0%
3644<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3644>     Runtime: master branch  Ubuntu 14.10 x86_64     100.0%  none    0.0%    none    0.0%    none    100.0%
3661<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=3661>     Build Appliance: master branch  qemu-kvm on Ubuntu 12.04 libvirt        100.0%  7426<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7426> 7544<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7544>       0.0%    none    0.0%    none    100.0%
Total: 21


[Bug Status]


Test Case Status Report

Status  Count
BLOCKED 26
FAILED  17
PASSED  1268
Total: 1311
        [http://chart.apis.google.com/chart?cht=bvg&chs=372x120&chbh=a&chds=0,1268&chxt=y&chxr=0,0,1268,211&chd=t:&chd=t:26,17,1268&chco=FFFF66|FF9933|00FF00&chdl=BLOCKED(26)+2%|FAILED(17)+1%|PASSED(1268)+97%]




Bugs Found during QA Test
New and notable issues Found during QA Test & Community
ID      Summary (7 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=7426&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%207522&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%207530&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%207532&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%207536&field0-0-5=bug_id&type0-0-5=equals&value0-0-5=%207543&field0-0-6=bug_id&type0-0-6=equals&value0-0-6=%207545&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>  P       Assignee        QA      Milestone       Status  Resolution      cf_regression_type      Created
ADT
7536<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7536>    The manifest file is empty for sdk ext  Medium  Randy Witt      Yi Zhao 1.9     NEW             New (Never tested)      2015-03-30
7545<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7545>    Failed to install sdk ext       Medium  Randy Witt      Yi Zhao 1.9 M1  NEW             New (Never tested)      2015-03-31
BSPs
7543<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7543>    [BeagleboneBlack] some error message in Xorg.log        Low     Kevin Hao       Yi Zhao 1.9     NEW             New (Never tested)      2015-03-31
7532<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7532>    LogParser: Fast TSC calibration failed  Medium  Saul Wold       Lucian Musat    1.9     NEW             New (Never tested)      2015-03-27
Eclipse Plugin
7530<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7530>    QEMU does not start when run as external tool   Medium  Cristian Iorga  Mihail Stanciu  1.8 M4  NEW             Regression (Used to work)       2015-03-27
Hob
7426<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7426>    [HOB]when build qemu images, there's no "ext4" option in "advanced configuration"       Undecided       Richard Purdie          ---     RESOLVED        FIXED   ---     2015-03-09
OE-Core
7522<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7522>    missing file "sstate-build-populate_lic" during oe-selftest     Medium+ Richard Purdie  Mihail Stanciu  1.8 M4  RESOLVED        FIXED   Regression (Used to work)       2015-03-26


Other Bugs found during QA Test (including regressions)
ID      Summary (11 tasks) ⇒<https://bugzilla.yoctoproject.org/buglist.cgi?&field0-0-0=bug_id&type0-0-0=equals&value0-0-0=5163&field0-0-1=bug_id&type0-0-1=equals&value0-0-1=%205187&field0-0-2=bug_id&type0-0-2=equals&value0-0-2=%206156&field0-0-3=bug_id&type0-0-3=equals&value0-0-3=%207025&field0-0-4=bug_id&type0-0-4=equals&value0-0-4=%207026&field0-0-5=bug_id&type0-0-5=equals&value0-0-5=%207198&field0-0-6=bug_id&type0-0-6=equals&value0-0-6=%207236&field0-0-7=bug_id&type0-0-7=equals&value0-0-7=%207529&field0-0-8=bug_id&type0-0-8=equals&value0-0-8=%207531&field0-0-9=bug_id&type0-0-9=equals&value0-0-9=%207537&field0-0-10=bug_id&type0-0-10=equals&value0-0-10=%207544&field0-1-0=bug_status&type0-1-0=notequals&value0-1-0=CLOSED>      P       Assignee        QA      Milestone       Status  Resolution      cf_regression_type      Created
---
5163<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5163>    no external tools displayed when first trying to run QEMU - test case 48 failed on Ubuntu 12.04 x86-64 host(build 1.5 M4 rc2)   Medium  David Reyna             Future  ACCEPTED                ---     2013-09-11
Toaster
5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187>    same cooker log file name used for several builds       Medium  Richard Purdie          1.8     ACCEPTED                ---     2013-09-13
New (Never tested)
7025<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7025>    View all targets: graphical overlap in table    Medium  Belen Barros Pena       Mihail Stanciu  1.8 M4  NEW             New (Never tested)      2014-12-03
7026<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7026>    All layers page: Sorting does not work  Medium  Michael Wood    Mihail Stanciu  1.8 M4  REOPENED                New (Never tested)      2014-12-03
Regression (Used to work)
7544<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7544>    [Build Appliance] Hob exception when build an image     Undecided       Cristian Iorga  Yi Zhao ---     RESOLVED        WORKSFORME      Regression (Used to work)       2015-03-31
OE-Core
6156<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6156>    [crosstap] no trace message output on qemuarm   Medium  Tom Zanussi             1.8     ACCEPTED                Regression (Used to work)       2014-04-14
7531<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7531>    Createme command not found during build Medium+ Ross Burton     Mihail Stanciu  1.8 M4  RESOLVED        FIXED   Regression (Used to work)       2015-03-27
7529<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7529>    Package build errors - files being changed while read   Undecided       Richard Purdie  Mihail Stanciu  ---     RESOLVED        FIXED   Regression (Used to work)       2015-03-27
System Startup
7236<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7236>    The color of splash screen for qemuppc is strange       Medium  Saul Wold       Yi Zhao 1.8     NEW             Regression (Used to work)       2015-01-23
Toaster
7198<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7198>    Hiding a sorted column does not revert to default sorting       Medium  Michael Wood    Mihail Stanciu  1.8 M4  IN PROGRESS REVIEW              Regression (Used to work)       2015-01-20
7537<https://bugzilla.yoctoproject.org/show_bug.cgi?id=7537>    Toaster fails to build with custom layer added  Undecided       Alexandru Damian        Mihail Stanciu  ---     VERIFIED        NOTABUG Regression (Used to work)       2015-03-30




Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania



More information about the yocto mailing list