[yocto] QA cycle report for 2.4.1 RC1

[Yeoh, Ee Peng]

Hi Richard,



We had configured GDC Fedora Performance Machine to run 2.4 M4 rc3 [1].

Based on the new performance data we collected, the average time for eSDK deploy is 237 seconds (3 min 57 sec). In comparison, data collected WW43 2017, the average time for eSDK deploy was 161 seconds (2 min 41 sec).



In summary, while running the same commit, 2.4 M4 rc3, the eSDK time is now significantly higher (47% higher). This clearly show that the performance machine was the root cause of the longer eSDK time during recent QA for 2.4.1.rc1 [2] but we have not identify why the performance machine was contributing to this trouble.



Any suggestion on what shall be our next step?



Hi Jose,



Any idea what could be the reason why performance machine take longer time to run eSDK deploy? How about restart the Fedora Performance Machine?



Thank you very much for your attention!



Thanks,

Yeoh Ee Peng



eSDK Deploy Time – Run on WW01 2018

[cid:image001.jpg at 01D38649.9DBA1930]



eSDK Deploy Time – Run on WW43 2017

[cid:image002.jpg at 01D38649.9DBA1930]





[1] https://wiki.yoctoproject.org/wiki/WW43_-_2017-10-23_-_Full_Test_Cycle_2.4_RC3

[2] https://wiki.yoctoproject.org/wiki/WW51_-_2017-12-21-_Full_Test_Cycle_-_2.4.1_rc1

-----Original Message-----
From: Richard Purdie [mailto:richard.purdie at linuxfoundation.org]
Sent: Tuesday, January 2, 2018 7:27 PM
To: Yeoh, Ee Peng <ee.peng.yeoh at intel.com>; Cruz, Libertad <libertad.cruz at intel.com>; yocto at yoctoproject.org; Lock, Joshua G <joshua.g.lock at intel.com>; Jolley, Stephen K <stephen.k.jolley at intel.com>; Zhang, Jessica <jessica.zhang at intel.com>
Cc: Perez Carranza, Jose <jose.perez.carranza at intel.com>; Sangal, Apoorv <apoorv.sangal at intel.com>
Subject: Re: QA cycle report for 2.4.1 RC1



Hi,



On Fri, 2017-12-22 at 01:40 -0800, Yeoh, Ee Peng wrote:

> Enjoy viewing the full Report for 2.4.1

> RC1:  https://wiki.yoctoproject.org/wiki/WW51_-_2017-12-21-

> _Full_Test_Cycle_-_2.4.1_rc1

>

> ======= Summary ========

>

> The QA cycle for release 2.4.1 RC1 is complete.  There are 5 new bugs

> from which so far none of them are high. QA has 1 concern on the

> performance testing.

>

> Performance report shows an increase of 23% build time on the eSDK in

> fedora 23, bug has not been created until further investigation with

> setup outside of the GDC environment.



Was there any further update on this?



It may be worth running the test for 2.4.0 and checking that you get the same result as we had at time of release, just to double check there isn't some other contributing cause here...



Cheers,



Richard
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20180105/5bf9001f/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 19879 bytes
Desc: image001.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20180105/5bf9001f/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 15441 bytes
Desc: image002.jpg
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20180105/5bf9001f/attachment-0001.jpg>