[yocto] [RFC PATCH 0/1] update.py: fetch repos parallelly

Robert Yang liezhi.yang at windriver.com
Wed Dec 27 05:23:59 PST 2017


Hi Paul,

We have 124 layers, the "update.py  -b <branch>" costs about 10 minutes to
finish the update for one branch, and we need update several branches periodly,
which is really a little slow. So I'd like to make it can run parally, here
are some thoughts about it:
1) Make fetch can run parallelly, this is easy to do, and safe enough as the
   patches does
2) Make recipeparse can parse layers parallelly, we may need split
   update_layer.py into two parts:
   - The one which only does recipeparse, this costs a lot of time, and can be
     parallell.
   - The one which writes to database (can't be parallel, and doesn't have to)

I will work on it if no objections.

// Robert

The following changes since commit fa0b01082fb0596959841e95af8c516ae3f267a7:

  admin: fix dependency display and search (2017-12-21 16:14:17 +1300)

are available in the git repository at:

  git://git.pokylinux.org/poky-contrib rbt/layerindex_parallel
  http://git.pokylinux.org/cgit.cgi//log/?h=rbt/layerindex_parallel

Robert Yang (1):
  update.py: fetch repos parallelly

 layerindex/update.py | 47 ++++++++++++++++++++++++++++++++++-------------
 settings.py          |  2 ++
 2 files changed, 36 insertions(+), 13 deletions(-)

-- 
2.7.4




More information about the yocto mailing list