[yocto] Shallow git clones?

Khem Raj raj.khem at gmail.com
Thu Nov 3 12:19:56 PDT 2016


> On Nov 3, 2016, at 6:06 AM, Gary Thomas <gary at mlbassoc.com> wrote:
> 
> I recall seeing some discussion in the past about using shallow
> GIT clones when importing repositories?  Is this ever going to
> happen?
> 
> The reason I ask is that I routinely save the GIT tarballs and
> some of them are obscenely obese :-(  The worst of the bunch
> is the device firmware for the RaspberryPi (as of today):
>  -rw-rw-r-- 1 gthomas gthomas 6321877646 Nov  3 12:13 git2_github.com.raspberrypi.firmware.git.tar.gz
> 
> This particular tar file increased by more than 300MB since
> the last time I downloaded it (only 2016-09-13!)  I routinely
> slosh these files across the oceans (sometimes using tin cans
> and strings it seems) and this can be very tedious.  Is there
> anything that can be done to make these files a bit more manageable?

while shallow clones is a comprehensive solution and we should probably slot it for 2.3 release
the above recipe should stop using git fetcher and convert to using tarballs
since this git repo hosts binaries, it will bloat with every time they push
stuff into it. Someone should teach these RPi folks to not abuse github.

> 
> Note: the RaspberryPi files are not the only offenders.  Take
> a look at the really big ones on my download mirror (~1GB or larger):
>  912558047 Jun  3  2015 git2_git.yoctoproject.org.linux-yocto-3.14.git.tar.gz
>  916869431 Sep 18 16:54 git2_git.yoctoproject.org.linux-yocto-4.4.git.tar.gz
>  917066415 Mar  8  2011 chrome-11.0.686.0.tar.bz2
>  929710560 Jun  5  2014 git2_git.yoctoproject.org.linux-yocto-3.10.git.tar.gz
>  975438005 May 14  2015 git2_git.yoctoproject.org.linux-yocto-3.19.git.tar.gz
>  997340641 Jan  4  2013 git2_dev.omapzoom.org.pub.scm.integration.kernel-ubuntu.git.tar.gz
> 1013093794 Jul 22  2011 chrome-14.0.825.0.tar.bz2
> 1097457194 Jul  9  2015 git2_github.com.Itseez.opencv.git.tar.gz
> 1101241868 Jul 15 15:44 git2_git.freescale.com.ppc.sdk.linux.git.tar.gz
> 1167801376 Oct 24  2013 git2_git.kernel.org.pub.scm.linux.kernel.git.stable.linux-stable.git.tar.gz
> 1192994858 Nov 24  2014 git2_github.com.Freescale.linux-mainline.git.tar.gz
> 1399737300 Mar 30  2010 git_git.kernel.org.pub.scm.linux.kernel.git.tmlind.linux-omap-2.6.git.tar.gz
> 1455878541 Feb 22  2016 git2_github.com.Freescale.linux-fslc.git.tar.gz
> 1637597724 Aug 11 09:45 git2_git.freescale.com.imx.linux-2.6-imx.git.tar.gz
> 1785320074 Aug 15  2012 git2_github.com.mirrors.gcc.git.tar.gz
> 1787717120 Oct 11 10:28 git2_git.ti.com.ti-linux-kernel.ti-linux-kernel.git.tar.gz
> 2070939344 Nov  3 12:11 git2_github.com.raspberrypi.linux.git.tar.gz
> 2478557202 Aug 10 11:47 git2_github.com.boundarydevices.linux-imx6.git.tar.gz
> 2525826872 Jul 12 16:42 git2_github.com.gcc-mirror.gcc.tar.gz
> 6321877646 Nov  3 12:13 git2_github.com.raspberrypi.firmware.git.tar.gz
> 
> --
> ------------------------------------------------------------
> Gary Thomas                 |  Consulting for the
> MLB Associates              |    Embedded world
> ------------------------------------------------------------
> --
> _______________________________________________
> yocto mailing list
> yocto at yoctoproject.org
> https://lists.yoctoproject.org/listinfo/yocto

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 204 bytes
Desc: Message signed with OpenPGP using GPGMail
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20161103/ecb5e666/attachment.pgp>


More information about the yocto mailing list