[yocto] [EXTERNAL] Problems using MIRRORS variables

Ryan Harkin ryan.harkin at linaro.org
Thu Feb 21 01:46:25 PST 2019


Hi Virgil,

On Wed, 20 Feb 2019 at 22:02, Smith, Virgil (US) <Virgil.Smith at flir.com>
wrote:

> Quick _*workaround*_:
>
>    1. Modify/extend your Repo manifest to pull your mirror repos to the
>    appropriate place under downloads/git2.
>    2. Override the non-sha1 SRCREVs with an appropriate SHA1.
>    Either in .bbappend files or via conf file extensions.
>    The mega-manual describes the latter in association with the
>    buildhistory-collect-srcrevs command.
>
>
>
> Item 1 should not be needed, but it works.
>

Thanks for the tip, that's good to know in any case.


>
>
> One can make a fair case that item 2 SHOULD be done.
>
> A mirror is NOT the same thing as the “official” repo.  This also gives
> you A clear way to record the version used for the build (though it might
> not have been the way you planned).  It is easier to make this case for
> branches/AUTOREV than tags, but tags _*can*_ change and so fetchers
> bypass the download cache for them.
>

I agree. I'll be working with them to make this change at source.

My current workaround is to branch their code and change the SRC_URI to
point to my own server, although I suppose I should have created my own
layer, with bbappends to override. That would prevent branching their code,
so I might do that anyway.

But we'd like to be able to share code between us without having to perform
such branching/forking, so a MIRRORS setup would be very useful. Either
way, I wanted to report the problems I found along the way, hoping there
might be a solution.

Regards,
Ryan.


>
>
>
>
>
> *Virgil Smith *FLIR Detection
>
>
>
> *From:* yocto-bounces at yoctoproject.org <yocto-bounces at yoctoproject.org> *On
> Behalf Of *Ryan Harkin
> *Sent:* Wednesday, February 20, 2019 12:04
> *To:* yocto at yoctoproject.org
> *Subject:* [EXTERNAL] [yocto] Problems using MIRRORS variables
>
>
>
> Hello,
>
>
>
> I'm having a few problems when using the MIRRORS variable for GIT repos. I
> see the same problems with the PREMIRRORS variable.
>
>
>
> My use-case is:
>
>
>
> 1. company A has a private layer with SRC_URI that points to private git
> 2. company A needs to share layers with company B
>
> 3. company B cannot access company A's private git tree
>
> 4. company B has a mirror of the git trees with the same contents,
> including SRC_URIs pointing to the company A private git trees
>
>
>
> I have tried to resolve this using the MIRRORS variable in local.conf.
>
>
>
> If SRCREV is a SHA, it seems to work for me.
>
>
>
> However, it fails when the SRCREV is not a fixed SHA, eg. if SRCREV is a
> branch, tag, or ${AUTOREV}. It looks like do_fetch is trying to pull the
> repo to work out the SHA, but before decoding MIRRORS or PREMIRRORS. It
> appears to do an ls-remote on the original repo, not the mirror, and fails.
>
>
>
> The next issue is when using MIRRORS to replace a GIT repo with one using
> SSH. This may simply be a syntax problem on my side.
>
>
>
> Example:
>
>
>
> MIRRORS += \
>
>  git://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git
> <https://protect2.fireeye.com/url?k=18e8f1e8-44fcb23e-18eaeb44-0cc47aa8d93e-1fcc9aaae925b539&u=http://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git>
> \
>
>  ssh://
> git at git.linaro.org/landing-teams/working/qualcomm/wcnss-config.git;protocol=ssh
> <https://protect2.fireeye.com/url?k=cdc73308-91d370de-cdc529a4-0cc47aa8d93e-08b211984dc709d5&u=http://git@git.linaro.org/landing-teams/working/qualcomm/wcnss-config.git;protocol=ssh>
> \n \
>
> "
>
>
>
> The MIRROR doesn't seem to be used at all in the above example. I've tried
> adding ";protocol=https" to the first line; it doesn't help, and fails in a
> different way, giving a "Exception: KeyError: 'protocol'" error.
>
>
>
> I've shown detailed examples below. People may not need them, but if my
> email isn't clear enough, hopefully they will help explain.
>
>
>
> Setup
>
> --------------------------------------------------
>
> For an example, I'm using Linaro's OE-RPB master. More info here:
> https://protect2.fireeye.com/url?k=e7212319-bb3560cf-e72339b5-0cc47aa8d93e-cd7528c3d8ac86ba&u=https://github.com/96boards/oe-rpb-manifest
> <https://protect2.fireeye.com/url?k=0f0a22ce-531e6118-0f083862-0cc47aa8d93e-6d0fb6a5dfdf7b0d&u=https://github.com/96boards/oe-rpb-manifest>
>
>
>
> First, set up the environment:
>
>
>
>   $ mkdir -p ${WORKSPACE}
>
>   $ repo init -u
> https://protect2.fireeye.com/url?k=47a0bd31-1bb4fee7-47a2a79d-0cc47aa8d93e-27ddccb5db2a6c87&u=https://github.com/96boards/oe-rpb-manifest.git
> <https://protect2.fireeye.com/url?k=460e0170-1a1a42a6-460c1bdc-0cc47aa8d93e-5ea80521ba35bc6d&u=https://github.com/96boards/oe-rpb-manifest.git>
> -b master
>
>   $ repo sync
>
>   $ export MACHINE=dragonboard-410c ; export DISTRO=rpb ; .
> setup-environment
>
>
>
> Then, make sure it's working:
>
>
>
>   $ bitbake -c do_fetch wcnss-config
>
>
>
> Mod a recipe to use a fake SRC_URI, and test that it no longer works.
>
>
>
>   $ sed -i ${WORKSPACE}/layers/meta-qcom/recipes-bsp/wcnss-config/
> wcnss-config_1.13.bb
> <https://protect2.fireeye.com/url?k=896bc539-d57f86ef-8969df95-0cc47aa8d93e-c54ec30fcada6dda&u=http://wcnss-config_1.13.bb/>
> -e 's#git.linaro.org#git.fake.org#g
> <https://protect2.fireeye.com/url?k=106424e0-4c706736-10663e4c-0cc47aa8d93e-55e1b1bc921612e1&u=http://git.linaro.org/#git.fake.org%23g>
> '
>
>   $ rm -rf tmp-rpb-glibc/ ../downloads/git2/*wcnss-config*
>
>   $ bitbake -c do_fetch wcnss-config
>
>
> I see this error output, as expected:
>
> ----------------------------------------------------
>
> WARNING: wcnss-config-1.13-r0 do_fetch: Failed to fetch URL git://
> git.fake.org/landing-teams/working/qualcomm/wcnss-config.git;branch=master;protocol=https
> <https://protect2.fireeye.com/url?k=b785006d-eb9143bb-b7871ac1-0cc47aa8d93e-cbb22c5ba8b8fad2&u=http://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git;branch=master;protocol=https>,
> attempting MIRRORS if available
>
> ERROR: wcnss-config-1.13-r0 do_fetch: Fetcher failure: Fetch command
> export PSEUDO_DISABLED=1; export
> DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1000/bus"; export
> SSH_AGENT_PID="3371"; export SSH_AUTH_SOCK="/run/user/1000/keyring/ssh";
> export
> PATH="/linaro/oe-rpb-workspace-testing/layers/openembedded-core/scripts:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/bin/allarch-linaro-linux:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot/usr/bin/crossscripts:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/sbin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/bin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/sbin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/bin:/linaro/oe-rpb-workspace-testing/bitbake/bin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/hosttools";
> export HOME="/home/ryan"; LANG=C git -c core.fsyncobjectfiles=0 clone
> --bare --mirror
> https://protect2.fireeye.com/url?k=04dc86bc-58c8c56a-04de9c10-0cc47aa8d93e-d490cc7f326e5e8b&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git
> <https://protect2.fireeye.com/url?k=9dc5102d-c1d153fb-9dc70a81-0cc47aa8d93e-17e7d35f41642d46&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git>
> /linaro/oe-rpb-workspace-testing/downloads/git2/git.fake.org.landing-teams.working.qualcomm.wcnss-config.git
> --progress failed with exit code 128, output:
>
> Cloning into bare repository
> '/linaro/oe-rpb-workspace-testing/downloads/git2/git.fake.org.landing-teams.working.qualcomm.wcnss-config.git'...
>
> fatal: unable to access '
> https://protect2.fireeye.com/url?k=eced21d8-b0f9620e-ecef3b74-0cc47aa8d93e-aad428d08bc0bd34&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git/
> <https://protect2.fireeye.com/url?k=2d398219-712dc1cf-2d3b98b5-0cc47aa8d93e-8d652bfea4f1bb72&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git/>':
> Could not resolve host: git.fake.org
> <https://protect2.fireeye.com/url?k=1f079e69-4313ddbf-1f0584c5-0cc47aa8d93e-cfef69661f83cab4&u=http://git.fake.org/>
>
>
>
> ERROR: wcnss-config-1.13-r0 do_fetch: Fetcher failure for URL: 'git://
> git.fake.org/landing-teams/working/qualcomm/wcnss-config.git;branch=master;protocol=https
> <https://protect2.fireeye.com/url?k=3e4b0a5e-625f4988-3e4910f2-0cc47aa8d93e-8a57ed80d72fe8e4&u=http://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git;branch=master;protocol=https>'.
> Unable to fetch URL from any source.
>
> ERROR: wcnss-config-1.13-r0 do_fetch:
>
> ERROR: wcnss-config-1.13-r0 do_fetch: Function failed: base_do_fetch
>
> ERROR: Logfile of failure stored in:
> /linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/temp/log.do_fetch.2525
>
> ERROR: Task
> (/linaro/oe-rpb-workspace-testing/build-rpb/conf/../../layers/meta-qcom/recipes-bsp/wcnss-config/wcnss-config_1.13.bb:do_fetch)
> failed with exit code '1'
>
> ----------------------------------------------------
>
>
>
>
>
> SRCREV PROBLEM
>
> --------------------------------------------------
>
> Set MIRRORS in local.conf and re-test. It should work again.
>
>
>
> $ cat << EOF >> conf/local.conf
>
> MIRRORS += " \\
>
>  git://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git
> <https://protect2.fireeye.com/url?k=c686fc40-9a92bf96-c684e6ec-0cc47aa8d93e-529d34c309f121f8&u=http://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git>
> \\
>
>  git://git.linaro.org/landing-teams/working/qualcomm/wcnss-config.git
> <https://protect2.fireeye.com/url?k=4d15febc-1101bd6a-4d17e410-0cc47aa8d93e-5483e8e34255846d&u=http://git.linaro.org/landing-teams/working/qualcomm/wcnss-config.git>
> \n \\
>
> "
>
> EOF
>
> $ rm -rf tmp-rpb-glibc/ ../downloads/git2/*wcnss-config*
>
> $ bitbake -c do_fetch wcnss-config
>
>
>
> All I see in the build is a warning, and the downloads/git2 directory is
> populated as expected:
>
>
>
> $ ll
>
> total 12K
>
> lrwxrwxrwx 1 ryan ryan  110 Feb 20 17:15
> git.fake.org.landing-teams.working.qualcomm.wcnss-config.git ->
> /linaro/oe-rpb-workspace-testing/downloads/git2/git.linaro.org.landing-teams.working.qualcomm.wcnss-config.git/
>
> -rw-rw-r-- 1 ryan ryan    6 Feb 20 17:15
> git.fake.org.landing-teams.working.qualcomm.wcnss-config.git.done
>
> drwxrwxr-x 7 ryan ryan 4.0K Feb 20 17:15
> git.linaro.org.landing-teams.working.qualcomm.wcnss-config.git/
>
>
>
> Change SRCREV to ${AUTOREV} and retest.
>
>
>
> $ sed -i ${WORKSPACE}/layers/meta-qcom/recipes-bsp/wcnss-config/
> wcnss-config_1.13.bb
> <https://protect2.fireeye.com/url?k=f5482b4f-a95c6899-f54a31e3-0cc47aa8d93e-2fc71701340330e7&u=http://wcnss-config_1.13.bb/>
> -e 's#^SRCREV.*#SRCREV = "${AUTOREV}"#'
>
> $ rm -rf tmp-rpb-glibc/ ../downloads/git2/*wcnss-config*
>
> $ bitbake -c do_fetch wcnss-config
>
>
> I see this failure:
>
>
>
> ERROR: ExpansionError during parsing
> /linaro/oe-rpb-workspace-testing/build-rpb/conf/../../layers/meta-qcom/recipes-bsp/wcnss-config/
> wcnss-config_1.13.bb######################################
> <https://protect2.fireeye.com/url?k=b03d6bea-ec29283c-b03f7146-0cc47aa8d93e-fd7b86554c1ca77c&u=http://wcnss-config_1.13.bb/#%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23%23>
>                | ETA:  0:00:05
>
> Traceback (most recent call last):
>
>   File
> "/linaro/oe-rpb-workspace-testing/bitbake/lib/bb/fetch2/__init__.py", line
> 1170, in srcrev_internal_helper(ud=<bb.fetch2.FetchData object at
> 0x7fd7884c8668>, d=<bb.data_smart.DataSmart object at 0x7fd78988e748>,
> name='default'):
>
>          if srcrev == "AUTOINC":
>
>     >        srcrev = ud.method.latest_revision(ud, d, name)
>
>
>
>   File
> "/linaro/oe-rpb-workspace-testing/bitbake/lib/bb/fetch2/__init__.py", line
> 1565, in Git.latest_revision(ud=<bb.fetch2.FetchData object at
> 0x7fd7884c8668>, d=<bb.data_smart.DataSmart object at 0x7fd78988e748>,
> name='default'):
>
>              except KeyError:
>
>     >            revs[key] = rev = self._latest_revision(ud, d, name)
>
>                  return rev
>
>   File "/linaro/oe-rpb-workspace-testing/bitbake/lib/bb/fetch2/git.py",
> line 594, in Git._latest_revision(ud=<bb.fetch2.FetchData object at
> 0x7fd7884c8668>, d=<bb.data_smart.DataSmart object at 0x7fd78988e748>,
> name='default'):
>
>              """
>
>     >        output = self._lsremote(ud, d, "")
>
>              # Tags of the form ^{} may not work, need to fallback to
> other form
>
>   File "/linaro/oe-rpb-workspace-testing/bitbake/lib/bb/fetch2/git.py",
> line 583, in Git._lsremote(ud=<bb.fetch2.FetchData object at
> 0x7fd7884c8668>, d=<bb.data_smart.DataSmart object at 0x7fd78988e748>,
> search=''):
>
>                      bb.fetch2.check_network_access(d, cmd, repourl)
>
>     >            output = runfetchcmd(cmd, d, True)
>
>                  if not output:
>
>   File
> "/linaro/oe-rpb-workspace-testing/bitbake/lib/bb/fetch2/__init__.py", line
> 888, in runfetchcmd(cmd='export PSEUDO_DISABLED=1; export
> DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1000/bus"; export
> SSH_AGENT_PID="3371"; export SSH_AUTH_SOCK="/run/user/1000/keyring/ssh";
> export
> PATH="/linaro/oe-rpb-workspace-testing/layers/openembedded-core/scripts:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/bin/allarch-linaro-linux:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot/usr/bin/crossscripts:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/sbin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/bin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/sbin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/bin:/linaro/oe-rpb-workspace-testing/bitbake/bin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/hosttools";
> export HOME="/home/ryan"; git -c core.fsyncobjectfiles=0 ls-remote
> https://protect2.fireeye.com/url?k=a526d02d-f93293fb-a524ca81-0cc47aa8d93e-3bb26c47932809ba&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git
> <https://protect2.fireeye.com/url?k=ba04ce85-e6108d53-ba06d429-0cc47aa8d93e-e81e1e6b3f8b767f&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git>
> ', d=<bb.data_smart.DataSmart object at 0x7fd78988e748>, quiet=True,
> cleanup=[], log=None, workdir=None):
>
>
>
>     >        raise FetchError(error_message)
>
>
>
> bb.data_smart.ExpansionError: Failure expanding variable SRCPV, expression
> was ${@bb.fetch2.get_srcrev(d)} which triggered exception FetchError:
> Fetcher failure: Fetch command export PSEUDO_DISABLED=1; export
> DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1000/bus"; export
> SSH_AGENT_PID="3371"; export SSH_AUTH_SOCK="/run/user/1000/keyring/ssh";
> export
> PATH="/linaro/oe-rpb-workspace-testing/layers/openembedded-core/scripts:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/bin/allarch-linaro-linux:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot/usr/bin/crossscripts:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/sbin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/bin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/sbin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/bin:/linaro/oe-rpb-workspace-testing/bitbake/bin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/hosttools";
> export HOME="/home/ryan"; git -c core.fsyncobjectfiles=0 ls-remote
> https://protect2.fireeye.com/url?k=d34d8d14-8f59cec2-d34f97b8-0cc47aa8d93e-ece1a2e77b35a928&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git
> <https://protect2.fireeye.com/url?k=b2a84fb4-eebc0c62-b2aa5518-0cc47aa8d93e-371995473aa70acc&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git>
> failed with exit code 128, output:
>
> fatal: unable to access '
> https://protect2.fireeye.com/url?k=a72c0f65-fb384cb3-a72e15c9-0cc47aa8d93e-f721743056161329&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git/
> <https://protect2.fireeye.com/url?k=7c31f850-2025bb86-7c33e2fc-0cc47aa8d93e-913458af0bd88749&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git/>':
> Could not resolve host: git.fake.org
> <https://protect2.fireeye.com/url?k=2788f5a7-7b9cb671-278aef0b-0cc47aa8d93e-4cf527ffc9088a66&u=http://git.fake.org/>
>
>
>
> A similar error happens if you use a tag rather than ${AUTOREV}:
>
>
>
> $ sed -i ${WORKSPACE}/layers/meta-qcom/recipes-bsp/wcnss-config/
> wcnss-config_1.13.bb
> <https://protect2.fireeye.com/url?k=5703404c-0b17039a-57015ae0-0cc47aa8d93e-ea4cd3a72e60d4d3&u=http://wcnss-config_1.13.bb/>
> -e 's#^SRCREV.*#SRCREV = "debian/1.13"#'
>
> $ rm -rf tmp-rpb-glibc/ ../downloads/git2/*wcnss-config*
>
> $ bitbake -c do_fetch wcnss-config
>
>
>
> These are the messages I see:
>
>
>
> ERROR: wcnss-config-1.13-r0 do_fetch: Fetcher failure: Fetch command
> export PSEUDO_DISABLED=1; export
> DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1000/bus"; export
> SSH_AGENT_PID="3371"; export SSH_AUTH_SOCK="/run/user/1000/keyring/ssh";
> export
> PATH="/linaro/oe-rpb-workspace-testing/layers/openembedded-core/scripts:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/bin/allarch-linaro-linux:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot/usr/bin/crossscripts:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/sbin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/bin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/sbin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/bin:/linaro/oe-rpb-workspace-testing/bitbake/bin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/hosttools";
> export HOME="/home/ryan"; git -c core.fsyncobjectfiles=0 ls-remote
> https://protect2.fireeye.com/url?k=406f0776-1c7b44a0-406d1dda-0cc47aa8d93e-a34fc0276b9f7193&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git
> <https://protect2.fireeye.com/url?k=004d9b16-5c59d8c0-004f81ba-0cc47aa8d93e-e4766c8b68946d93&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git>
> failed with exit code 128, output:
>
> fatal: unable to access '
> https://protect2.fireeye.com/url?k=74555bc8-2841181e-74574164-0cc47aa8d93e-52823b94e880c977&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git/
> <https://protect2.fireeye.com/url?k=fa696296-a67d2140-fa6b783a-0cc47aa8d93e-6c4d08c7ed4fa99b&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git/>':
> Could not resolve host: git.fake.org
> <https://protect2.fireeye.com/url?k=248f6c05-789b2fd3-248d76a9-0cc47aa8d93e-d031a7f235d50f3f&u=http://git.fake.org/>
>
>
>
> ERROR: wcnss-config-1.13-r0 do_fetch:
>
> ERROR: wcnss-config-1.13-r0 do_fetch: Function failed: base_do_fetch
>
> ERROR: Logfile of failure stored in:
> /linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/temp/log.do_fetch.5673
>
> ERROR: Task
> (/linaro/oe-rpb-workspace-testing/build-rpb/conf/../../layers/meta-qcom/recipes-bsp/wcnss-config/wcnss-config_1.13.bb:do_fetch)
> failed with exit code '1'
>
>
>
>
>
>
>
> SSH MIRRORS Problem
>
> --------------------------------------------
>
> From a clean setup as above with the SRC_URI point to to git.fake.org...
>
>
>
> $ sed -i ${WORKSPACE}/layers/meta-qcom/recipes-bsp/wcnss-config/
> wcnss-config_1.13.bb
> <https://protect2.fireeye.com/url?k=a8182e0d-f40c6ddb-a81a34a1-0cc47aa8d93e-d8a09f72a98e05f9&u=http://wcnss-config_1.13.bb/>
> -e 's#git.linaro.org#git.fake.org#g
> <https://protect2.fireeye.com/url?k=7e2710a0-22335376-7e250a0c-0cc47aa8d93e-623f51f874ff8cb3&u=http://git.linaro.org/#git.fake.org%23g>
> '
>
> $ cat << EOF >> conf/local.conf
>
> MIRRORS += " \\
>
>  git://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git
> <https://protect2.fireeye.com/url?k=ca16bb42-9602f894-ca14a1ee-0cc47aa8d93e-6b6b803d58afb693&u=http://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git>
> \\
>
>  ssh://
> git at git.linaro.org/landing-teams/working/qualcomm/wcnss-config.git;protocol=ssh
> <https://protect2.fireeye.com/url?k=5d6cc0b4-01788362-5d6eda18-0cc47aa8d93e-2acfbc51148e1d32&u=http://git@git.linaro.org/landing-teams/working/qualcomm/wcnss-config.git;protocol=ssh>
> \n \\
>
> "
>
> EOF
>
> $ rm -rf tmp-rpb-glibc/ ../downloads/git2/*wcnss-config*
>
> $ bitbake -c do_fetch wcnss-config
>
>
>
> These are the errors I see:
>
>
>
> WARNING: wcnss-config-1.13-r0 do_fetch: Failed to fetch URL git://
> git.fake.org/landing-teams/working/qualcomm/wcnss-config.git;branch=master;protocol=https
> <https://protect2.fireeye.com/url?k=8698c138-da8c82ee-869adb94-0cc47aa8d93e-28cf445e13336db0&u=http://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git;branch=master;protocol=https>,
> attempting MIRRORS if available
>
> ERROR: wcnss-config-1.13-r0 do_fetch: Fetcher failure: Fetch command
> export PSEUDO_DISABLED=1; export
> DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1000/bus"; export
> SSH_AGENT_PID="3371"; export SSH_AUTH_SOCK="/run/user/1000/keyring/ssh";
> export
> PATH="/linaro/oe-rpb-workspace-testing/layers/openembedded-core/scripts:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/bin/allarch-linaro-linux:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot/usr/bin/crossscripts:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/sbin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/usr/bin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/sbin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/recipe-sysroot-native/bin:/linaro/oe-rpb-workspace-testing/bitbake/bin:/linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/hosttools";
> export HOME="/home/ryan"; LANG=C git -c core.fsyncobjectfiles=0 clone
> --bare --mirror
> https://protect2.fireeye.com/url?k=fa4abe42-a65efd94-fa48a4ee-0cc47aa8d93e-b6b91bf272908847&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git
> <https://protect2.fireeye.com/url?k=e244c2d6-be508100-e246d87a-0cc47aa8d93e-7f952daaaf46cbb6&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git>
> /linaro/oe-rpb-workspace-testing/downloads/git2/git.fake.org.landing-teams.working.qualcomm.wcnss-config.git
> --progress failed with exit code 128, output:
>
> Cloning into bare repository
> '/linaro/oe-rpb-workspace-testing/downloads/git2/git.fake.org.landing-teams.working.qualcomm.wcnss-config.git'...
>
> fatal: unable to access '
> https://protect2.fireeye.com/url?k=d022c4f9-8c36872f-d020de55-0cc47aa8d93e-4b2e8b54b85a9a9a&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git/
> <https://protect2.fireeye.com/url?k=3420972a-6834d4fc-34228d86-0cc47aa8d93e-14fedaf78b95862a&u=https://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git/>':
> Could not resolve host: git.fake.org
> <https://protect2.fireeye.com/url?k=4c2d844e-1039c798-4c2f9ee2-0cc47aa8d93e-c9433e6440d277b0&u=http://git.fake.org/>
>
>
>
> ERROR: wcnss-config-1.13-r0 do_fetch: Fetcher failure for URL: 'git://
> git.fake.org/landing-teams/working/qualcomm/wcnss-config.git;branch=master;protocol=https
> <https://protect2.fireeye.com/url?k=f3655f0f-af711cd9-f36745a3-0cc47aa8d93e-89fc024ac7cad7d5&u=http://git.fake.org/landing-teams/working/qualcomm/wcnss-config.git;branch=master;protocol=https>'.
> Unable to fetch URL from any source.
>
> ERROR: wcnss-config-1.13-r0 do_fetch:
>
> ERROR: wcnss-config-1.13-r0 do_fetch: Function failed: base_do_fetch
>
> ERROR: Logfile of failure stored in:
> /linaro/oe-rpb-workspace-testing/build-rpb/tmp-rpb-glibc/work/all-linaro-linux/wcnss-config/1.13-r0/temp/log.do_fetch.7701
>
> ERROR: Task
> (/linaro/oe-rpb-workspace-testing/build-rpb/conf/../../layers/meta-qcom/recipes-bsp/wcnss-config/wcnss-config_1.13.bb:do_fetch)
> failed with exit code '1'
>
>
>
> It looks like the MIRRORS variable hasn't replaced the repo at all.
>
>
>
> Regards,
>
> Ryan.
>
> ------------------------------
>
> Notice to recipient: This email is meant for only the intended recipient
> of the transmission, and may be a communication privileged by law, subject
> to export control restrictions or that otherwise contains proprietary
> information. If you receive this email by mistake, please notify us
> immediately by replying to this message and then destroy it and do not
> review, disclose, copy or distribute it. Thank you in advance for your
> cooperation.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/yocto/attachments/20190221/92bec142/attachment-0001.html>


More information about the yocto mailing list