johnspackman
Posts: 18
Joined: Tue Jul 16, 2013 9:29 am

Mirror of archive.raspberrypi.org

Thu Feb 08, 2018 12:41 pm

Hi

We have around 1,000 Pi's (and we expect to be growing by another 300 this year) and we want to take control of our distribution of updates; this means creating private mirrors of archive.raspberrypi.org and archive.raspbian.org.

I've already created a mirror of archive.raspbian.org, but the only mechanism I have found for archive.raspberrypi.org is using wget; this is a little slow but works - however in the past caused my IP address to get blocked half way through updating my copy of the repo.

Please can someone tell me either how to mirror the repo, or put me in touch with someone who can?

Regards
John

ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 6178
Joined: Fri Jul 29, 2011 5:36 pm
Location: The unfashionable end of the western spiral arm of the Galaxy

Re: Mirror of archive.raspberrypi.org

Thu Feb 08, 2018 12:54 pm

Internally, we use debmirror.

Which repo blocked your IP?

johnspackman
Posts: 18
Joined: Tue Jul 16, 2013 9:29 am

Re: Mirror of archive.raspberrypi.org

Fri Feb 09, 2018 9:40 am

It was archive.raspberrypi.org, my wget script started returning HTTP errors and wasn't allowed to download any more, but when I checked from my workstation (at a different location) I was able to browse and download just fine.

Do you have an example script you can send me for debmirror? I've not used debmirror before today, and having a quick try just now it's reporting errors; it looks like it's trying rysnc even with `--method=http` and then having errors with GPG even though I've specified `--ignore-release-gpg`:

Code: Select all

# debmirror --host=archive.raspberrypi.org -root=debian --dist=wheezy,jessie,stretch --section=main --no-source --ignore-release-gpg --method=http mirror/test
rsync: failed to connect to archive.raspberrypi.org: Network is unreachable (101)
rsync error: error in socket IO (code 10) at clientserver.c(124) [receiver=3.0.6]
Warning: failed to use rsync to download extra files.
gpgv: keyblock resource `/root/.gnupg/trustedkeys.gpg': No such file or directory
gpgv: Signature made Fri 22 Sep 2017 15:18:16 BST using RSA key ID 7FA3303E
[GNUPG:] ERRSIG 82B129927FA3303E 1 8 00 1506089896 9
[GNUPG:] NO_PUBKEY 82B129927FA3303E
gpgv: Can't check signature: No public key
gpgv: keyblock resource `/root/.gnupg/trustedkeys.gpg': No such file or directory
gpgv: Signature made Tue 06 Feb 2018 11:12:27 GMT using RSA key ID 7FA3303E
[GNUPG:] ERRSIG 82B129927FA3303E 1 8 00 1517915547 9
[GNUPG:] NO_PUBKEY 82B129927FA3303E
gpgv: Can't check signature: No public key
gpgv: keyblock resource `/root/.gnupg/trustedkeys.gpg': No such file or directory
gpgv: Signature made Thu 08 Feb 2018 13:17:09 GMT using RSA key ID 7FA3303E
[GNUPG:] ERRSIG 82B129927FA3303E 1 8 00 1518095829 9
[GNUPG:] NO_PUBKEY 82B129927FA3303E
gpgv: Can't check signature: No public key
Errors:
 Download of dists/sid/Release failed: 404 Not Found
Failed to download some Release or Release.gpg files!
releasing 1 pending lock... at /usr/share/perl5/vendor_perl/LockFile/Simple.pm line 206.

# ping archive.raspberrypi.org
PING lb.raspberrypi.org (46.235.227.11) 56(84) bytes of data.
64 bytes from 46.235.227.11: icmp_seq=1 ttl=55 time=11.2 ms
64 bytes from 46.235.227.11: icmp_seq=2 ttl=55 time=12.7 ms

Return to “Raspbian”