Apache has a mirror network, which only covers the most recent release
of any given package. They also have an additional site which does not
appear to be a CDN, and is throttled and can maybe ban you if you use it
too much. Unfortunately, it is also the ONLY way to actually get
historic releases of many packages.
Use it, and use it last -- after every other mirror has been tried,
which should handle latest releases. In combination with GENTOO_MIRRORS
this should ensure that users can actually download software when
needed, without running afoul of throttling.
Signed-off-by: Eli Schwartz <eschwartz@gentoo.org>
---
profiles/thirdpartymirrors | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/profiles/thirdpartymirrors b/profiles/thirdpartymirrors
index bb5398896976..d3a857327495 100644
--- a/profiles/thirdpartymirrors
+++ b/profiles/thirdpartymirrors
@@ -1,4 +1,4 @@
-apache https://dlcdn.apache.org/ https://apache.mirror.iphh.net/ https://artfiles.org/apache.org/ https://ftp-stud.hs-esslingen.de/pub/Mirrors/ftp.apache.org/dist/ https://ftp.fau.de/apache/ https://apache.osuosl.org/
+apache https://dlcdn.apache.org/ https://apache.mirror.iphh.net/ https://artfiles.org/apache.org/ https://ftp-stud.hs-esslingen.de/pub/Mirrors/ftp.apache.org/dist/ https://ftp.fau.de/apache/ https://apache.osuosl.org/ https://archive.apache.org/dist/
cpan https://cpan.metacpan.org https://www.cpan.org
debian https://deb.debian.org/debian/
http://ftp.au.debian.org/debian/ http://ftp.at.debian.org/debian/ http://ftp.by.debian.org/debian/ http://ftp.be.debian.org/debian/ http://ftp.br.debian.org/debian/ http://ftp.bg.debian.org/debian/ http://ftp.ca.debian.org/debian/ http://ftp2.cn.debian.org/debian/ http://ftp.cn.debian.org/debian/ http://ftp.hr.debian.org/debian/ http://ftp.cz.debian.org/debian/ http://ftp.dk.debian.org/debian/ http://ftp.sv.debian.org/debian/ http://ftp.ee.debian.org/debian/ http://ftp.fi.debian.org/debian/ http://ftp.fr.debian.org/debian/ http://ftp2.de.debian.org/debian/ http://ftp.de.debian.org/debian/ http://ftp.gr.debian.org/debian/ http://ftp.hu.debian.org/debian/ http://ftp.is.debian.org/debian/ http://ftp.ie.debian.org/debian/ http://ftp.it.debian.org/debian/ http://ftp.jp.debian.org/debian/ http://ftp.lt.debian.org/debian/ http://ftp.mx.debian.org/debian/ http://ftp.md.debian.org/debian/ http://ftp.nl.debian.org/debian/ http://ftp.nc.debian.org/debian/ http://ftp.nz.debian.org/debian/ http://ftp.no.debian.org/debian/ http://ftp.pl.debian.org/debian/ http://ftp.pt.debian.org/debian/ http://ftp.ro.debian.org/debian/ http://ftp.ru.debian.org/debian/ http://ftp.sg.debian.org/debian/ http://ftp.sk.debian.org/debian/ http://ftp.si.debian.org/debian/ http://ftp.es.debian.org/debian/ http://ftp.se.debian.org/debian/ http://ftp.ch.debian.org/debian/ http://ftp.tw.debian.org/debian/ http://ftp.tr.debian.org/debian/ http://ftp.ua.debian.org/debian/ http://ftp.uk.debian.org/debian/ http://ftp.us.debian.org/debian/
gentoo https://distfiles.gentoo.org/distfiles https://gentoo.osuosl.org/distfiles https://ftp.halifax.rwth-aachen.de/gentoo/distfiles https://ftp.fau.de/gentoo/distfiles
Apache has a mirror network, which only covers the most recent releaseThis does not actually do it "last" as you claim.
of any given package. They also have an additional site which does not
appear to be a CDN, and is throttled and can maybe ban you if you use it
too much. Unfortunately, it is also the ONLY way to actually get
historic releases of many packages.
Use it, and use it last -- after every other mirror has been tried,
which should handle latest releases. In combination with GENTOO_MIRRORS
this should ensure that users can actually download software when
needed, without running afoul of throttling.
On Tue, Oct 22, 2024 at 11:24:29PM -0400, Eli Schwartz wrote:
Apache has a mirror network, which only covers the most recent release
of any given package. They also have an additional site which does not appear to be a CDN, and is throttled and can maybe ban you if you use it too much. Unfortunately, it is also the ONLY way to actually get
historic releases of many packages.
Use it, and use it last -- after every other mirror has been tried,This does not actually do it "last" as you claim.
which should handle latest releases. In combination with GENTOO_MIRRORS this should ensure that users can actually download software when
needed, without running afoul of throttling.
Portage shuffles the list of thirdpartymirrors: https://gitweb.gentoo.org/proj/portage.git/tree/lib/portage/package/ebuild/fetch.py#n1140
While it increases mirror burden; this should likely be done as a
distinct thirdpartymirror:
apache-historical https://archive.apache.org/dist/
And that gets used in ebuilds when distfiles fall off the main mirrors
[until such time as strictly ordered behavior is available].
This does not actually do it "last" as you claim.
Portage shuffles the list of thirdpartymirrors: https://gitweb.gentoo.org/proj/portage.git/tree/lib/portage/package/ebuild/fetch.py#n1140
While it increases mirror burden; this should likely be done as a
distinct thirdpartymirror:
apache-historical https://archive.apache.org/dist/
And that gets used in ebuilds when distfiles fall off the main mirrors
[until such time as strictly ordered behavior is available].
In likelihood, unless the ebuild has RESTRICT=mirror, I'd hope that that
the primary request is made to Gentoo's mirrors before the upstreams: so
that we are better open-source participants.
Users who are also trying to use old ebuilds, where the distfile is no
longer on the Gentoo mirrors should also consider thirdpartymirrors in
their profiles, in which case inserting this entry locally would be appropriate.
Sysop: | Keyop |
---|---|
Location: | Huddersfield, West Yorkshire, UK |
Users: | 493 |
Nodes: | 16 (3 / 13) |
Uptime: | 174:26:47 |
Calls: | 9,705 |
Calls today: | 5 |
Files: | 13,736 |
Messages: | 6,178,746 |