Z572 <z572@z572.online> writes: > Christopher Baines <m...@cbaines.net> writes: > >> Hilton Chain <hako@ultrarare.space> writes: >> >>> Recently, I got in touch with Jing Luo on mirror hosting. They have >>> hosted mirrors for various distributions[1], and it's really kind of >>> them to still[2] be willing to help out. >>> >>> As a result, here are two new mirrors: >>> >>> --8<---------------cut here---------------start------------->8--- >>> https://berlin-guix.jing.rocks >>> https://bordeaux-guix.jing.rocks >>> --8<---------------cut here---------------end--------------->8--- >>> >>> for https://ci.guix.gnu.org and https://bordeaux.guix.gnu.org, >>> respectively. >>> >>> Hope this will improve user experience of Guix in Asia! (Excluding PRC, >>> GFW blocks Jing's home, sadly) >>> >>> >>> >>> However currently there's one bottleneck we're facing: the mirrors are >>> implemented as reverse proxy with cache, and there's latency issue with >>> uncached substitutes. When looking up several hundred substitutes, it >>> takes minutes. >> >> The nar-herder which handles serving substitutes for the bordeaux build >> farm is meant to enable high performance mirroring, and that's what's >> used for the mirrors listed on https://bordeaux.guix.gnu.org/. >> >> This does require running the nar-herder, but this should be possible on >> foreign distros. The nar-herder uses a SQLite database containing the >> narinfo information, and responds directly to the narinfo requests >> meaning those don't have to be reverse proxied, cutting the latency. > > As far as I know, for reasons such as unified management, security and > scalability, most mirror sites prefer to use static services and expect > the mirror recipients to provide rsync. It is not feasible to run > nar-herder on their servers
This could potentially be provided as well, the most efficient option would be to have some bridge between the nar-herder and rsync or http and rsync. Alternatively, the functionality to write out all the narinfo files to disk could be added to the nar-herder, then rsync could just work over all the narinfo and nar files on disk.
signature.asc
Description: PGP signature