Re: Slow substitute narinfo querying for japanese mirror

[Luke Yasuda]

On 2025-08-12 19:42, Maxim Cournoyer wrote:

Hello Jing,


max my networking equipment bandwidth at about 12 MiB/s, while with
ci.guix.gnu.org it typically tops around 5 MiB/s on the best days).

I've been using the mirror you've kindly setup for at least a month [0], and it's given me a nice speed boost compared to berlin (I can sometimes

I'm glad the at least someone found it useful ;D

One place where it is excruciatingly slow though is for checking the
availability of the substitutes ("looking for substitutes"), which

I often must 'export
GUIX_BUILD_OPTIONS=--substitute-urls=https://ci.guix.gnu.org' to get
past a lengthy check when there are many substitutes being looked for.

corresponds to querying the server for .narinfo files; it seems to be on at least a 10x order slower than berlin, perhaps 100x, to the point that

hmm, I would wonder if the connection just times out. It's not uncommon these days unfortunately: the router is sometimes overloaded and drops packets, nginx may drop connections too, because of very high traffic from crawlers, bad bots, DDoS attacks, etc. The internet has become extremely hostile.

Is there something in the proxy setup that could explain this? From what

I remember, the connection is supposed to be reused for multiple
queries; perhaps a configuration issue could cause this to not be
possible for your mirror? (I'm just speculating reasons that could
explain a slowdown).

Anyhow, thanks for maintaining it!

[0]  https://berlin-guix.jing.rocks

--
Luke Yasuda
About me: https://jing.rocks/about/
GPG Fingerprint: 4E09 8D19 00AA 3F72 1899 2614 09B3 316E 13A1 1EFC

I have more bad news. I'm moving to a new home, and because I host the servers at home, they come with me. There is no word on when the fiber line will be done at the new place yet, and I will have to rely on a pocket wifi for internet access for months. Therefore the servers will be down for an unknown amount of time. I'm not optimistic that the fiber line will be connected soon; the ISP seems to be very reluctant to get the work done because the building is too old and may not have space for more (fiber optic) cables. The worst case scenario is that I'll live with internet over tv cables, no static IPs; but let's hope it doesn't come to that. Either way, *.jing.rocks will be down for a few months, starting from Aug 14 ish.

signature.asc
Description: OpenPGP digital signature