Re: Architecture to reduce download time when pulling multiple packages – historic success with magnet URLs, BTIHs, & Aria2c!

2023-11-07 Thread JRHaigh+ML . GNU . Guix--- via
Hi Christopher, At Z+0100=2023-10-18Wed09:11:21, Christopher Baines sent: > […] > Reimplementing fetching files/substitutes using a tool like aria2c would > probably greatly complicate the bootstrap path. Why not make Aria2c an optional dependency? It could be implemented such that it is not r

Re: Architecture to reduce download time when pulling multiple packages – historic success with magnet URLs, BTIHs, & Aria2c!

2023-10-18 Thread Christopher Baines
Josh Marshall writes: > what I want to implement is to parallelize obtaining > packages. Server side vs client side. This is already possible, if you enable parallel build jobs, then you'll get parallel downloads. There's also been work to allow controling these things separately. > So it sou

Re: Architecture to reduce download time when pulling multiple packages – historic success with magnet URLs, BTIHs, & Aria2c!

2023-10-17 Thread Josh Marshall
How long is traditional before I can bump a thread? On Sun, Oct 15, 2023 at 2:21 PM Josh Marshall wrote: > > So it sounds like my first steps are to re-implement the downloads > using aria2c. This would affect the minimum base package, no? Can I > get some buy-in from maintainers that such chan

Re: Architecture to reduce download time when pulling multiple packages – historic success with magnet URLs, BTIHs, & Aria2c!

2023-10-15 Thread Josh Marshall
So it sounds like my first steps are to re-implement the downloads using aria2c. This would affect the minimum base package, no? Can I get some buy-in from maintainers that such changes are acceptable? On Fri, Oct 13, 2023 at 2:06 PM James R. Haigh (+ML.GNU.Guix subaddress) wrote: > > Hi Josh,

Re: Architecture to reduce download time when pulling multiple packages – historic success with magnet URLs, BTIHs, & Aria2c!

2023-10-13 Thread JRHaigh+ML . GNU . Guix--- via
Hi Josh, At Z-0400=2023-10-13Fri12:36:01, Josh Marshall sent: > This is to parallelize connections which should never hurt downloading but > can help. Mirroring would be parallelizing for providing packages, what I > want to implement is to parallelize obtaining packages. Server side vs > cli

Re: Architecture to reduce download time when pulling multiple packages

2023-10-13 Thread Josh Marshall
This is to parallelize connections which should never hurt downloading but can help. Mirroring would be parallelizing for providing packages, what I want to implement is to parallelize obtaining packages. Server side vs client side. On Fri, Oct 13, 2023 at 6:18 AM Christopher Baines wrote: > >

Re: Architecture to reduce download time when pulling multiple packages

2023-10-13 Thread Christopher Baines
Josh Marshall writes: > I just went and installed everything with texlive in the name. A few > were less than 1KB, a few over 1GB. Download speed peaked at less > than 3MB/s. My Internet is a fiber connection with symmetric gigabit. > However, I think picking at this info is the wrong tack.

Re: Architecture to reduce download time when pulling multiple packages

2023-10-12 Thread Josh Marshall
I just went and installed everything with texlive in the name. A few were less than 1KB, a few over 1GB. Download speed peaked at less than 3MB/s. My Internet is a fiber connection with symmetric gigabit. However, I think picking at this info is the wrong tack. I am of the opinion this should b

Re: Architecture to reduce download time when pulling multiple packages

2023-10-12 Thread Christopher Baines
Josh Marshall writes: > Presently, I am waiting until the end of global warming to finish > pulling down texlive packages. I see that there are a few servers > from which packages are provided. Is the following feasible as a > feature to improve effective download speed? It really depends. Ca

Architecture to reduce download time when pulling multiple packages

2023-10-11 Thread Josh Marshall
Presently, I am waiting until the end of global warming to finish pulling down texlive packages. I see that there are a few servers from which packages are provided. Is the following feasible as a feature to improve effective download speed? List the base information for what packages there are