Re: March update on bordeaux.guix.gnu.org

Hello, Christopher Baines skribis: > The max-age of that narinfo is currently based on the scheduled removal > of the zstd compressed nar, which is going to happen quite far in the > future. > > I did think of a number of ways to approach this, and I'm not sure I've > settled on the right one ye

Re: March update on bordeaux.guix.gnu.org

Ludovic Courtès writes: > Hi! > > Christopher Baines skribis: > >> Related to this, I've added options to the nar-herder to help change the >> TTL being used, and reduced the TTL for bordeaux.guix.gnu.org to 10 >> minutes (from 180 days) [4]. This will at least mean that in the future, >> the n

Re: March update on bordeaux.guix.gnu.org

Hi! Christopher Baines skribis: > I've finally got around to starting to address the problems with > disappearing nars discussed in [3]. The nar-herder now schedules nars > which it's generated for removal and the time for removal is based on > the TTL in use. > > 3: https://issues.guix.gnu.org/

March update on bordeaux.guix.gnu.org

Hey! I'm think the last update I sent out was back in April 2023 [1], but it's coming up to 3 years since bordeaux was added as a default substitute server [2]. It's scary how much time has passed! 1: https://lists.gnu.org/archive/html/guix-devel/2023-04/msg00319.html 2: https://guix.gnu.org/en/

April update on bordeaux.guix.gnu.org / guix-build-coordinator

Hey! I sent out the last update about a month ago in March [1]. 1: https://lists.gnu.org/archive/html/guix-devel/2023-03/msg00262.html ## Numbers bordeaux.guix.gnu.org currently provides ~2.4 million nars, which take up ~10TiB to store. ## Storage There are two machines with all the nars, h

Re: March update on bordeaux.guix.gnu.org

Hi Chris, Christopher Baines skribis: > ## Serving fixed output files by hash > > bordeaux.guix.gnu.org is now in the list of content addressed mirrors > [2]. Yay! > ## Referential integrity > > This is usually something I think about in the context of databases, but > nars/narinfos have refer

Re: March update on bordeaux.guix.gnu.org

Hi Chris, Thanks for writing the update; it's come a long way :-). -- Thanks, Maxim

March update on bordeaux.guix.gnu.org

Hey! The last update was sent out back in January [1], while things are stable there has been some activity in the last couple of months. 1: https://lists.gnu.org/archive/html/guix-devel/2023-01/msg00199.html ## Numbers bordeaux.guix.gnu.org currently provides ~2.2 million nars, which take up

January (2023) update on bordeaux.guix.gnu.org

Hey! The last update was sent out in September [1], so 4 and a bit months ago. 1: https://lists.gnu.org/archive/html/guix-devel/2022-09/msg00038.html ## Numbers bordeaux.guix.gnu.org currently provides ~2 million nars, which take up ~8.3TiB to store. Substitute availability is still reasonabl

Re: September update on bordeaux.guix.gnu.org

Hi Chris, On Sat, Sep 03, 2022 at 01:13 PM, Christopher Baines wrote: > Hey, > > The last update was sent out in May [1], so this update roughly covers > the last 3 months. > > 1: > > This hasn't been my primary focus, so some

September update on bordeaux.guix.gnu.org

Hey, The last update was sent out in May [1], so this update roughly covers the last 3 months. 1: https://lists.gnu.org/archive/html/guix-devel/2022-05/msg00202.html This hasn't been my primary focus, so some of the changes that somewhat involve bordeaux.guix.gnu.org relate to using it for patch

May update on bordeaux.guix.gnu.org

Hi! The last update was sent out in February [1], so this update covers roughly the last 3 months. 1: https://lists.gnu.org/archive/html/guix-devel/2022-02/msg00099.html ### Summary bordeaux.guix.gnu.org is one of the default sources of substitutes, the other one being ci.guix.gnu.org. I haven

Start of 2022 update on bordeaux.guix.gnu.org (over 1,000,000 successful builds!)

Hey! It's not quite been a year since bordeaux.guix.gnu.org started operating, but I thought I'd send out an update email towards the start of 2022 looking back in to 2021 and looking forward to the rest of this year. If you're missing some context, this blog post should be useful, and has lots o

Re: Mid-December update on bordeaux.guix.gnu.org

Ludovic Courtès writes: >> However, due to the time spent not building things, the backlog is >> longer than usual, and the substitute availability (especially for >> x86_64-linux and i686-linux) is lower than usual. > > Yeah, ‘guix weather coreutils’ finds nothing on bordeaux.guix right now. I

Re: Mid-December update on bordeaux.guix.gnu.org

Hello! Christopher Baines skribis: > In summary, the space issue I mentioned in the previous update has > effectively been addressed. All the paused agents are now unpaused and > builds are happening again. Yay! > However, due to the time spent not building things, the backlog is > longer than

Re: Mid-December update on bordeaux.guix.gnu.org

Sorry, this message was intended for the guix-sysadmin mailing list, I did not want to bother all of Guix ;-) Andreas

Re: Mid-December update on bordeaux.guix.gnu.org

Hello! Am Wed, Dec 15, 2021 at 04:48:21PM + schrieb Christopher Baines: > As for build machines, milano-guix-1 came back online today, which is > great. I believe harbourfront is still unusable through (broken hard > drive). We spent an hour in the server room with a colleague and tried to ge

Re: Mid-December update on bordeaux.guix.gnu.org

Am Thu, Dec 16, 2021 at 12:48:34PM + schrieb Christopher Baines: > I too want to coordinate, although I think that having two independent > build farms is actually good for reliability. Indeed, if we have enough build power, that would be ideal. It would also help to examine reproducibility.

Re: Mid-December update on bordeaux.guix.gnu.org

zimoun writes: > Hi Chris, > > On Thu, 16 Dec 2021 at 00:20, Christopher Baines wrote: >> zimoun writes: > >>> Do you think that Bordeaux could run >>> >>> >> >> The Guix Build Coordinator just builds derivations. I h

Re: Mid-December update on bordeaux.guix.gnu.org

Hi Chris, On Thu, 16 Dec 2021 at 00:20, Christopher Baines wrote: > zimoun writes: >> Do you think that Bordeaux could run >> >> > > The Guix Build Coordinator just builds derivations. I haven't got it to > build a man

Re: Mid-December update on bordeaux.guix.gnu.org

zimoun writes: > Hi Chris, > > Thanks for the update. And for the all work. :-) > > > On Wed, 15 Dec 2021 at 16:48, Christopher Baines wrote: > >> In summary, the space issue I mentioned in the previous update has >> effectively been addressed. All the paused agents are now unpaused and >> bui

Re: Mid-December update on bordeaux.guix.gnu.org

Hi Chris, Thanks for the update. And for the all work. :-) On Wed, 15 Dec 2021 at 16:48, Christopher Baines wrote: > In summary, the space issue I mentioned in the previous update has > effectively been addressed. All the paused agents are now unpaused and > builds are happening again. The t

Mid-December update on bordeaux.guix.gnu.org

Hey! I sent out the last update 3 weeks ago [1]. 1: https://lists.gnu.org/archive/html/guix-devel/2021-11/msg00154.html In summary, the space issue I mentioned in the previous update has effectively been addressed. All the paused agents are now unpaused and builds are happening again. However,

Re: Update on bordeaux.guix.gnu.org

Christopher Baines writes: > [[PGP Signed Part:Undecided]] > > Ricardo Wurmus writes: > >> Ludovic Courtès writes: >> The disk space usage trend is pretty much linear, so if things continue without any change, I think it will be necessary to pause the agents within a month

Re: Update on bordeaux.guix.gnu.org

Ricardo Wurmus writes: > Ludovic Courtès writes: > >>> The disk space usage trend is pretty much >>> linear, so if things continue without any change, I think it will >>> be >>> necessary to pause the agents within a month, to avoid filling up >>> bayfront entirely. >> >> Ah, bummer. I hope we

Re: Update on bordeaux.guix.gnu.org

Ludovic Courtès writes: > Christopher Baines skribis: > >> I've been doing some performance tuning, submitting builds is now more >> parallelised, a source of slowness when fetching builds has been >> addressed, and one of the long queries involved in allocating builds has >> been removed, whic

Re: Update on bordeaux.guix.gnu.org

Hi, [space is running out on bayfront, so I wrote:] Remember that I’ve got three 256G SSDs here that I could send to wherever bayfront now sits. With LVM or a RAID configuration these could just be added to the storage pool — if bayfront has sufficient slots for three more disks. You wrote

Re: Update on bordeaux.guix.gnu.org

Hi, Ricardo Wurmus skribis: > Ludovic Courtès writes: > >>> The disk space usage trend is pretty much >>> linear, so if things continue without any change, I think it will >>> be >>> necessary to pause the agents within a month, to avoid filling up >>> bayfront entirely. >> >> Ah, bummer. I ho

Re: Update on bordeaux.guix.gnu.org

Ludovic Courtès writes: The disk space usage trend is pretty much linear, so if things continue without any change, I think it will be necessary to pause the agents within a month, to avoid filling up bayfront entirely. Ah, bummer. I hope we can find a solution one way or another. Certa

Re: Update on bordeaux.guix.gnu.org

Hello, Christopher Baines skribis: > I've been doing some performance tuning, submitting builds is now more > parallelised, a source of slowness when fetching builds has been > addressed, and one of the long queries involved in allocating builds has > been removed, which also improved handling o

Update on bordeaux.guix.gnu.org

Hey! It's been 3 months since I sent the last update [1]. This email was meant to go out on Friday, but it seems opensmtpd was broken on my machine, so it got stuck. 1: https://lists.gnu.org/archive/html/guix-devel/2021-08/msg00075.html First, some good things: I've been doing some performance

Re: Update on bordeaux.guix.gnu.org

Vagrant Cascadian writes: > On 2021-08-18, Christopher Baines wrote: >> Around 2 months ago, bordeaux.guix.gnu.org came in to existence [1][2]. >> >> 1: >> https://guix.gnu.org/en/blog/2021/substitutes-now-also-available-from-bordeauxguixgnuorg/ >> 2: https://lists.gnu.org/archive/html/guix-dev

Re: Update on bordeaux.guix.gnu.org

On 2021-08-18, Christopher Baines wrote: > Around 2 months ago, bordeaux.guix.gnu.org came in to existence [1][2]. > > 1: > https://guix.gnu.org/en/blog/2021/substitutes-now-also-available-from-bordeauxguixgnuorg/ > 2: https://lists.gnu.org/archive/html/guix-devel/2021-06/msg00044.html > > This to

Update on bordeaux.guix.gnu.org

Hey! Around 2 months ago, bordeaux.guix.gnu.org came in to existence [1][2]. 1: https://guix.gnu.org/en/blog/2021/substitutes-now-also-available-from-bordeauxguixgnuorg/ 2: https://lists.gnu.org/archive/html/guix-devel/2021-06/msg00044.html This took work I'd done on providing substitutes back