Re: Guix pull: avoiding "Computing Guix derivation"

2024-06-24 Thread Edouard Klein
Hi Ryan, Just to tell you that guix deploy was the key :) Here is what I came up with: https://the-dam.org/docs/explanations/GarbageCollection.html using guix deploy, in conjunction with: (modify-service os guix (channels %beaverlabs-channels) (guix (guix-fo

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-31 Thread Edouard Klein
Hi, Josselin Poiret writes: > [[PGP Signed Part:Undecided]] > Hi everyone, > > Edouard Klein writes: > >> I think my misunderstanding boils down to a bad mental model of how guix >> works. >> >> What I imagine the "Computing guix derivation" step to be is no >> different than building a packag

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-15 Thread Josselin Poiret
Hi everyone, Edouard Klein writes: > I think my misunderstanding boils down to a bad mental model of how guix > works. > > What I imagine the "Computing guix derivation" step to be is no > different than building a package whose inputs are the channels' > sources, guile, and the current guix, an

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-14 Thread Richard Sent
> I see that build in build-self.scm isn't a derivation, but most of the time > spent in build is, to my knowledge, while the daemon is building the > build-program derivation. build-program in build-self.scm returns a > gexp->script file-like object and I see various /gnu/store > *-compute-gui

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-14 Thread Edouard Klein
Hi ! I may be a bit dense, but there's one part I don't understand: Ludovic Courtès writes: > Hi, > > Edouard Klein skribis: > >> - Why is this step not substitutable ? The inputs are known, a hash can >> be derived, a substitute server could be queried for an output of that >> hash ? What am

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-14 Thread Edouard Klein
Thank you both for this detailed explanations. I think I have a better grasp at the problem. Keep in mind that I never not dive into guix's internals. I just - had previous experience with Gentoo and Source Mage (anyone remember this distro ?) who did some interesting steps towards reproductibili

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-14 Thread Edouard Klein
Hi, Good advice, thank you ! I just began playing with btrfs, and I see that you can convert an existing ext4 to a btrfs, so I may try that (I'll just run some backups first). I was not aware that guix deploy does the computation on the local computer rather than on the target. I'll look more in

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-14 Thread Richard Sent
>> - Why is this step not substitutable ? The inputs are known, a hash can >> be derived, a substitute server could be queried for an output of that >> hash ? What am I missing ? Does the guix derivation not end up in the >> store ? What makes it so special that it can't be served by a substitute >

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-14 Thread Ludovic Courtès
Hi, Edouard Klein skribis: > - Why is this step not substitutable ? The inputs are known, a hash can > be derived, a substitute server could be queried for an output of that > hash ? What am I missing ? Does the guix derivation not end up in the > store ? What makes it so special that it can't b

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-14 Thread Simon Tournier
Hi Richard, On lun., 13 mai 2024 at 20:52, Richard Sent wrote: > You're correct. This solution wouldn't be sufficient to avoid "Computing > Guix Derivation" for every possible A or B. To my understanding it could > reduce the frequency this occurs. [...] > Assuming D changes significantly less

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-13 Thread Richard Sent
Simon Tournier writes: > Hi, > > On lun., 13 mai 2024 at 17:11, Richard Sent > wrote: > >> Instead of A and B building C directly, A and B download the >> substitutable Guix package D, then use D to build C. Because D is a >> reproducible package, it should be substitutable from both A and B. >

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-13 Thread Simon Tournier
Hi, On lun., 13 mai 2024 at 17:11, Richard Sent wrote: > Instead of A and B building C directly, A and B download the > substitutable Guix package D, then use D to build C. Because D is a > reproducible package, it should be substitutable from both A and B. > Then, because D->C is the same for e

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-13 Thread Richard Sent
Simon Tournier writes: > Hi, > > On lun., 13 mai 2024 at 17:04, Edouard Klein wrote: > >> - Why is this step not substitutable ? The inputs are known, a hash can >> be derived, a substitute server could be queried for an output of that >> hash ? What am I missing ? Does the guix derivation not e

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-13 Thread Simon Tournier
Hi, On lun., 13 mai 2024 at 17:04, Edouard Klein wrote: > - Why is this step not substitutable ? The inputs are known, a hash can > be derived, a substitute server could be queried for an output of that > hash ? What am I missing ? Does the guix derivation not end up in the > store ? What makes

Re: Guix pull: avoiding "Computing Guix derivation"

2024-05-13 Thread Ryan Sundberg
Hi Edouard, I have couple of ideas for you, which may help with your deployment process: 1) if possible, mount /gnu on a btrfs filesystem with zstd compression enabled. This will let you fill up at least 3x of your physical disk space because the store compresses very well. 2) for production s

Guix pull: avoiding "Computing Guix derivation"

2024-05-13 Thread Edouard Klein
Hi Guix, First, I'd like to apologize for not having taken the time to answer those who helped me on a previous guix performance issue (with containers), the reason is tied to the topic of this email: the store has eaten all the space of my server, and solving that takes precedence over everything