Re: [slurm-users] speed / efficiency of sacct vs. scontrol

2023-02-24 Thread Sean Maxwell
Hi David, Those queries then should not have to happen too often, although do you > have any indication of a range for when you say "you still wouldn't > want to query the status too frequently." Because I don't really, and > would probably opt for some compromise of every 30 seconds or so. > Eve

Re: [slurm-users] speed / efficiency of sacct vs. scontrol

2023-02-24 Thread David Laehnemann
Hi Sean, Thanks again for all the feedback! I'll definitely try to implement batch queries, then. Both for the default `sacct` query and for the fallback `scontrol` query. Also see here: https://github.com/snakemake/snakemake/pull/2136#issuecomment-1443295051 Those queries then should not have t

Re: [slurm-users] snakemake and slurm in general

2023-02-24 Thread David Laehnemann
Hi Loris, thanks for all the extra infos and the pointer to the nextflow issue. That's exactly the conversations that need to happen, to make these systems work for everybody. From the perspective of the users who need to manage huge analyses with incredibly complicated job dependencies. And from

Re: [slurm-users] snakemake and slurm in general - correction

2023-02-24 Thread Loris Bennett
Loris Bennett writes: > Hi David, > > (Thanks for changing the subject to something more appropriate). > > David Laehnemann writes: > >> Yes, but only to an extent. The linked conversation ends with this: >> Do you have any best practice about setting MaxJobCount to a proper >> number? >> >