Re: [slurm-users] Managing Multiple Dependencies

2021-03-03 Thread Jason Simms
Dear Mike and Jan, Thank you for your suggestions. Mike, your script was close to what I had in mind, though way more elegant. So I appreciate it! Also Jan, thank you for pointing out snakemake. Apparently people do use it with Slurm, so I'm looking into it. Probably overkill at this point for mo

Re: [slurm-users] Managing Multiple Dependencies

2021-03-02 Thread Jan van der Laan
Snakemake is a tool to manage job dependencies. I don't have experience using this in a slurm context, but I have used Snakemake to manage complex depencies in workflows in other contexts. Snakemake should support slurm. HTH, Jan On 02-03-2021 20:16, Jason Simms wrote: Hello all, I am r

Re: [slurm-users] Managing Multiple Dependencies

2021-03-02 Thread Renfro, Michael
B2N=$(echo ${JOB2N} | sed 's/:$//g') echo "Submitting last job" sbatch --dependency=afterok:$JOB2N joblast.sh From: slurm-users on behalf of Jason Simms Date: Tuesday, March 2, 2021 at 1:18 PM To: Slurm User Community List Subject: [slurm-users] Managing Multiple Dependenc

[slurm-users] Managing Multiple Dependencies

2021-03-02 Thread Jason Simms
Hello all, I am relatively new to the nuances of handling complex dependencies in Slurm, so I'm hoping the hive mind can help. I have a user wanting to accomplish the following: - submit one job - submit multiple jobs that are dependent on the output from the first job (so they just need