Re: [slurm-users] Managing Multiple Dependencies

2021-03-02 Thread Jan van der Laan
Snakemake is a tool to manage job dependencies. I don't have experience using this in a slurm context, but I have used Snakemake to manage complex depencies in workflows in other contexts. Snakemake should support slurm. HTH, Jan On 02-03-2021 20:16, Jason Simms wrote: Hello all, I am r

Re: [slurm-users] Managing Multiple Dependencies

2021-03-02 Thread Renfro, Michael
There may be prettier ways, but this gets the job done. Captures the output from each sbatch command to get a job ID, colon separates the ones in the second group, and removes the trailing colon before submitting the last job: #!/bin/bash JOB1=$(sbatch job1.sh | awk '{print $NF}') echo "Submitt

[slurm-users] Managing Multiple Dependencies

2021-03-02 Thread Jason Simms
Hello all, I am relatively new to the nuances of handling complex dependencies in Slurm, so I'm hoping the hive mind can help. I have a user wanting to accomplish the following: - submit one job - submit multiple jobs that are dependent on the output from the first job (so they just need