Re: [slurm-users] Slurm Job Error Output is Missing

2021-09-14 Thread Maria Semple
" >&2 echo "err 2" 1>&2 >&2 echo "err 3" echo "err 4" >>/dev/stderr echo "err 5" 1>>/dev/stderr echo "err 6" | tee -a /dev/stderr In the end it was on my side, but I thought I would still share in case someone e

[slurm-users] Slurm Job Error Output is Missing

2021-09-13 Thread Maria Semple
Hi all, I have some jobs which write error messages to stderr, and I've noticed that the stderr output is not being written to file. Here is a simple reproduction case: test.sh: #!/bin/bash echo "out" echo "err" >&2 echo "err 2" 1>&2 >&2 echo "err 3" echo "err 4" >/dev/stderr echo "err 5" 1>/dev

Re: [slurm-users] Job Step Output Delay

2021-02-10 Thread Maria Semple
; what I said above is the case. > > Cheers, > Aaron > > > On 9 February 2021 at 23:47 GMT, Maria Semple wrote: > > > Hello all, > > > > I've noticed an odd behaviour with job steps in some Slurm environments. > > When a script is launched directly as a j

Re: [slurm-users] Job Step Output Delay

2021-02-10 Thread Maria Semple
dding the -u flag (specifies unbuffered) to your srun > command? > > https://slurm.schedmd.com/srun.html#OPT_unbuffered > > Your description sounds like buffering, so this might help. > > Thanks, > > -Sean > > On Tue, Feb 9, 2021 at 6:49 PM Maria Semple wrote:

[slurm-users] Job Step Output Delay

2021-02-09 Thread Maria Semple
Hello all, I've noticed an odd behaviour with job steps in some Slurm environments. When a script is launched directly as a job, the output is written to file immediately. When the script is launched as a step in a job, output is written in ~30 second chunks. This doesn't happen in all Slurm envir

Re: [slurm-users] Job Step Resource Requests are Ignored

2020-05-06 Thread Maria Semple
te a job that contains this: > > preamble_id=`sbatch preamble.job` > main_id=`sbatch -d afterok:$preamble_id main.job` > sbatch -d afterany:$main_id postamble.job > > Best, > > D > > On Wed, May 6, 2020 at 2:19 PM Maria Semple wrote: > >> Hi Chris, >> >&g

Re: [slurm-users] Job Step Resource Requests are Ignored

2020-05-06 Thread Maria Semple
whole job would be rejected on the basis that too many CPUs were requested. Is that correct? On Tue, May 5, 2020, 11:13 PM Chris Samuel wrote: > On Tuesday, 5 May 2020 11:00:27 PM PDT Maria Semple wrote: > > > Is there no way to achieve what I want then? I'd like the first and l

Re: [slurm-users] Job Step Resource Requests are Ignored

2020-05-05 Thread Maria Semple
de note, do you know why it's not even possible to restrict the number of resources a single step uses (i.e. set less CPUs than are available to the full job)? Thanks, Maria On Tue, May 5, 2020 at 10:27 PM Chris Samuel wrote: > On Tuesday, 5 May 2020 4:47:12 PM PDT Maria Semple wrote

[slurm-users] Job Step Resource Requests are Ignored

2020-05-05 Thread Maria Semple
Hi! I'd like to set different resource limits for different steps of my job. A sample script might look like this (e.g. job.sh): #!/bin/bash srun --cpus-per-task=1 --mem=1 echo "Starting..." srun --cpus-per-task=4 --mem=250 --exclusive srun --cpus-per-task=1 --mem=1 echo "Finished." Then I woul