Re: [slurm-users] Feature request: create a job id before job submission

2019-05-07 Thread Mark Hahn
puzzled two ways: why not use the numeric jobid, I don't know the job id before the actual job submission. Hence I would like to get some kind of place holder, and `scommit` the job later with the actual resource requirements as comments in an usual jobscript. OK, in that case, you can make

Re: [slurm-users] Feature request: create a job id before job submission

2019-05-07 Thread Reuti
> Am 07.05.2019 um 16:00 schrieb Mark Hahn : > >> Some cluster sites need the creation of a workspace for the job in a >> scratch area before the actual job submission, and on the other hand they >> don't accept all characters as name of the workspace. Hence the plain job >> name often can't be

[slurm-users] Slurm database error messages (redux)

2019-05-07 Thread Will Dennis
Hi all, We had to restart the slurmdbd service on one of our clusters running Slurm 17.11.7 yesterday, since folks were experiencing errors with job scheduling, and running 'sacct': - $ sacct -X -p -o jobid,jobname,user,partition%-30,nodelist,alloccpus,reqmem,cputime,qos,state,exitcode,All

Re: [slurm-users] Slurm resource limits on jobs

2019-05-07 Thread Sajesh Singh
Barbara, Thank you for info. Will add to config. -- SS From: slurm-users On Behalf Of Barbara Krašovec Sent: Tuesday, May 7, 2019 8:53 AM To: slurm-users@lists.schedmd.com Subject: Re: [slurm-users] Slurm resource limits on jobs Resources are limited with cgroups in SLURM. Check the document

Re: [slurm-users] Feature request: create a job id before job submission

2019-05-07 Thread Michael Di Domenico
On Tue, May 7, 2019 at 10:03 AM Mark Hahn wrote: > > > Some cluster sites need the creation of a workspace for the job in a > >scratch area before the actual job submission, and on the other hand they > >don't accept all characters as name of the workspace. Hence the plain job > >name often can't

Re: [slurm-users] Feature request: create a job id before job submission

2019-05-07 Thread Mark Hahn
Some cluster sites need the creation of a workspace for the job in a scratch area before the actual job submission, and on the other hand they don't accept all characters as name of the workspace. Hence the plain job name often can't be used here. puzzled two ways: why not use the numeric jobid,

Re: [slurm-users] Slurm resource limits on jobs

2019-05-07 Thread Barbara Krašovec
Resources are limited with cgroups in SLURM. Check the documentation: https://slurm.schedmd.com/cgroups.html You simply specify ProctrackType=proctrack/cgroup or/and TaskPlugin=task/cgroup in slurm.conf and then configure which resources are limited and how much in the cgroup.conf: https://slurm

Re: [slurm-users] Slurm database failure messages

2019-05-07 Thread Pawel R. Dziekonski
On 07/05/2019 13.47, David Baker wrote: > We are experiencing quite a number of database failures. > [root@blue51 slurm]#*less slurmdbd.log-20190506.gz | grep failed* > [2019-05-05T04:00:05.603] error: mysql_query failed: 1213 Deadlock found when > trying to get lock; try restarting transaction

[slurm-users] Slurm database failure messages

2019-05-07 Thread David Baker
Hello, We are experiencing quite a number of database failures. We saw an outright failure a short while ago where we had to restart the maria database and the slurmdbd process. After restarting the database appear to be working well, however over the last few days I have notice quite a number

[slurm-users] Feature request: create a job id before job submission

2019-05-07 Thread Reuti
Hi, Some cluster sites need the creation of a workspace for the job in a scratch area before the actual job submission, and on the other hand they don't accept all characters as name of the workspace. Hence the plain job name often can't be used here. sblank (with possible array size give) wil