On 01/19/2017 09:38 AM, Frederik Himpe wrote: > > I want to limit the amount of CPUs a single user can use in one > partition, so I created a QOS named "batch" and set this as the default > QOS in slurm.conf for the (default) partition "batch". > > However when I submit a job to the default partition, the QOS batch is > not used so the user can use much more resources than allowed in the > QOS, for example: > > $ squeue -j 3995 -O partition,QOS > PARTITION QOS > batch normal > > What could be wrong? > To my (up to now not so extensive I must admit) exprience this is normal - jobs will only show the QOS they are given via the --qos flag. If they get submitted to a partition with a attaced partition QOS this will not show up.
I am running such a setup - it definitely works with slurm 16.05.5 and 'MaxJobsPerUser' Things to note are: -jobs not listing the partion QOS as noted above -there is a significant time delay beween adding limits to a QOS in accounting and slurmctld picking it up and enforcing it -I think (not certain) one has to set the parameter 'AccountingStorageEnforce=limits,qos' in slurm.conf for this to be active. Otherwise its simply ignored. regards, hn > > # scontrol show partition batch > PartitionName=batch > AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL > AllocNodes=ALL Default=YES QoS=batch > DefaultTime=NONE DisableRootJobs=YES ExclusiveUser=NO GraceTime=0 Hidden=NO > MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=1 LLN=YES > MaxCPUsPerNode=UNLIMITED > Nodes=node[001-012] > PriorityJobFactor=3 PriorityTier=3 RootOnly=NO ReqResv=NO > OverSubscribe=FORCE:1 PreemptMode=GANG,SUSPEND > State=UP TotalCPUs=168 TotalNodes=12 SelectTypeParameters=NONE > DefMemPerNode=UNLIMITED MaxMemPerNode=UNLIMITED > > # sacctmgr list qos batch > Name Priority GraceTime Preempt PreemptMode > Flags UsageThres UsageFactor GrpTRES GrpTRESMins > GrpTRESRunMin GrpJobs GrpSubmit GrpWall MaxTRES MaxTRESPerNode > MaxTRESMins MaxWall MaxTRESPU MaxJobsPU MaxSubmitPU MaxTRESPA > MaxJobsPA MaxSubmitPA MinTRES > ---------- ---------- ---------- ---------- ----------- > ---------------------------------------- ---------- ----------- ------------- > ------------- ------------- ------- --------- ----------- ------------- > -------------- ------------- ----------- ------------- --------- ----------- > ------------- --------- ----------- ------------- > batch 0 00:00:00 cluster > 1.000000 > > cpu=80 > > -- Dr. Holger Naundorf Christian-Albrechts-Universität zu Kiel Rechenzentrum / HPC / Server und Storage Tel: +49 431 880-1990 Fax: +49 431 880-1523 [email protected]
smime.p7s
Description: S/MIME Cryptographic Signature
