Hi,
It seems that my *MaxMemPerCpu *is not working as I would have expected
(increase cpu if mem or mem-per-cpu exceed that limit)
Here is my partition definition
$ scontrol show part short
PartitionName=short
AllowGroups=ALL DenyAccounts=data AllowQos=ALL
AllocNodes=ALL Default=YES QoS=N/A
DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0
Hidden=NO
MaxNodes=UNLIMITED MaxTime=00:30:00 MinNodes=1 LLN=NO
MaxCPUsPerNode=UNLIMITED
Nodes=srv0029[73-80,87-95,98-99]
PriorityJobFactor=1000 PriorityTier=1000 RootOnly=NO ReqResv=NO
OverSubscribe=NO PreemptMode=OFF
State=UP TotalCPUs=560 TotalNodes=28 SelectTypeParameters=NONE
DefMemPerCPU=19000 MaxMemPerCPU=19000
$ srun --partition=short --mem=40000 sleep 10
$ srun --partition=short --mem-per-cpu=40000 sleep 10
$ sacct
JobID User Account JobName Priority NTasks AllocCPUS
ReqCPUS MaxRSS MaxVMSize ReqMem State
------------ --------- ---------- ---------- ---------- -------- ----------
-------- ---------- ---------- ---------- ----------
19522383 jcollas admin sleep 994 1 1
1 92K 203980K 40000Mn COMPLETED
19522384 jcollas admin sleep 994 1 1
1 92K 203980K 40000Mc COMPLETED
For theses 2 jobs, I would have expected *AllocCPUS *to 3.
$ scontrol show conf
...
DefMemPerNode = UNLIMITED
MaxMemPerNode = UNLIMITED
MemLimitEnforce = Yes
SelectTypeParameters = CR_CPU_MEMORY
...
AccountingStorageBackupHost = (null)
AccountingStorageEnforce = associations,limits
AccountingStorageHost = stor089
AccountingStorageLoc = N/A
AccountingStoragePort = 6819
AccountingStorageTRES = cpu,mem,energy,node
AccountingStorageType = accounting_storage/slurmdbd
AccountingStorageUser = N/A
AccountingStoreJobComment = Yes
AcctGatherEnergyType = acct_gather_energy/none
AcctGatherFilesystemType = acct_gather_filesystem/none
AcctGatherInfinibandType = acct_gather_infiniband/none
AcctGatherNodeFreq = 0 sec
AcctGatherProfileType = acct_gather_profile/none
JobAcctGatherFrequency = 10
JobAcctGatherType = jobacct_gather/cgroup
JobAcctGatherParams = (null)
...
We are currently running with version 16.05.6
Is there something I am missing ?
Regards,
Julien
