Hello, I made some tests on a simple environment and it seems that this functionality is working fine until *15.08.13 (included).* With versions *16.05.6*, *16.05.9*, and *17.02.0-0rc1* I'm not able to see what I would expect to see.
# scontrol show part PartitionName=short AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL AllocNodes=ALL Default=YES QoS=N/A DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=1 LLN=NO MaxCPUsPerNode=UNLIMITED Nodes=dhcpvm4-191 PriorityJobFactor=1 PriorityTier=1 RootOnly=NO ReqResv=NO OverSubscribe=NO OverTimeLimit=NONE PreemptMode=OFF State=UP TotalCPUs=8 TotalNodes=1 SelectTypeParameters=NONE DefMemPerCPU=200 *MaxMemPerCPU=200* # srun --mem 600 sleep 5 && scontrol show job JobId=25 JobName=sleep UserId=root(0) GroupId=root(0) MCS_label=N/A Priority=4294901754 Nice=0 Account=(null) QOS=(null) JobState=COMPLETED Reason=None Dependency=(null) Requeue=1 Restarts=0 BatchFlag=0 Reboot=0 ExitCode=0:0 RunTime=00:00:05 TimeLimit=UNLIMITED TimeMin=N/A SubmitTime=2017-02-14T15:38:41 EligibleTime=2017-02-14T15:38:41 StartTime=2017-02-14T15:38:41 EndTime=2017-02-14T15:38:46 Deadline=N/A PreemptTime=None SuspendTime=None SecsPreSuspend=0 Partition=short AllocNode:Sid=dhcpvm4-174:5130 ReqNodeList=(null) ExcNodeList=(null) NodeList=dhcpvm4-191 BatchHost=dhcpvm4-191 NumNodes=1 *NumCPUs=1* NumTasks=0 CPUs/Task=1 ReqB:S:C:T=0:0:*:* TRES=cpu=1,*mem=600M*,node=1 Socks/Node=* NtasksPerN:B:S:C=0:0:*:* CoreSpec=* MinCPUsNode=1 MinMemoryNode=600M MinTmpDiskNode=0 Features=(null) DelayBoot=00:00:00 Gres=(null) Reservation=(null) OverSubscribe=OK Contiguous=0 Licenses=(null) Network=(null) Command=sleep WorkDir=/root Power= It doesn't help me a lot with my problem but ... Best regards, Julien 2017-02-02 8:53 GMT+01:00 Julien Collas <[email protected]>: > Hi, > > It seems that my *MaxMemPerCpu *is not working as I would have expected > (increase cpu if mem or mem-per-cpu exceed that limit) > > Here is my partition definition > > $ scontrol show part short > PartitionName=short > AllowGroups=ALL DenyAccounts=data AllowQos=ALL > AllocNodes=ALL Default=YES QoS=N/A > DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 > Hidden=NO > MaxNodes=UNLIMITED MaxTime=00:30:00 MinNodes=1 LLN=NO > MaxCPUsPerNode=UNLIMITED > Nodes=srv0029[73-80,87-95,98-99] > PriorityJobFactor=1000 PriorityTier=1000 RootOnly=NO ReqResv=NO > OverSubscribe=NO PreemptMode=OFF > State=UP TotalCPUs=560 TotalNodes=28 SelectTypeParameters=NONE > DefMemPerCPU=19000 MaxMemPerCPU=19000 > > > $ srun --partition=short --mem=40000 sleep 10 > $ srun --partition=short --mem-per-cpu=40000 sleep 10 > $ sacct > JobID User Account JobName Priority NTasks > AllocCPUS ReqCPUS MaxRSS MaxVMSize ReqMem State > ------------ --------- ---------- ---------- ---------- -------- > ---------- -------- ---------- ---------- ---------- ---------- > 19522383 jcollas admin sleep 994 1 > 1 1 92K 203980K 40000Mn COMPLETED > 19522384 jcollas admin sleep 994 1 > 1 1 92K 203980K 40000Mc COMPLETED > > For theses 2 jobs, I would have expected *AllocCPUS *to 3. > > $ scontrol show conf > ... > DefMemPerNode = UNLIMITED > MaxMemPerNode = UNLIMITED > MemLimitEnforce = Yes > SelectTypeParameters = CR_CPU_MEMORY > ... > AccountingStorageBackupHost = (null) > AccountingStorageEnforce = associations,limits > AccountingStorageHost = stor089 > AccountingStorageLoc = N/A > AccountingStoragePort = 6819 > AccountingStorageTRES = cpu,mem,energy,node > AccountingStorageType = accounting_storage/slurmdbd > AccountingStorageUser = N/A > AccountingStoreJobComment = Yes > AcctGatherEnergyType = acct_gather_energy/none > AcctGatherFilesystemType = acct_gather_filesystem/none > AcctGatherInfinibandType = acct_gather_infiniband/none > AcctGatherNodeFreq = 0 sec > AcctGatherProfileType = acct_gather_profile/none > JobAcctGatherFrequency = 10 > JobAcctGatherType = jobacct_gather/cgroup > JobAcctGatherParams = (null) > ... > > We are currently running with version 16.05.6 > > Is there something I am missing ? > > Regards, > > Julien >
