Should be set on your NodeName lines in slurm.conf. For a 256 GB node, I’ve got:
NodeName=node038 CoresPerSocket=14 RealMemory=254000 Sockets=2 ThreadsPerCore=1 so that users can’t reserve every bit of physical memory, leaving a small amount for OS operation. > On May 16, 2019, at 3:47 PM, Robert Kudyba <rkud...@fordham.edu> wrote: > > External Email Warning > This email originated from outside the university. Please use caution when > opening attachments, clicking links, or responding to requests. > The MEMORY limit here shows 1, which I believe is 1 MB? But the results of > the free command clearly shows we have more than that. Where is this > configured? > > sinfo -lNe > Thu May 16 16:41:23 2019 > NODELIST NODES PARTITION STATE CPUS S:C:T MEMORY TMP_DISK WEIGHT > AVAIL_FE REASON > node001 1 defq* idle 24 2:12:1 1 0 1 > (null) none > node002 1 defq* idle 24 2:12:1 1 0 1 > (null) none > node003 1 defq* idle 24 2:12:1 1 0 1 > (null) none > [rkudyba@ciscluster ~]$ squeue > JOBID PARTITION NAME USER ST TIME NODES > NODELIST(REASON) > > free -h > total used free shared buff/cache > available > Mem: 187G 7.8G 128G 992M 50G > 176G > Swap: 15G 3.3G 12G > [rkudyba@ciscluster ~]$ srun -N 3 free -h > total used free shared buff/cache > available > Mem: 187G 4.5G 147G 1.8G 35G > 179G > Swap: 11G 382M 11G > total used free shared buff/cache > available > Mem: 187G 4.5G 145G 1.6G 36G > 179G > Swap: 11G 658M 11G > total used free shared buff/cache > available > Mem: 187G 95G 78G
