Hi, I have noticed our site relies on the default value SelectTypeParameters (e.g. not specified in slurm.conf) which should be same as:
SelectTypeParameters=CR_Core_Memory I have noticed some strange behaviour where the compute nodes do not seem to use memory cgroup e.g. in the log without the above specified in slurm.conf and assuming default value I see: [2023-11-10T10:47:52.087] [7307368.batch] debug: task/cgroup: init: core enforcement enabled [2023-11-10T10:47:52.088] [7307368.batch] debug: task/cgroup: init: device enforcement enabled And with the above option in slurm.conf I see: [2023-11-10T11:00:28.059] [7307370.extern] debug: task/cgroup: init: core enforcement enabled [2023-11-10T11:00:28.059] [7307370.extern] debug: task/cgroup: task_cgroup_memory_init: task/cgroup/memory: TotCfgRealMem:191000M allowed:100%(enforced), swap:0%(enforced), max:100%(191000M) max+swap:100%(382000M) min:30M kmem:100%(191000M permissive) min:30M [2023-11-10T11:00:28.059] [7307370.extern] debug: task/cgroup: init: memory enforcement enabled [2023-11-10T11:00:28.060] [7307370.extern] debug: task/cgroup: init: device enforcement enabled This relates to https://github.com/SchedMD/slurm/blob/master/src/plugins/task/cgroup/task_cgroup.c Specifically https://github.com/SchedMD/slurm/blob/d59bf870f660bed022f08aff073c9ae65119c37c/src/plugins/task/cgroup/task_cgroup.c#L78C2-L78C2 Whilst I can only see the default possibly set on slurmctld but not on slurmd: https://github.com/SchedMD/slurm/blob/d59bf870f660bed022f08aff073c9ae65119c37c/src/plugins/select/cons_tres/select_cons_tres.c#L288 Should the documentation be updated to require use of SelectTypeParameters or the code has better handling of defaulting this parameter? Specifying the option seemed to fix odd behaviour but wanted to report the observation and whether I have misunderstood how this parameter is defaulted and whether other options also may need special care with defaults. Tom -- Thomas Green Senior Programmer ARCCA, Redwood Building, King Edward VII Avenue, Cardiff, CF10 3NB Tel: +44 (0)29 208 79269 Fax: +44 (0)29 208 70734 Email: green...@cardiff.ac.uk<mailto:green...@cardiff.ac.uk> Web: http://www.cardiff.ac.uk/arcca Thomas Green Uwch Raglennydd ARCCA, Adeilad Redwood, King Edward VII Avenue, Caerdydd, CF10 3NB Ffôn: +44 (0)29 208 79269 Ffacs: +44 (0)29 208 70734 E-bost: green...@caerdydd.ac.uk<mailto:green...@caerdydd.ac.uk> Gwefan: http://www.caerdydd.ac.uk/arcca
