I'm announcing an initial version 0.1 of the node status tool "pestat"
for Slurm.
For Torque clusters I wrote the tool "pestat" (available in
ftp://ftp.fysik.dtu.dk/pub/Torque/) and we use it all the time, so I
think there's a need for this kind of tool for Slurm as well. Slurm
commands don't offer such information directly, and you need to combine
the output of several Slurm commands.
The output from pestat currently looks like:
Hostname Partition Node Num_CPU CPUload Memsize Joblist
State Use/Tot (MB) JobId User ...
a001 xeon8* alloc 8 8 8.01 23900 48451 user1
a002 xeon8* alloc 8 8 8.05 23900 45937 user2
a003 xeon8* alloc 8 8 8.01 23900 47784 user3
...
You can also do "pestat -p partition" to select partitions.
Download the tool (a short bash script) from
ftp://ftp.fysik.dtu.dk/pub/Slurm/pestat
This tool needs to expand Slurm hostlists like a[095,097-098] into
a095,a097,a098, so I found the nice tool
https://www.nsc.liu.se/~kent/python-hostlist/ by Kent Engström at NSC.
It's simple to install this as an RPM package, see
https://wiki.fysik.dtu.dk/niflheim/SLURM#expanding-host-lists
I'll be expanding the functionality of pestat over time, so please send
me comments and bug reports.
My ToDo list would include:
1. Report current node memory usage of jobs.
2. Flag jobs that abuse or under-utilize resources.
--
Ole Holm Nielsen
Department of Physics, Technical University of Denmark
