[slurm-users] free resources

2021-08-25 Thread Pankaj Dorlikar
Hi, We are using slurm-20.11..7 on ubuntu system having GPUs. What is the equivalent of "showbf -S" in maui or any command in slurm for checking the free resources ? Regards, pvd

Re: [slurm-users] EXTERNAL-Re: [External] scancel gpu jobs when gpu is not requested

2021-08-25 Thread Ratnasamy, Fritz
Hi Michael, Thanks for your message. Yes I was able to get all interactive sessions killed quickly when trying other partitions and deactivating the prolog. I read your example and I understand how it could possibly work (in the ex., maybe instead of looking if the gpu model is passed, we could loo

Re: [slurm-users] [External] scancel gpu jobs when gpu is not requested

2021-08-25 Thread Michael Robbert
I doubt that it is a problem with your script and suspect that there is some weird interaction with scancel on interactive jobs. If you wanted to get to the bottom of that Iā€™d suggest disabling the prolog and test by manually cancelling some interactive jobs. Another suggestion is to try a compl

Re: [slurm-users] sacct output in tabular form

2021-08-25 Thread Killian Murphy
sacct --parsable2 | column -s '|' -t | less -S has always been useful to me for a glance at it. On Wed, 25 Aug 2021 at 13:41, Jeffrey T Frey wrote: > You've confirmed my suspicion ā€” no one seems to care for Slurm's standard > output formats :-) At UD we did a Python curses wrapper around the >

Re: [slurm-users] sacct output in tabular form

2021-08-25 Thread Jeffrey T Frey
You've confirmed my suspicion ā€” no one seems to care for Slurm's standard output formats :-) At UD we did a Python curses wrapper around the parseable output to turn the terminal window into a navigable spreadsheet of output: https://gitlab.com/udel-itrci/slurm-output-wrappers > On Aug 25,

Re: [slurm-users] Slurm does not start after (stupid) upgrade from 16.05.9 to 20.11.7

2021-08-25 Thread Julien Tailleur
Dear Ole, thanks for your answer and your useful links. I finally managed to change the root password of mariadb and successfully ran mariadb-upgrade I could then restart everything and the cluster seems to be running again (!) I will run more checks and will also ask questions on the debi

Re: [slurm-users] Slurm does not start after (stupid) upgrade from 16.05.9 to 20.11.7

2021-08-25 Thread Ole Holm Nielsen
On 8/25/21 10:48 AM, Julien Tailleur wrote: We have been running a computing cluster using slurm since 2016, that I installed back then, with some help from others. I was pretty late on upgrades and decided to upgrade the cluster up to debian Bullseye, which runs slurm 20.11.7, starting from st

[slurm-users] Slurm does not start after (stupid) upgrade from 16.05.9 to 20.11.7

2021-08-25 Thread Julien Tailleur
Dear all, We have been running a computing cluster using slurm since 2016, that I installed back then, with some help from others. I was pretty late on upgrades and decided to upgrade the cluster up to debian Bullseye, which runs slurm 20.11.7, starting from stretch, that runs slurm 16.05.9.

Re: [slurm-users] sacct output in tabular form

2021-08-25 Thread Ole Holm Nielsen
Hi Sven, On 8/25/21 7:41 AM, Sternberger, Sven wrote: this is a simple wrapper for sacct which prints the output from sacct as table. So you can make a "sacctml -j foo --long" even without two 8k displays ;-) This script works nicely, thanks! However, in stead of an extremely wide display on