Re: [slurm-users] Tracking efficiency of all jobs on the cluster (dashboard etc.)

Hello John, I also am keen to follow your progress, as this is something we would find extremely useful as well. Regards, Jason On Fri, Sep 8, 2023 at 4:47 AM John Snowdon wrote: > I've been needing to do this as part of some analysis work we are > undertaking to determine requirements for a r

Re: [slurm-users] Tracking efficiency of all jobs on the cluster (dashboard etc.)

John, I'm interested to see where this goes. Good luck. Daryl On 9/8/23, 1:48 AM, "slurm-users on behalf of John Snowdon" mailto:slurm-users-boun...@lists.schedmd.com> on behalf of john.snow...@newcastle.ac.uk > wrote: I've been needing to do this as pa

Re: [slurm-users] Tracking efficiency of all jobs on the cluster (dashboard etc.)

I've been needing to do this as part of some analysis work we are undertaking to determine requirements for a replacement system. We don't have anything structured in place currently to analyse Slurm data; lots of Grafana system-level metrics but nothing to look at trends of useful metrics like

Re: [slurm-users] Tracking efficiency of all jobs on the cluster (dashboard etc.)

Hi Will, Will Furnell - STFC UKRI writes: > That does sound like an interesting solution – yes please would you be > able to send me (or us if you’re willing to share it to the list) > through some more information please? > > And thank you everyone else that has replied to my email – there’s >

Re: [slurm-users] Tracking efficiency of all jobs on the cluster (dashboard etc.)

Hi Magnus, That does sound like an interesting solution - yes please would you be able to send me (or us if you're willing to share it to the list) through some more information please? And thank you everyone else that has replied to my email - there's definitely a few solutions I need to look

Re: [slurm-users] Tracking efficiency of all jobs on the cluster (dashboard etc.)

Hi Will, I don't, currently, although it's on my list. However, we had a presentation on a recent Oxford HPC-SIG meeting from a colleague, who implemented a simple job profiler that saves a lot of job data (including efficiency) & creates plots of the efficiency of the job run (in a nutshell)

Re: [slurm-users] Tracking efficiency of all jobs on the cluster (dashboard etc.)

y sending an email to Umeå University, the University will need to > > process your personal data. For more information, please read > www.umu.se/en/gdpr > > *Från:* slurm-users *För *Will > Furnell - STFC UKRI > *Skickat:* Monday, 24 July 2023 16:38 > *Till:* slurm-us...@schedmd

Re: [slurm-users] Tracking efficiency of all jobs on the cluster (dashboard etc.)

need to process your personal data. For more information, please read www.umu.se/en/gdpr<http://www.umu.se/en/gdpr> Från: slurm-users För Will Furnell - STFC UKRI Skickat: Monday, 24 July 2023 16:38 Till: slurm-us...@schedmd.com Ämne: [slurm-users] Tracking efficiency of all jobs on the c

Re: [slurm-users] Tracking efficiency of all jobs on the cluster (dashboard etc.)

I use seff all the time as a first order approximation. It's a good hint at what's going on with a job but doesn't give much detail. We are in the process of integrating the Supremm node utilization capture tool with our clusters and with our local XDMOD installation. Plain old XDMOD can ingest th

[slurm-users] Tracking efficiency of all jobs on the cluster (dashboard etc.)

Hello, I am aware of 'seff', which allows you to check the efficiency of a single job, which is good for users, but as a cluster administrator I would like to be able to track the efficiency of all jobs from all users on the cluster, so I am able to 're-educate' users that may be running jobs t