Re: [slurm-users] GPU utilization of running jobs

2022-10-20 Thread Markus Kötter
Hi, I've shared my take on this here: > https://forums.developer.nvidia.com/t/job-statistics-with-nvidia-data-center-gpu-manager-and-slurm/148768 It lacks graphing. MfG -- Markus Kötter, +49 681 870832434 30159 Hannover, Lange Laube 6 Helmholtz Center for Information Security smime.p7s Des

Re: [slurm-users] GPU utilization of running jobs

2022-10-19 Thread Relu Patrascu
Look up CUDA_​DEVICE_​ORDER and PCI_BUS_ID Sent from my iPhone > On Oct 19, 2022, at 04:33, Vecerka Daniel wrote: >

[slurm-users] GPU utilization of running jobs

2022-10-19 Thread Vecerka Daniel
Hi,  we want to push our users to run jobs with high GPU utilization. Because it's difficult for users to get GPU utilization of their jobs, I have decided to write script, which prints utilization of running jobs. The idea is simple:  1. get list of running jobs in GPU partitions  2. get ID