Re: [SGE-discuss] GPUs as a resource

2017-05-24 Thread Reuti
; Juan Jimenez >>> System Administrator, HPC >>> MDC Berlin / IT-Dept. >>> Tel.: +49 30 9406 2800 >>> >>> >>> >>> From: Reuti [re...@staff.uni-marburg.de] >>> Sent: Friday, May 19, 2017 17:0

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread Marco Donauer
Donauer [mdona...@univa.com] > Sent: Friday, May 19, 2017 17:49 > To: Jimenez, Juan Esteban; Reuti > Cc: SGE-discuss@liv.ac.uk > Subject: Re: [SGE-discuss] GPUs as a resource > > Hi Juan, > > what have you been told by Univa, > regarding GPUs? > > Regards > M

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread juanesteban.jime...@mdc-berlin.de
From: Marco Donauer [mdona...@univa.com] Sent: Friday, May 19, 2017 17:49 To: Jimenez, Juan Esteban; Reuti Cc: SGE-discuss@liv.ac.uk Subject: Re: [SGE-discuss] GPUs as a resource Hi Juan, what have you been told by Univa, regarding GPUs? Regards Marco Am 19. Mai 2017 17

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread Marco Donauer
-Dept. Tel.: +49 30 9406 2800 From: Reuti [re...@staff.uni-marburg.de] Sent: Friday, May 19, 2017 17:01 To: Jimenez, Juan Esteban Cc: William Hay; SGE-discuss@liv.ac.uk Subject: Re: [SGE-discuss] GPUs as a resource Am 19.05.2017 um 16:35 schrieb juanesteban.j

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread juanesteban.jime...@mdc-berlin.de
Esteban Cc: William Hay; SGE-discuss@liv.ac.uk Subject: Re: [SGE-discuss] GPUs as a resource > Am 19.05.2017 um 16:35 schrieb juanesteban.jime...@mdc-berlin.de: > >> You are being told by who or what? If it is a what then the exact message >> is helpful? > > By my colleagu

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread juanesteban.jime...@mdc-berlin.de
> It does indeed but not by a whole lot for a queue on a couple of nodes. > Since you want to reserve these nodes for GPU users then the extra queue is > needless. > I suggest: > 1.Make the GPU complex FORCED (so users who don't request a gpu can't end up > on a node with gpus). > 2.Define the

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread Reuti
> Am 19.05.2017 um 16:35 schrieb juanesteban.jime...@mdc-berlin.de: > >> You are being told by who or what? If it is a what then the exact message >> is helpful? > > By my colleagues who are running a 2nd cluster using Univa GridEngine. This > was a warning from Univa not to do it that way be

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread Reuti
rburg.de] > Sent: Friday, May 19, 2017 16:37 > To: Jimenez, Juan Esteban > Cc: Kamel Mazouzi; SGE-discuss@liv.ac.uk > Subject: Re: [SGE-discuss] GPUs as a resource > >> Am 19.05.2017 um 16:33 schrieb juanesteban.jime...@mdc-berlin.de: >> >> I put them in /opt/sge/defa

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread Reuti
Then a boolean complex which is set to FORCED can be used: $ qconf -mc … gpu gpuBOOL== FORCED NO 00 and attach it to the exechost's complex_values: $ qconf -me gpu-node … complex_values gpu=TRUE Users then have to request "-l gpu" (resp. th

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread juanesteban.jime...@mdc-berlin.de
...@staff.uni-marburg.de] Sent: Friday, May 19, 2017 16:37 To: Jimenez, Juan Esteban Cc: Kamel Mazouzi; SGE-discuss@liv.ac.uk Subject: Re: [SGE-discuss] GPUs as a resource > Am 19.05.2017 um 16:33 schrieb juanesteban.jime...@mdc-berlin.de: > > I put them in /opt/sge/default/common/sge-gpuprolog.

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread juanesteban.jime...@mdc-berlin.de
> As William mentions below: are these nodes exclusively reserved for dedicated > users, or should other users be able to use them, but not the GPU? One node, reserved for a user list. The problem is that those users run non-gpu jobs and some of the jobs get put into the gpu node even though the

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread juanesteban.jime...@mdc-berlin.de
> You are being told by who or what? If it is a what then the exact message is > helpful? By my colleagues who are running a 2nd cluster using Univa GridEngine. This was a warning from Univa not to do it that way because it increases qmaster workload Juan __

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread juanesteban.jime...@mdc-berlin.de
...@staff.uni-marburg.de] Sent: Friday, May 19, 2017 14:20 To: Jimenez, Juan Esteban Cc: Kamel Mazouzi; SGE-discuss@liv.ac.uk Subject: Re: [SGE-discuss] GPUs as a resource Hi, > Am 18.05.2017 um 14:15 schrieb juanesteban.jime...@mdc-berlin.de: > > I tried it according to the instructions, but it w

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread Reuti
Hi, > Am 18.05.2017 um 12:37 schrieb juanesteban.jime...@mdc-berlin.de: > > Ok, so I create a new queue, gpu.q, that only has that node, with the complex > value for the gpu. I removed the node from @allhosts so that the all.q and > interactive.q don’t use the node. I also modified the user lis

Re: [SGE-discuss] GPUs as a resource

2017-05-19 Thread Reuti
i > > Mfg, > Juan Jimenez > System Administrator, BIH HPC Cluster > MDC Berlin / IT-Dept. > Tel.: +49 30 9406 2800 > > > From: Kamel Mazouzi > Date: Thursday, 18. May 2017 at 13:07 > To: "Jimenez, Juan Esteban" > Cc: William Hay , "SGE-discuss@liv.ac.uk

Re: [SGE-discuss] GPUs as a resource

2017-05-18 Thread juanesteban.jime...@mdc-berlin.de
prolog and epilog or ?? Mfg, Juan Jimenez System Administrator, BIH HPC Cluster MDC Berlin / IT-Dept. Tel.: +49 30 9406 2800 From: Kamel Mazouzi Date: Thursday, 18. May 2017 at 13:07 To: "Jimenez, Juan Esteban" Cc: William Hay , "SGE-discuss@liv.ac.uk" Subject: Re: [SG

Re: [SGE-discuss] GPUs as a resource

2017-05-18 Thread Kamel Mazouzi
Hi, For GPU integration we are using a solution like this one: https://github.com/kyamagu/sge-gpuprolog Regards On Thu, May 18, 2017 at 12:37 PM, juanesteban.jime...@mdc-berlin.de < juanesteban.jime...@mdc-berlin.de> wrote: > Ok, so I create a new queue, gpu.q, that only has that node, with t

Re: [SGE-discuss] GPUs as a resource

2017-05-18 Thread juanesteban.jime...@mdc-berlin.de
Ok, so I create a new queue, gpu.q, that only has that node, with the complex value for the gpu. I removed the node from @allhosts so that the all.q and interactive.q don’t use the node. I also modified the user list so that only users authorized to use the GPU can use the node. But now I am to

Re: [SGE-discuss] GPUs as a resource

2017-05-16 Thread Reuti
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I wondered how you attached a complex to an ACL. Am 16.05.2017 um 22:19 schrieb juanesteban.jime...@mdc-berlin.de: > i don't know what that means. > > Get Outlook for Android > > > > > On Tue, May 16, 2017 at 10:10 PM +0200, "Reuti" > wrote: >

Re: [SGE-discuss] GPUs as a resource

2017-05-16 Thread juanesteban.jime...@mdc-berlin.de
i don't know what that means. Get Outlook for Android On Tue, May 16, 2017 at 10:10 PM +0200, "Reuti" mailto:re...@staff.uni-marburg.de>> wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 16.05.2017 um 22:07 schrieb juanesteban.jime...@mdc-berlin.de: > In our

Re: [SGE-discuss] GPUs as a resource

2017-05-16 Thread Reuti
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 16.05.2017 um 22:07 schrieb juanesteban.jime...@mdc-berlin.de: > In our cluster we have one node with two Nvidia GPUs. I have been trying to > figure out how to set them up as consumable resources tied to an ACL, but I > can't get SGE to handle

[SGE-discuss] GPUs as a resource

2017-05-16 Thread juanesteban.jime...@mdc-berlin.de
In our cluster we have one node with two Nvidia GPUs. I have been trying to figure out how to set them up as consumable resources tied to an ACL, but I can't get SGE to handle them correctly. It always says the resource is not available. Can someone walk me through the steps required to set thi