[OMPI users] Docker Cluster Queue Manager

We would like to use MPI on Docker with arbitrarily configured clusters (e.g. created with StarCluster or bare metal). What I'm curious about is if there is a queue manager that understands Docker, file systems, MPI, and OpenAuth. JupyterHub does a lot of this, but it doesn't interface with MPI. Id

Re: [OMPI users] Docker Cluster Queue Manager

Thanks, Ralph. I'm not sure I explained the problem clearly. Salt and JupyterHub are distractions, sorry. I have code which "wires up" a cluster for MPI. What I need is scheduler that allows users to: * Select which Docker image they'd like to wire up * Request a number of nodes/cores * Understan

Re: [OMPI users] Docker Cluster Queue Manager

Hi John, Thanks for your thoughts. Lots of new technology out there! have you looked at Singularity > https://github.com/gmkurtzer/singularity/releases/tag/2.0 > Looks very cool, but it doesn't address our problem. We already have the images built with our codes. Our users don't have Unix user i

Re: [OMPI users] Docker Cluster Queue Manager

Hi John, > What is the use case here - are you just wanting the codes to execute with one given Unix ID? Are you familiar with wakari.io? That's an example of what we want to do, but with the ability to start jobs. Rescale.com is another example of a web-based job submission mechanism. JupyterHu

Re: [OMPI users] Docker Cluster Queue Manager

Hi Daniel, Thanks. Shifter is also interesting. However, it assumes our users map to a Unix user id, and therefore the access to the shared file system can be controlled by normal Unix permissions. That's not scalable, and makes for quite a bit of complexity. Each node must know about each user s

Re: [OMPI users] Docker Cluster Queue Manager

Thanks! SLURM Elastic Computing seems like it might do the trick. I need to try it out. xCAT is interesting, too. It seems to be the HPC version of Salt'ed Cobbler. :) I don't know that it's so important for our problem. We have a small cluster for testing against the cloud, primarily. I could se

Re: [OMPI users] Docker Cluster Queue Manager

Thanks, John. I sometimes wonder if I'm the only one out there with this particular problem. Ralph, thanks for sticking with me. :) Using a pool of uids doesn't really work due to the way cgroups/containers works. It also would require changing the permissions of all of the user's files, which wou

Re: [OMPI users] Docker Cluster Queue Manager

Ralph, > FWIW: I haven’t seen it before. > Good to know. > > Not sure I understand the issue, but I have no knowledge of Jupyter or why > you are using it. From what I can see, it appears that your choice of tools > may be complicating your solution - I’d suggest perhaps focusing on solving > t

Re: [OMPI users] Docker Cluster Queue Manager

Good morning, Dave, Amongst reasons for not running Docker, a major one that I didn't notice > raised is that containers are not started by the resource manager, but > by a privileged daemon, so the resource manager can't directly control > or monitor them. > There's an endless debate