Re: Slurm with containers (i.e., orchestration)

2020-05-19 Thread Begley Brothers Inc
P.S Just to keep things interesting - GWL: A workflow management language extension for GNU Guix The Guix Workflow Language (GWL) provides a scientific computing extension to GNU Guix's declarative language for package management for the declaration of scientific workflows. https://www.guixwl.org

Re: Slurm with containers (i.e., orchestration)

2020-05-19 Thread Begley Brothers Inc
On Mon, May 18, 2020 at 7:50 AM Pjotr Prins wrote: > > I am looking into some light-weight style orchestration. One We think there is such a niche, the 80/20 rule. We think containers are too limiting and a bad idea to target - but we use them and they have mind share. We also have some other ide

Re: Slurm with containers (i.e., orchestration)

2020-05-18 Thread Pjotr Prins
Ricardo added slurm-drmaa in the past (I can't believe it almost 4 years ago we packaged slurm!) which may also help in addressing some points http://www.drmaa.org/ Pj. On Mon, May 18, 2020 at 07:49:00AM -0500, Pjotr Prins wrote: > I am looking into some light-weight style orchestration. One

Slurm with containers (i.e., orchestration)

2020-05-18 Thread Pjotr Prins
I am looking into some light-weight style orchestration. One possibility is to use Slurm with Guix containers - on a cluster with Guix that is almost trivial (we use Guix containers a lot! They are great) and would also allow non-container jobs. Once we have containers and Slurm it should also be