Re: Not enough free slots to run the job

2017-10-27 Thread Fabian Hueske
Hi David, that's correct. A TM is a single process. A slot is just a virtual concept in the TM process and runs its program slice in multiple threads. Besides managed memory (which is split into chunks add assigned to slots) all other resources (CPU, heap, network, disk) are not isolated and free

Re: Not enough free slots to run the job

2017-10-26 Thread David Dreyfus
Hello, I know this is an older thread, but ... If some slots are left empty it doesn't necessarily mean that machine resources are wasted. Some managed memory might be unavailable, but CPU, heap memory, network, and disk are shared across slots. To the extent there are multiple operators executin

Re: Not enough free slots to run the job

2016-03-21 Thread Ovidiu-Cristian MARCU
>> On Fri, Mar 18, 2016 at 1:30 PM, Ovidiu-Cristian MARCU >> mailto:ovidiu-cristian.ma...@inria.fr>> >> wrote: >> Hi, >> >> For the situation where a program specify a maximum parallelism (so it is >> supposed to use all available task slots) we can

Re: Not enough free slots to run the job

2016-03-21 Thread Robert Metzger
, 2016 at 1:30 PM, Ovidiu-Cristian MARCU < > ovidiu-cristian.ma...@inria.fr> wrote: > >> Hi, >> >> For the situation where a program specify a maximum parallelism (so it is >> supposed to use all available task slots) we can have the possibility that >> one of

Re: Not enough free slots to run the job

2016-03-21 Thread Ovidiu-Cristian MARCU
here a program specify a maximum parallelism (so it is > supposed to use all available task slots) we can have the possibility that > one of the task managers is not registered for various reasons. > In this case the job will fail for not enough free slots to run the job. > > For me

Re: Not enough free slots to run the job

2016-03-21 Thread Robert Metzger
stered for various reasons. > In this case the job will fail for not enough free slots to run the job. > > For me this means the scheduler has a limitation to work by statically > assign tasks to the task slots the job is configured. > > Instead I would like to be able to specify a

Not enough free slots to run the job

2016-03-18 Thread Ovidiu-Cristian MARCU
Hi, For the situation where a program specify a maximum parallelism (so it is supposed to use all available task slots) we can have the possibility that one of the task managers is not registered for various reasons. In this case the job will fail for not enough free slots to run the job. For