Re: How to use all available task managers

2016-02-24 Thread Matthias J. Sax
Could it be, that you would need to edit client local flink-conf.yaml instead of the TaskManager config files? (In case, you do not want to specify parallelism via env.setParallelism(int);) -Matthias On 02/24/2016 04:19 PM, Saiph Kappa wrote: > Thanks! It worked now :-) > > On Wed, Feb 24, 2016

Re: How to use all available task managers

2016-02-24 Thread Saiph Kappa
Thanks! It worked now :-) On Wed, Feb 24, 2016 at 2:48 PM, Ufuk Celebi wrote: > You can use the environment to set it the job parallelism to 6 e.g. > env.setParallelism(6). > > Setting this will override the default behaviour. Maybe that's why the > default parallelism is not working... you migh

Re: How to use all available task managers

2016-02-24 Thread Ufuk Celebi
You can use the environment to set it the job parallelism to 6 e.g. env.setParallelism(6). Setting this will override the default behaviour. Maybe that's why the default parallelism is not working... you might have it set to 1 already? On Wed, Feb 24, 2016 at 3:41 PM, Saiph Kappa wrote: > I set

Re: How to use all available task managers

2016-02-24 Thread Saiph Kappa
I set "parallelism.default: 6" on flink-conf.yaml of all 6 machines, and still, my job only uses 1 task manager. Why? On Wed, Feb 24, 2016 at 8:31 AM, Till Rohrmann wrote: > Hi Saiph, > > I think the configuration value should be parallelism.default: 6. That > will execute jobs which have not pa

Re: How to use all available task managers

2016-02-24 Thread Till Rohrmann
Hi Saiph, I think the configuration value should be parallelism.default: 6. That will execute jobs which have not parallelism defined with a DOP of 6. Cheers, Till ​ On Wed, Feb 24, 2016 at 1:43 AM, Saiph Kappa wrote: > Hi, > > I am running a flink stream application on a cluster with 6 slave

How to use all available task managers

2016-02-23 Thread Saiph Kappa
Hi, I am running a flink stream application on a cluster with 6 slaves/task managers. I have set in flink-conf.yaml of every machine "parallelization.degree.default: 6". However, when I run my application it just uses one task slot and not all of them. Am I missing something? Thanks.