OK Michael!

I will look into it and will come back at you! Thanks for the help. I agree 
that it is quite suspicious the par = 8

Jps? Meaning?

Oh I should mention that the JobManager node is also a TaskManager.

Best,
Max

> On 27 Apr 2018, at 01:39, TechnoMage <mla...@technomage.com> wrote:
> 
> Check that you have slaves and masters set correctly on all machines, and in 
> particular the one submitting jobs.  Make sure that from the machine 
> submitting the job that it is talking to the correct job manager 
> (jobmanager.rpc.address).  It really sounds like you are some how submitting 
> jobs to only one taskmanager.
> 
> You should also use jps to verify that you only have one jobmanager running 
> and the worker machines only have taskmanager running.
> 
> Michael
> 
>> On Apr 26, 2018, at 11:34 AM, Makis Pap <makisnt...@gmail.com 
>> <mailto:makisnt...@gmail.com>> wrote:
>> 
>> So what should the correct configs be then?
>> 
>> I have set numOfSlotsPerTaskManager = 8. Which is reasonable as each has 8 
>> cpus.
>> 
>> Best,
>> Makis
>> 
>> On Fri, 27 Apr 2018, 01:26 TechnoMage, <mla...@technomage.com 
>> <mailto:mla...@technomage.com>> wrote:
>> You need to verify your configs are correct.  Check that the local machine 
>> sees all the task managers, that is the most likely reason it will reject a 
>> higher parallelism.  I use a java program to submit to a 3 node 18 slot 
>> cluster without issue on a job with 18 parallelism.  I have not used the 
>> command line to do this however.
>> 
>> Michael
>> 
>> > On Apr 26, 2018, at 11:16 AM, m@xi <makisnt...@gmail.com 
>> > <mailto:makisnt...@gmail.com>> wrote:
>> > 
>> > No man. I have 17 TaskManagers and each has a number of 8 slots.
>> > 
>> > Do you think it is better to have 8 TaskManager (1 slot each) ?
>> > 
>> > Best,
>> > Max
>> > 
>> > 
>> > 
>> > --
>> > Sent from: 
>> > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ 
>> > <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/>
>> 
> 

Reply via email to