Re: Question about slot and yarn vcores

2018-11-08 Thread Dawid Wysakowicz
Hi, It is not as easy. To understand it well I would recommend going through the docs[1]. In short slots do not equal thread/core it is just an abstraction over a share of resources. For you setup: It is true there will be 3 jvms each will be assigned 2 vcores ( by default it is equal to slot per

Question about slot and yarn vcores

2018-11-02 Thread sohimankotia
Let's assume I have yarn cluster with 3 nodes, 3 vcores each nodes. So total available cores = 9 Now if I spin a flink job with taskmanager = 3 and no. of slots per task manager = 2 ,what will happen : 1. 3 Jvms will be initiated (for each task manager) 2. Each JVM will run 2 threads for tasks .