Re: Parallelism and Partitioning

2017-02-06 Thread Ufuk Celebi
On Fri, Feb 3, 2017 at 2:09 AM, Mohit Anchlia wrote: > What is the granularity of parallelism in flink? For eg: if I am reading > from Kafka -> map -> Sink and I say parallel 2 does it mean it creates 2 > consumer threads and allocates it on 2 separate task managers? Yes, this will instantiate tw

Re: Parallelism and Partitioning

2017-02-03 Thread Mohit Anchlia
t on 2 separate task managers? > > Also, it would be good to understand the difference between parallelism > and partitioning that also could be distributed across task managers. >

Parallelism and Partitioning

2017-02-02 Thread Mohit Anchlia
What is the granularity of parallelism in flink? For eg: if I am reading from Kafka -> map -> Sink and I say parallel 2 does it mean it creates 2 consumer threads and allocates it on 2 separate task managers? Also, it would be good to understand the difference between parallelism and partit