Re: Questions about slot sharing

2016-07-14 Thread Vincent Wang
Got it, thank you, Robert. 2016-07-14 20:55 GMT+08:00 Robert Metzger : > Hi Huafeng, > > yes, the mapper and reducer are running in different threads on the > TaskManager. Slot sharing is an abstract concept of the scheduler. > > Flink also supports thread-sharing, for example when you have a ser

Re: Questions about slot sharing

2016-07-14 Thread Robert Metzger
Hi Huafeng, yes, the mapper and reducer are running in different threads on the TaskManager. Slot sharing is an abstract concept of the scheduler. Flink also supports thread-sharing, for example when you have a series of mappers (or filters) running with the same parallelism. We call this feature

Questions about slot sharing

2016-07-14 Thread Vincent Wang
Hi all, I'm totally new to Flink and I got a question about Flink's slot sharing feature. Suppose I have a pipeline like *Mapper-> Reducer, *and of cause the operators are* not *chained to a single task. When the job is actually scheduled to the Flink cluster, there is a Mapper task and a Re