RE: When is the StreamPartitioner selectChannel() method called

2017-01-25 Thread Katsipoulakis, Nikolaos Romanos
10:33 AM To: user@flink.apache.org Subject: RE: When is the StreamPartitioner selectChannel() method called Hello Ufuk, First, thank you very much for your quick reply and for clarifying the difference between channels and slots. Turning to debugging and visiting the breakpoint inside the HashPartitioner, I

RE: When is the StreamPartitioner selectChannel() method called

2017-01-25 Thread Katsipoulakis, Nikolaos Romanos
t: Re: When is the StreamPartitioner selectChannel() method called Hey Nikos, slots are only relevant for scheduling tasks. The number of outgoing channels depends on the number of parallel subtasks that consume a produced intermediate result stream, say the result of a source operator. If you have

Re: When is the StreamPartitioner selectChannel() method called

2017-01-25 Thread Ufuk Celebi
Hey Nikos, slots are only relevant for scheduling tasks. The number of outgoing channels depends on the number of parallel subtasks that consume a produced intermediate result stream, say the result of a source operator. If you have a job with a simple source->keyBy->map flow with parallelism X yo