Re: Regarding source Parallelism and usage of coflatmap transformation

2016-05-09 Thread Biplob Biswas
Hi, Regarding 1) Thanks a lot for the ParallelSourceFunction, i completely missed that I was using a SourceFunction instead. Regarding 2) the example works and i can see what is happening there, now when i increase the parallelism i understand the corresponding change as to how the data is fed ba

Re: Regarding source Parallelism and usage of coflatmap transformation

2016-05-09 Thread Aljoscha Krettek
Hi, regarding 1) the source needs to implement the ParallelSourceFunction or RichParallelSourceFunction interface to allow it to have a higher parallelism than 1. regarding 2) I wrote a small example that showcases how to do it: final StreamExecutionEnvironment env = StreamExecutionEnvironment.g