Hi Averell, As far as I know, the custom partitioner will inevitably lead to shuffle of data. Even if it is bundled in the logic of the source function, isn't the behavior different?
Thanks, vino. 2018-07-30 20:32 GMT+08:00 Averell <lvhu...@gmail.com>: > Thanks Vino. > > Yes, I can do that after the source function. But that means data would be > shuffled - sending from every source to the right partition. > I think that by doing the partition from within the file source would help > to save that shuffling. > > Thanks. > Averell. > > > > -- > Sent from: http://apache-flink-user-mailing-list-archive.2336050. > n4.nabble.com/ >
