Hi Averell, Yes, you can not do it in the source function. I think you can call keyBy with a partitioner (based on NodeID) after source. Why do you have to use the customized partitioner in the source function?
Thanks, vino. 2018-07-30 19:56 GMT+08:00 Averell <lvhu...@gmail.com>: > Thank you Vino. > > Yes, I went thru that official guide before posting this question. The > problem was that I could not see any call to one of those mentioned > partitioning methods (partitionCustom, shuffle, rebalance, rescale, or > broadcast) in the original readFile function. I'm still trying to look into > the code. > There should always be a way to do it, but I hope that you / someone can > help me with the easiest way - kind of a small customization at the very > place that "directory monitoring" hands-over the file splits to "file > reader". > > Thanks! > > > > -- > Sent from: http://apache-flink-user-mailing-list-archive.2336050. > n4.nabble.com/ >
