Hi devs, I’d like to start a discussion on FLIP-434: Support optimizations for pre-partitioned data sources [1].
The FLIP introduces taking advantage of pre-partitioned data sources for SQL/Table API (it is already supported as experimental feature in DataStream API [2]). Please find more details in the FLIP wiki document [1]. Looking forward to your feedback. Regards, Jeyhun [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-434%3A+Support+optimizations+for+pre-partitioned+data+sources [2] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/experimental/