Hi devs, I’d like to start a discussion on FLIP-419: Optimize multi-sink query plan generation [1].
Currently, the optimization process of multi-sink query plans are suboptimal: 1) it requires to go through the optimization process several times and 2) as a result of this some low-level code complexity is introduced on high level optimization classes such as StreamCommonSubGraphBasedOptimizer. To address this issue, this FLIP introduces to decouple changelog and mini-batch interval inference from the main optimization process. Please find more details in the FLIP wiki document [1]. Looking forward to your feedback. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-419%3A+Optimize+multi-sink+query+plan+generation Regards, Jeyhun Karimov