Great :) Just one more note. Currently FlinkKafkaShuffle has a critical bug [1] that probably will prevent you from using it directly. I hope it will be fixed in some next release. In the meantime you can just inspire your solution with the source code.
Best, Piotrek [1] https://issues.apache.org/jira/browse/FLINK-21317 czw., 4 mar 2021 o 03:48 yidan zhao <hinobl...@gmail.com> napisał(a): > Yes, you are right and thank you. I take a brief look at what > FlinkKafkaShuffle is doing, it seems what I need and I will have a try. > >>
