Hi dev & users, We are happy to announce the open source of remote shuffle project [1] for Flink. The project is originated in Alibaba and the main motivation is to improve batch data processing for both performance & stability and further embrace cloud native. For more features about the project, please refer to [1].
Before going open source, the project has been used widely in production and it behaves well on both stability and performance. We hope you enjoy it. Collaborations and feedbacks are highly appreciated. Best, Yingjie on behalf of all contributors [1] https://github.com/flink-extended/flink-remote-shuffle