Thanks Daisy and Kevin for a great write up! ;) Especially the 2nd part was really interesting, I really like the idea of the single spill file with a custom scheduling of read requests.
Best, D. On Mon, Nov 1, 2021 at 10:01 AM Daisy Tsang <da...@ververica.com> wrote: > Hey everyone, we have a new two-part post published on the Apache Flink > blog about the sort-based blocking shuffle implementation in Flink. It > covers benchmark results, design and implementation details, and more! We > hope you like it and welcome any sort of feedback on it. :) > > > https://flink.apache.org/2021/10/26/sort-shuffle-part1.html > https://flink.apache.org/2021/10/26/sort-shuffle-part2.html >