Re: [I] nit: Hash Partitioning Shuffle Writes Last Batches First [datafusion-comet]

2025-04-21 Thread via GitHub
andygrove closed issue #1659: nit: Hash Partitioning Shuffle Writes Last Batches First URL: https://github.com/apache/datafusion-comet/issues/1659 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[I] nit: Hash Partitioning Shuffle Writes Last Batches First [datafusion-comet]

2025-04-20 Thread via GitHub
EmilyMatt opened a new issue, #1659: URL: https://github.com/apache/datafusion-comet/issues/1659 This is a nitpick, but I've noticed that in the new interleaved shuffle, when copying the data into the output data file, first the in-memory data is written to the file, and only then is the co