comphead commented on PR #2375: URL: https://github.com/apache/datafusion-comet/pull/2375#issuecomment-3292854549
@rluvaton > for example shuffle files in spark are sorted, but ours are not, so we should make sure that the sort is used correctly. IMO files are sorted by partitionId within partition the order is not guaranteed unless the optional user key is requested This is nice to have sort info in sync from Spark caller to the native code, to check benefits would be great to see if any of TPCH queries got faster -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
