mbutrovich commented on PR #1862: URL: https://github.com/apache/datafusion-comet/pull/1862#issuecomment-2952887778
> I ran TPC-H benchmarks and saw shuffles with range partitioning run natively. I did not see any difference in performance compared to the last set of benchmarks I ran some time ago, but I have not compared to the main branch yet. Thanks Andy. I'm doing some pretty inefficient stuff to get around ownership issues of `Rows`, `Vec<Row>`, `Vec<OwnedRow>`, etc. that I aim to improve, so performance should improve. The microbenchmark for shuffle_writer shows range partitioning taking almost twice as long as hash partitioning on my laptop at the moment, but I aim to fix that. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
