zhuqi-lucas commented on PR #15380: URL: https://github.com/apache/datafusion/pull/15380#issuecomment-2812607514
```rust -------------------- Benchmark sort_tpch10.json -------------------- ┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓ ┃ Query ┃ main ┃ concat_batches_for_sort ┃ Change ┃ ┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩ │ Q1 │ 2243.52ms │ 1525.77ms │ +1.47x faster │ │ Q2 │ 1842.11ms │ 1150.71ms │ +1.60x faster │ │ Q3 │ 12446.31ms │ 12498.09ms │ no change │ │ Q4 │ 4047.55ms │ 1949.27ms │ +2.08x faster │ │ Q5 │ 4364.46ms │ 4334.64ms │ no change │ │ Q6 │ 4561.01ms │ 4538.98ms │ no change │ │ Q7 │ 8158.01ms │ 7720.56ms │ +1.06x faster │ │ Q8 │ 6077.40ms │ 6010.15ms │ no change │ │ Q9 │ 6347.21ms │ 6406.01ms │ no change │ │ Q10 │ 11561.03ms │ 9081.48ms │ +1.27x faster │ │ Q11 │ 6069.42ms │ 4684.90ms │ +1.30x faster │ └──────────────┴────────────┴─────────────────────────┴───────────────┘ ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓ ┃ Benchmark Summary ┃ ┃ ┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩ │ Total Time (main) │ 67718.04ms │ │ Total Time (concat_batches_for_sort) │ 59900.57ms │ │ Average Time (main) │ 6156.19ms │ │ Average Time (concat_batches_for_sort) │ 5445.51ms │ │ Queries Faster │ 6 │ │ Queries Slower │ 0 │ │ Queries with No Change │ 5 │ └────────────────────────────────────────┴────────────┘ ``` Updated the latest code result, when column <=2 , we will do it in memory sort and using interleave. It's no regression for the testing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
