zhuqi-lucas commented on issue #16710: URL: https://github.com/apache/datafusion/issues/16710#issuecomment-3082269096
> > [@UBarney](https://github.com/UBarney) - here are the 1e7 join results on my M3 Macbook with 16GB of RAM: > > [@MrPowers](https://github.com/MrPowers) I am using the **1e8** dataset. > > ``` > target/release/dfbench h2o --iterations 5 --join-paths /home/lv/code/datafusion/benchmarks/data/h2o/J1_1e8_NA_0.csv,/home/lv/code/datafusion/benchmarks/data/h2o/J1_1e8_1e2_0.csv,/home/lv/code/datafusion/benchmarks/data/h2o/J1_1e8_1e5_0.csv,/home/lv/code/datafusion/benchmarks/data/h2o/J1_1e8_1e8_NA.csv --queries-path /home/lv/code/datafusion/benchmarks/queries/h2o/join.sql -o /home/lv/code/datafusion/benchmarks/results/join/h2o_join_exch_join_order.json > > > devhomeinsp ~/c/datafusion > wc benchmarks/data/h2o/J1_1e8_* > 101 101 2841 benchmarks/data/h2o/J1_1e8_1e2_0.csv > 100001 100001 4420917 benchmarks/data/h2o/J1_1e8_1e5_0.csv > 100000001 100000001 6619091495 benchmarks/data/h2o/J1_1e8_1e8_NA.csv > 101 101 6661 benchmarks/data/h2o/J1_1e8_NA_0.csv > 100100204 100100204 6623521914 total > ``` I got similar result for my Mac M4 48GB, i believe we need to limit 16GB to mock the 16GB result. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
