SemyonSinchenko commented on PR #14902: URL: https://github.com/apache/datafusion/pull/14902#issuecomment-2687145015
@zhuqi-lucas Did you try to increase the `batch_size` argument? It is designed to avoid OOMs but the small batch size can also reduce the generation speed. If your computer has enough memory you can try to increase this value. The default value (5_000_000 of rows) is quite conservative. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
