alamb commented on PR #16789: URL: https://github.com/apache/datafusion/pull/16789#issuecomment-3085558681
I for one am not really worried about memory as we are talking about `8k * Int64` = 64k for the largest index size. I expect most people to use a single index size (e.g. Int32) so that is like 32K per process if they query partition columns -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org