alamb commented on PR #115: URL: https://github.com/apache/datafusion-site/pull/115#issuecomment-3339480401
> Maybe this is too much hedging, but: this sounds like we get orders of magnitude gains always. But that probably depends on the query! yeah, I think specifically it really helps: 1. When the files are entirely remote (on object_store) 1. The queries are relatively low latency (10s of ms) as parsing the footer can be substantial amount of the overall query processing time I'll try and add that detail to the post -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
