alamb commented on PR #15770: URL: https://github.com/apache/datafusion/pull/15770#issuecomment-2970437633
> The interesting bit is that this is now faster even with predicate pushdown turned off thanks to the late partition / stats based pruning @alamb !! For the case of a single partition it's 14x faster: That sounds pretty sweet. I looked at the numbers and it seems like you have achieved the "at least as good performance and sometimes better" test that I think is needed for a feature like this. Hopefully we can get an additional confirmation and then we can merge this PR. That would be epic -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
