alamb commented on PR #19622: URL: https://github.com/apache/datafusion/pull/19622#issuecomment-3711902125
> QQuery 23 still seems to be leading ahead! I suspect this has to do with timing. Basically Q23 is like `select * from ... WHERE ... ` type query This can now takes advantage of dynamic filter pushdown which can prune some of the files. However, the updates of the dynamic filters is not deterministic so I think that accounts for the variance run to run -- depending on what rows have been seen already will potentially skip entire files I suspect this accounts for the non determinsim I will see if I can reproduce the results locally -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
