adriangb commented on issue #18856: URL: https://github.com/apache/datafusion/issues/18856#issuecomment-3581218003
I think the _for stats pruning only_ is perhaps not the right distinction to make: what can and can't be used for stats pruning is going to vary by file format and changes over time. The distinction that the logical filter pushdown makes, and that maybe we should be making here, is: - I am going to use the filter, but I can't guarantee exact filtering aka `Inexact`. This usually means it *might* be used for stats pruning but *will not* be used for row-level pruning. - I am going to apply the filter exactly as `FilterExec` would i.e. `Exact`. - I won't use the filter at all i.e. `Unsupported`. But maybe I'm missing something... what would a node do with the information that another operator is going to use a filter "only for stats pruning"? Not produce the filter? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
