dwsmith1983 commented on issue #25923: URL: https://github.com/apache/datafusion/issues/25923#issuecomment-5922271773
@sunchao #25584 summarizes the inner group for range and `<>` comparisons, which covers q21's `l_suppkey <>` filter, but only once the buffered inner group has at least seven rows and the outer group more than one. Lineitem's groups mostly fall below that. For those, and for compound filters, I'd like to evaluate the filter over a few thousand outer and inner row pairs per call instead of once per inner row. Would you rather that go on top of #25584, or wait until it merges? The memory accounting half doesn't touch the filter path and will come as its own PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
