samuelcolvin commented on issue #11170: URL: https://github.com/apache/datafusion/issues/11170#issuecomment-2253527396
I think the problem is that [here](https://github.com/apache/arrow-rs/blob/f42d2420525a05a9b55461d83b359779ca5cc2a3/arrow-select/src/filter.rs#L320-L383) `arrow-rs` has special cases for primative types and "byte types" e.g. strings, but no special case for `FixedSizeBinary`. Not sure how much of the slow down is due to that, but could be significant. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
