alamb commented on PR #12978: URL: https://github.com/apache/datafusion/pull/12978#issuecomment-2423167089
@adriangb in theory I think parquet statistics can be truncated. > Now we want to know if col LIKE '%A%' I don't think we can use statistics for substring match -- we can only use statistics for equality and prefix matching so like `col LIKE 'A%'` The predicate would be transformed into `'B' <= 'A' AND 'A' <= 'Z'` which I do think is correct -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
