alamb commented on PR #12606: URL: https://github.com/apache/datafusion/pull/12606#issuecomment-2379168110
> Basically I want to take the predicate a_point_lookup_column = 'abc' and transform that into a filter in my index. I've chosen to store this is a_point_lookup_column_distinct text[] for the case of a UTF8 column called a_point_lookup_column. This column is then stored alongside other stats columns so you end up with something like (file_path text, row_group int, a_stats_column_min double, a_stats_column_max double, a_stats_column_null_count int, a_point_lookup_column_distinct text[]). I see -- what I am not understanding is why you need to do this rewrite as part of the PruningPredicate logic (which is already complicated). WHy can't you do the rewrite/transformation *before* passing the predicate to `PruningPredicate` ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
