adriangb opened a new pull request, #17323:
URL: https://github.com/apache/datafusion/pull/17323

   similar to #17077, equivalence info was being lost. this time it happens 
when a dynamic filter is pushed down (which is now unblocked in some queries 
thanks to #17238).
   
   the tldr is that the second filter comes around and we try to re-compute 
equivalence info _using only the second filter_ and since we no longer have the 
first filter we ignore that one -> that info gets lost.
   
   the big picture problem imo is that the equivalence info / cache is at the 
DataSourceExec level, the projection is at the FileScanConfig level and the 
filter is at the FileSource level. So the information / code is distributed 
across 3 places. I'm h


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

Reply via email to