Re: [I] Exponential planning time (100s of seconds) with `UNION` and `ORDER BY` queries [datafusion]

[via GitHub]

alamb commented on issue #13748:
URL: https://github.com/apache/datafusion/issues/13748#issuecomment-2596026263

   I think I am close to actually making measurable progress
   
   With some more flame graph profiling, I am convinced that the time is 
largely spent in
   - `OrderingEquivalenceProperties::resolve_overlap`
   - `normalize_sort_exprs`
   
   
![Image](https://github.com/user-attachments/assets/aa210131-8c35-4707-871a-57a3aaa6e272)
   
   My next steps are to create a benchmark in the repository and then work on 
validating some optimizations (such as 
https://github.com/apache/datafusion/pull/14136)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org