vladimirg-db opened a new pull request, #49658:
URL: https://github.com/apache/spark/pull/49658

   ### What changes were proposed in this pull request?
   
   Support more advanced SQL/DataFrame read path functionality in single-pass 
Analyzer:
   - Most of name resolution
   - Views
   - CTEs
   - UNIONs
   - Global aggregates
   - Most of the functions
   - LCAs in Project
   - LIMIT
   - Subtree resolution in extensions
   - Expression ID assignment
   - Generic type coercion
   
   Also, remove `TracksResolvedNodes`, because it's based on comparing object 
addresses, which doesn't always make sense in Catalyst, because Catalyst reuses 
objects (e.g. literals or local/global limit expression trees).
   
   ### Why are the changes needed?
   
   To replace fixed-point Analyzer in Spark with a single-pass one.
   
   ### Does this PR introduce _any_ user-facing change?
   
   No, single-pass Analyzer is still disabled.
   
   ### How was this patch tested?
   
   - New test suites
   - Dual running two Analyzers and comparing logical plans with 
`ANALYZER_DUAL_RUN_LEGACY_AND_SINGLE_PASS_RESOLVER`.
   
   ### Was this patch authored or co-authored using generative AI tooling?
   
   Yes, copilot.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to