Re: [DISCUSS] [Spark SQL] Single-pass Analyzer SPIP

2024-09-24 Thread Wenchen Fan
Let me add a bit more color since I'm the Shepherd. I've fixed quite some bugs in the analyzer due to rule order issues. The recent ones are https://github.com/apache/spark/pull/45718 and https://github.com/apache/spark/pull/45350 . Dealing with rule order is very tricky and making all the analyze

Re: [DISCUSS] [Spark SQL] Single-pass Analyzer SPIP

2024-09-19 Thread Reynold Xin
Great document! Thanks for writing it up. On Tue, Sep 10, 2024 at 10:00 AM Vladimir Golubev wrote: > Hey folks, following up on the recent single-pass Analyzer discussion. I > made a high-level proposal document for this idea: > https://docs.google.com/document/d/1dWxvrJV-0joGdLtWbvJ0uNyTocDMJ90