Re: Bugs with joins and SQL in Structured Streaming

2024-09-30 Thread Jungtaek Lim
I figured out the issue which breaks the second test in SqlSyntaxTest. This is also a correctness issue, unfortunately. Issue and the fix for OuterJoinTest: https://issues.apache.org/jira/browse/SPARK-49829 Issue and the fix for SqlSyntaxTest: https://issues.apache.org/jira/browse/SPARK-49836 Tha

Re: Rust Spark Connect

2024-09-30 Thread ed elliott
Hi, There isn’t an official client (the only official ones are python/java/scala) but this uses the spark connect gRPC API and is well supported: https://github.com/sjrusso8/spark-connect-rs Ed Elliott From: Tarkhan Shakhbazyan Sent: Sunday, September 29, 2024