+1 man. 25. nov. 2024 kl. 14:48 skrev Herman van Hovell <her...@databricks.com.invalid>:
> Hi All, > > I would like to start a discussion on "Spark Connect the default API in > Spark 4.0". > > The rationale for this change is that Spark Connect brings a lot of > improvements with respect to simplicity, stability, isolation, > upgradability, and extensibility (all detailed in the SPIP). In a nutshell: > we want to introduce a flag, spark.api.mode, that allows a user to choose > between classic or connect mode, the default being connect. A user can > easily fallback to Classic by setting spark.api.mode to classic. > > SPIP: > https://docs.google.com/document/d/1C0kuQEliG78HujVwdnSk0wjNwHEDdwo2o8aVq7kbhTo/edit?tab=t.0#heading=h.r2c3xrbiklu3 > JIRA: https://issues.apache.org/jira/browse/SPARK-50411 > > I am looking forward to your feedback! > > Cheers, > Herman > -- Bjørn Jørgensen Vestre Aspehaug 4, 6010 Ålesund Norge +47 480 94 297
