+1 On Wed, Nov 27, 2024 at 5:21 AM bo yang <bobyan...@gmail.com> wrote:
> +1 > > On Tue, Nov 26, 2024 at 3:47 PM Hyukjin Kwon <gurwls...@apache.org> wrote: > >> +1 >> >> On Mon, 25 Nov 2024 at 23:33, Bjørn Jørgensen <bjornjorgen...@gmail.com> >> wrote: >> >>> +1 >>> >>> man. 25. nov. 2024 kl. 14:48 skrev Herman van Hovell >>> <her...@databricks.com.invalid>: >>> >>>> Hi All, >>>> >>>> I would like to start a discussion on "Spark Connect the default API in >>>> Spark 4.0". >>>> >>>> The rationale for this change is that Spark Connect brings a lot of >>>> improvements with respect to simplicity, stability, isolation, >>>> upgradability, and extensibility (all detailed in the SPIP). In a nutshell: >>>> we want to introduce a flag, spark.api.mode, that allows a user to >>>> choose between classic or connect mode, the default being connect. A >>>> user can easily fallback to Classic by setting spark.api.mode to >>>> classic. >>>> >>>> SPIP: >>>> https://docs.google.com/document/d/1C0kuQEliG78HujVwdnSk0wjNwHEDdwo2o8aVq7kbhTo/edit?tab=t.0#heading=h.r2c3xrbiklu3 >>>> JIRA: https://issues.apache.org/jira/browse/SPARK-50411 >>>> >>>> I am looking forward to your feedback! >>>> >>>> Cheers, >>>> Herman >>>> >>> >>> >>> -- >>> Bjørn Jørgensen >>> Vestre Aspehaug 4, 6010 Ålesund >>> Norge >>> >>> +47 480 94 297 >>> >>