Re: [DISCUSS] Support spark.ml on Spark Connect

2025-01-21 Thread Mich Talebzadeh
Given our recent discussion on using spark connect as a stable API, this will be another positive step. HTH Mich Talebzadeh, Architect | Data Science | Financial Crime | Forensic Analysis | GDPR view my Linkedin profile On Tue, 2

Re: [DISCUSS] Support spark.ml on Spark Connect

2025-01-20 Thread Martin Grund
Awesome progress! On Tue, Jan 21, 2025 at 8:15 AM Bobby wrote: > Hi all, > > Thank you for reviewing and merging PR #48791 > , which enables running > spark.ml on Connect starting from Spark 4.0. With this PR, it becomes > extremely easy to support thi

Re: [DISCUSS] Support spark.ml on Spark Connect

2025-01-20 Thread Bobby
Hi all, Thank you for reviewing and merging PR #48791 , which enables running spark.ml on Connect starting from Spark 4.0. With this PR, it becomes extremely easy to support third-party Spark ML libraries on Connect. I also want to highlight PR #49503 <

Re: [DISCUSS] Support spark.ml on Spark Connect

2024-11-13 Thread Mich Talebzadeh
OK I added a comment to PR HTH, Mich Talebzadeh, Architect | Data Engineer | Data Science | Financial Crime PhD Imperial College London London, United Kingdom view my Linkedin profil

Re: [DISCUSS] Support spark.ml on Spark Connect

2024-11-13 Thread Bobby
Hi all, Finally, I got the draft PR up https://github.com/apache/spark/pull/48791 last week, but I would like to send it out here and hope to get your feedback and reviews. Thx very much. Mich Talebzadeh 于2024年10月15日周二 15:47写道: > +1 > > It will be a desirable feature > > Mich Talebzadeh, > > A

Re: [DISCUSS] Support spark.ml on Spark Connect

2024-10-15 Thread Mich Talebzadeh
+1 It will be a desirable feature Mich Talebzadeh, Architect | Data Engineer | Data Science | Financial Crime PhD Imperial College London London, United Kingdom view my Linkedin prof

Re: [DISCUSS] Support spark.ml on Spark Connect

2024-10-14 Thread Bobby
Thank you for your kind response. I will prepare a formal PR for Spark. Niranjan Jayakar 于2024年10月11日周五 22:45写道: > +1 > > On Thu, Oct 10, 2024 at 5:28 PM Xiao Li wrote: > >> Thank you for working on this! >> >> Xiao >> >> Martin Grund 于2024年10月10日周四 03:01写道: >> >>> >>> Hi Bobby, >>> >>> Awes

Re: [DISCUSS] Support spark.ml on Spark Connect

2024-10-11 Thread Niranjan Jayakar
+1 On Thu, Oct 10, 2024 at 5:28 PM Xiao Li wrote: > Thank you for working on this! > > Xiao > > Martin Grund 于2024年10月10日周四 03:01写道: > >> >> Hi Bobby, >> >> Awesome to see the proposal! I'm very much looking forward to the >> contributions! >> >> Martin >> >> On Thu, Oct 10, 2024 at 4:16 AM Áng

Re: [DISCUSS] Support spark.ml on Spark Connect

2024-10-10 Thread Xiao Li
Thank you for working on this! Xiao Martin Grund 于2024年10月10日周四 03:01写道: > > Hi Bobby, > > Awesome to see the proposal! I'm very much looking forward to the > contributions! > > Martin > > On Thu, Oct 10, 2024 at 4:16 AM Ángel > wrote: > >> You have my vote (btw, great idea, ML is so sexy now

Re: [DISCUSS] Support spark.ml on Spark Connect

2024-10-10 Thread Martin Grund
Hi Bobby, Awesome to see the proposal! I'm very much looking forward to the contributions! Martin On Thu, Oct 10, 2024 at 4:16 AM Ángel wrote: > You have my vote (btw, great idea, ML is so sexy nowadays 😉) > > El jue, 10 oct 2024 a las 3:19, Bobby () escribió: > >> Hi, >> >> I'd like to start

Re: [DISCUSS] Support spark.ml on Spark Connect

2024-10-09 Thread Ángel
You have my vote (btw, great idea, ML is so sexy nowadays 😉) El jue, 10 oct 2024 a las 3:19, Bobby () escribió: > Hi, > > I'd like to start a discussion about support spark.ml on Connect. With > this feature, Users don't need to change their code to run Spark ML cases > on Connect. > > Please re