Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-06 Thread Matei Zaharia
+1 on multiple packages here. > On Feb 6, 2025, at 10:54 AM, Rozov, Vlad wrote: > > +1 (non-binding) > > Thank you, > > Vlad > >> On Feb 4, 2025, at 11:05 PM, Wenchen Fan wrote: >> >> Hi all, >> >> Given the positive feedback in the previous DISCUSS email >>

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-06 Thread Rozov, Vlad
+1 (non-binding) Thank you, Vlad On Feb 4, 2025, at 11:05 PM, Wenchen Fan wrote: Hi all, Given the positive feedback in the previous DISCUSS email, I'd like to start the vote for the proposal "Publish additional Spark distrib

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-06 Thread John Zhuge
+1 (non-binding) On Thu, Feb 6, 2025 at 7:56 AM Dongjoon Hyun wrote: > +1 for the additional package. > > Dongjoon. > > On Wed, Feb 5, 2025 at 6:30 PM Wenchen Fan wrote: > >> Hi Adam, >> >> Thanks for raising your concerns! This is also why we are not making >> Spark Connect the default but pro

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-06 Thread Dongjoon Hyun
+1 for the additional package. Dongjoon. On Wed, Feb 5, 2025 at 6:30 PM Wenchen Fan wrote: > Hi Adam, > > Thanks for raising your concerns! This is also why we are not making Spark > Connect the default but providing an additional Spark distribution so that > users can opt in easily. There is a

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-05 Thread Wenchen Fan
Hi Adam, Thanks for raising your concerns! This is also why we are not making Spark Connect the default but providing an additional Spark distribution so that users can opt in easily. There is a simple fix for this security issue as @Hyukjin Kwon mentioned and we are working on it: https://github

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-05 Thread Hyukjin Kwon
This is exactly the same case with the Py4J gateway server. We can easily implement that - I am one of the maintainers of Py4J fwiw and running a local Spark Connect server is already there apart from the PR https://github.com/apache/spark/pull/49107. On Thu, 6 Feb 2025 at 10:40, Adam Binford wr

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-05 Thread Adam Binford
-1 (non-binding) for me. I've commented on the PR for this ( https://github.com/apache/spark/pull/49107), but in its current state this seems like it would introduce a massive security vulnerability. If a user launches a "Spark Connect enabled" cluster deploy mode job in a multi-tenant YARN cluster

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-05 Thread Chao Sun
+1 On Wed, Feb 5, 2025 at 8:42 AM Martin Grund wrote: > +1 > > On Wed, Feb 5, 2025 at 17:15 bo yang wrote: > >> +1 (non-binding) >> >> On Wed, Feb 5, 2025 at 7:51 AM Jules Damji wrote: >> >>> +1 (non-binding) >>> >>> Excuse the thumb typos >>> >>> >>> On Tue, 04 Feb 2025 at 11:06 PM, Wenchen F

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-05 Thread Martin Grund
+1 On Wed, Feb 5, 2025 at 17:15 bo yang wrote: > +1 (non-binding) > > On Wed, Feb 5, 2025 at 7:51 AM Jules Damji wrote: > >> +1 (non-binding) >> >> Excuse the thumb typos >> >> >> On Tue, 04 Feb 2025 at 11:06 PM, Wenchen Fan wrote: >> >>> Hi all, >>> >>> Given the positive feedback in the prev

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-05 Thread bo yang
+1 (non-binding) On Wed, Feb 5, 2025 at 7:51 AM Jules Damji wrote: > +1 (non-binding) > > Excuse the thumb typos > > > On Tue, 04 Feb 2025 at 11:06 PM, Wenchen Fan wrote: > >> Hi all, >> >> Given the positive feedback in the previous DISCUSS email >>

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-05 Thread Jules Damji
+1 (non-binding) Excuse the thumb typos On Tue, 04 Feb 2025 at 11:06 PM, Wenchen Fan wrote: > Hi all, > > Given the positive feedback in the previous DISCUSS email > , I'd > like to start the vote for the proposal "Publish addit

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-05 Thread Denny Lee
+1 (non-binding) On Wed, Feb 5, 2025 at 07:11 huaxin gao wrote: > +1 > > On Wed, Feb 5, 2025 at 1:39 AM Mich Talebzadeh > wrote: > >> +1 >> >> Dr Mich Talebzadeh, >> Architect | Data Science | Financial Crime | Forensic Analysis | GDPR >> >>view my Linkedin profile >>

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-05 Thread huaxin gao
+1 On Wed, Feb 5, 2025 at 1:39 AM Mich Talebzadeh wrote: > +1 > > Dr Mich Talebzadeh, > Architect | Data Science | Financial Crime | Forensic Analysis | GDPR > >view my Linkedin profile > > > > > > > On Wed, 5 Feb 2025 at 08:26, Yumi

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-05 Thread Mich Talebzadeh
+1 Dr Mich Talebzadeh, Architect | Data Science | Financial Crime | Forensic Analysis | GDPR view my Linkedin profile On Wed, 5 Feb 2025 at 08:26, Yuming Wang wrote: > +1 > > On Wed, Feb 5, 2025 at 4:15 PM Max Gekk wrote: > >>

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-05 Thread Yuming Wang
+1 On Wed, Feb 5, 2025 at 4:15 PM Max Gekk wrote: > +1 > > On Wed, Feb 5, 2025 at 9:00 AM Yang Jie wrote: > >> +1 >> >> Jie Yang >> >> On 2025/02/05 07:38:08 Sakthi wrote: >> > +1 (non-binding) >> > >> > On Tue, Feb 4, 2025 at 11:25 PM DB Tsai wrote: >> > >> > > +1 >> > > >> > > DB Tsai | ht

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-05 Thread Max Gekk
+1 On Wed, Feb 5, 2025 at 9:00 AM Yang Jie wrote: > +1 > > Jie Yang > > On 2025/02/05 07:38:08 Sakthi wrote: > > +1 (non-binding) > > > > On Tue, Feb 4, 2025 at 11:25 PM DB Tsai wrote: > > > > > +1 > > > > > > DB Tsai | https://www.dbtsai.com/ | PGP 42E5B25A8F7A82C1 > > > > > > On Feb 4, 20

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-04 Thread Yang Jie
+1 Jie Yang On 2025/02/05 07:38:08 Sakthi wrote: > +1 (non-binding) > > On Tue, Feb 4, 2025 at 11:25 PM DB Tsai wrote: > > > +1 > > > > DB Tsai | https://www.dbtsai.com/ | PGP 42E5B25A8F7A82C1 > > > > On Feb 4, 2025, at 11:13 PM, Xiao Li wrote: > > > > +1 > > > > Xiao > > > > Jungtaek Lim

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-04 Thread L. C. Hsieh
+1 On Tue, Feb 4, 2025 at 11:56 PM Gengliang Wang wrote: > > +1 > > On Tue, Feb 4, 2025 at 11:38 PM Sakthi wrote: >> >> +1 (non-binding) >> >> On Tue, Feb 4, 2025 at 11:25 PM DB Tsai wrote: >>> >>> +1 >>> >>> DB Tsai | https://www.dbtsai.com/ | PGP 42E5B25A8F7A82C1 >>> >>> On Feb 4, 2025, a

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-04 Thread Gengliang Wang
+1 On Tue, Feb 4, 2025 at 11:38 PM Sakthi wrote: > +1 (non-binding) > > On Tue, Feb 4, 2025 at 11:25 PM DB Tsai wrote: > >> +1 >> >> DB Tsai | https://www.dbtsai.com/ | PGP 42E5B25A8F7A82C1 >> >> On Feb 4, 2025, at 11:13 PM, Xiao Li wrote: >> >> +1 >> >> Xiao >> >> Jungtaek Lim 于2025年2月4日

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-04 Thread Sakthi
+1 (non-binding) On Tue, Feb 4, 2025 at 11:25 PM DB Tsai wrote: > +1 > > DB Tsai | https://www.dbtsai.com/ | PGP 42E5B25A8F7A82C1 > > On Feb 4, 2025, at 11:13 PM, Xiao Li wrote: > > +1 > > Xiao > > Jungtaek Lim 于2025年2月4日周二 23:11写道: > >> +1 (non-binding) >> >> Sounds like a great alternati

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-04 Thread DB Tsai
+1 DB Tsai | https://www.dbtsai.com/ | PGP 42E5B25A8F7A82C1 > On Feb 4, 2025, at 11:13 PM, Xiao Li wrote: > > +1 > > Xiao > > Jungtaek Lim > 于2025年2月4日周二 23:11写道: >> +1 (non-binding) >> >> Sounds like a great alternative! >> >> On Wed, Feb 5, 2025 a

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-04 Thread Xiao Li
+1 Xiao Jungtaek Lim 于2025年2月4日周二 23:11写道: > +1 (non-binding) > > Sounds like a great alternative! > > On Wed, Feb 5, 2025 at 4:10 PM Hyukjin Kwon wrote: > >> +1 >> >> On Wed, 5 Feb 2025 at 16:06, Wenchen Fan wrote: >> >>> Hi all, >>> >>> Given the positive feedback in the previous DISCUSS em

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-04 Thread Jungtaek Lim
+1 (non-binding) Sounds like a great alternative! On Wed, Feb 5, 2025 at 4:10 PM Hyukjin Kwon wrote: > +1 > > On Wed, 5 Feb 2025 at 16:06, Wenchen Fan wrote: > >> Hi all, >> >> Given the positive feedback in the previous DISCUSS email >>

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-04 Thread Hyukjin Kwon
+1 On Wed, 5 Feb 2025 at 16:06, Wenchen Fan wrote: > Hi all, > > Given the positive feedback in the previous DISCUSS email > , I'd > like to start the vote for the proposal "Publish additional Spark > distribution with Spark Conne

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-04 Thread Mridul Muralidharan
+1 Regards, Mridul On Wed, Feb 5, 2025 at 1:06 AM Wenchen Fan wrote: > Hi all, > > Given the positive feedback in the previous DISCUSS email > , I'd > like to start the vote for the proposal "Publish additional Spark > distribut

[VOTE] Publish additional Spark distribution with Spark Connect enabled

2025-02-04 Thread Wenchen Fan
Hi all, Given the positive feedback in the previous DISCUSS email , I'd like to start the vote for the proposal "Publish additional Spark distribution with Spark Connect enabled". Please vote for the next 72 hours: [ ] +1: Accept