Ready for Review: spark-kubernetes-operator Alpha Release

Hi dev members, I am writing to let you know that the first pull request has been raised to the newly established spark-kubernetes-operator, as previously discussed within the group. This PR includes the alpha version release of this project. https://github.com/apache/spark-kubernetes-operator/pu

Re: Scheduling jobs using FAIR pool

Hi Hussein, Thanks for clarifying my doubts. It means that even if I configure 2 separate pools for 2 jobs or submit the 2 jobs in same pool, the submission time will take into effect only when both the jobs are "running" in parallel ( ie if job 1 gets all resources, job 2 has to wait unless unti

Re: [VOTE] SPIP: Pure Python Package in PyPI (Spark Connect)

+1 Tom On Sunday, March 31, 2024 at 10:09:28 PM CDT, Ruifeng Zheng wrote: +1 On Mon, Apr 1, 2024 at 10:06 AM Haejoon Lee wrote: +1 On Mon, Apr 1, 2024 at 10:15 AM Hyukjin Kwon wrote: Hi all, I'd like to start the vote for SPIP: Pure Python Package in PyPI (Spark Connect)  JIRA

Re: [VOTE] SPIP: Pure Python Package in PyPI (Spark Connect)

Yes On Tue, Apr 2, 2024 at 6:36 PM Femi Anthony wrote: > So, to clarify - the purpose of this package is to enable connectivity to > a remote Spark cluster without having to install any local JVM > dependencies, right ? > > Sent from my iPhone > > On Mar 31, 2024, at 10:07 PM, Haejoon Lee > wro

Re: [VOTE] SPIP: Pure Python Package in PyPI (Spark Connect)

So, to clarify - the purpose of this package is to enable connectivity to a remote Spark cluster without having to install any local JVM dependencies, right ? Sent from my iPhoneOn Mar 31, 2024, at 10:07 PM, Haejoon Lee wrote:+1On Mon, Apr 1, 2024 at 10:15 AM Hyukjin Kwon w