Re: [DISCUSSION] SPIP: Support Volcano/Alternative Schedulers Proposal

> Any guidance on how to best contribute? @Agarwal Thanks for the feedback. - It would be very good if you could share your idea and suggestion on native scheduler support in SPARK-36057 , it would be considered as part of this feature or next ad

About contribution

Hello, I hope this is not a silly question. (I couldn't find any chat room on spark project, so asking on mail) It has been about a year since using spark in work, and try to make a contribution to this project. I'm currently looking at documents in more detail, and checking the issue in JIRA now

RE: [DISCUSSION] SPIP: Support Volcano/Alternative Schedulers Proposal

Hello Folks, Happy new year to one and all. I’m from the EMR on EKS team. We help customers to run Spark workloads on Kubernetes. My team had similar ideas, and we have also sourced requirements from customers who use EMR on EKS / Spark on EKS. Would lov

Re: Time for Spark 3.2.1?

+1 non-binding view my Linkedin profile *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical cont

Re: Time for Spark 3.2.1?

+1 thanks On Tue, Jan 4, 2022 at 7:59 AM huaxin gao wrote: > Happy New Year, everyone! > > I will start preparing for Spark 3.2.1 release. I plan to do the branch > cut on Friday 1/7. Please let me know if there are any issues I need to be > aware of. > > Thanks, > Huaxin > > > On Tue, Dec 7, 20

Re: Time for Spark 3.2.1?

Happy New Year, everyone! I will start preparing for Spark 3.2.1 release. I plan to do the branch cut on Friday 1/7. Please let me know if there are any issues I need to be aware of. Thanks, Huaxin On Tue, Dec 7, 2021 at 11:03 PM Jungtaek Lim wrote: > +1 for both releases and the time! > > On

Re: [DISCUSSION] SPIP: Support Volcano/Alternative Schedulers Proposal

Interesting,thanks Do you have any indication of the ballpark figure (a rough numerical estimate) of adding Volcano as an alternative scheduler is going to improve Spark on k8s performance? Thanks view my Linkedin profile *Disclai

Re: [DISCUSSION] SPIP: Support Volcano/Alternative Schedulers Proposal

Hi, folks! Wishing you all the best in 2022. I'd like to share the current status on "Support Customized K8S Scheduler in Spark". https://docs.google.com/document/d/1xgQGRpaHQX6-QH_J9YV2C2Dh6RpXefUpLM7KGkzL6Fg/edit#heading=h.1quyr1r2kr5n Framework/Common support - Volcano and Yunikorn team join