Re: Recap on current status of "SPIP: Support Customized Kubernetes Schedulers"

Thank you, Yikun. I am working on SPARK-37809 and SPARK-38310 . They are the major stuff for the yunikorn part. Keep in mind we also need to add the documents. Thanks for building up the common th

Re: [VOTE][SPIP] Support Customized Kubernetes Schedulers Proposal

+1 (non-binding) On Wed, Jan 5, 2022 at 5:09 PM Chaoran Yu wrote: > +1 (non-binding). Thanks Yikun for putting it all together > > On Wed, Jan 5, 2022 at 5:07 PM Yikun Jiang wrote: > >> Hi all, >> >> I’d like to start a vote for SPIP: "Support Customized Kubernetes >> Schedulers Proposal" >> >>

Re: [DISCUSSION] SPIP: Support Volcano/Alternative Schedulers Proposal

;>> Interesting,thanks >>>>>>>> >>>>>>>> Do you have any indication of the ballpark figure (a rough >>>>>>>> numerical estimate) of adding Volcano as an alternative scheduler >>>>>>>> is going to improve Spark on k8s performance? >&

Re: [DISCUSSION] SPIP: Support Volcano/Alternative Schedulers Proposal

thub.com/kubernetes-sigs/kube-batch > [4] > https://kubernetes.io/docs/tasks/extend-kubernetes/custom-resources/custom-resource-definitions/ > > Regards, > Yikun > > > Weiwei Yang 于2021年12月1日周三 上午5:57写道： > >> Hi Chenya >> >> Thanks for bringing this up.

Re: [DISCUSSION] SPIP: Support Volcano/Alternative Schedulers Proposal

s explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Tue, 30 Nov 2021 at 21:57, Weiwei Yang wrote: > >> Hi Chenya >> >> Thanks for bringing this up. This is qui

Re: [DISCUSSION] SPIP: Support Volcano/Alternative Schedulers Proposal

Hi Chenya Thanks for bringing this up. This is quite interesting, we definitely should participate more in the discussions. The main thing here is, the Spark community should make Spark pluggable in order to support other schedulers, not just for Volcano. It looks like this proposal is pushing rea