Hi, Damon Cortesi runs Spark on K8s and uses YuniKorn as the scheduler. He presented at Kubecon with some of his findings [1] He published a test setup for YuniKorn with Karpenter which looks interesting on the YunKorn slack channel: -+-+-+- Hey folks! I just published a repo for local testing of YuniKorn + Karpenter using KWOK and Kind (so many tools).If you're thinking of testing out auto-scaling w/YuniKorn and Karpenter, this is a pretty nice way of doing it without requiring a full k8s cluster. [2] -+-+-+-
Might be something to look at for performance testing of YuniKorn Wilfred [1] https://kccncna2025.sched.com/event/27Fd6/spark-on-kubernetes-a-practical-guide-damon-cortesi-airbnb [2] https://github.com/dacort/kinda-yunikarp/tree/main --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
