{
"emoji": "đź‘Ť",
"version": 1
}
a pod restart.
Have you checked Apache Uniffle / Celeborn for enabling spark shuffle ?
fyi .. i'm using kubeflow spark operator, and in the process of doing
performance comparison/optimization as well.
regds,
Karan Alang
On Fri, Apr 11, 2025 at 9:07 AM Prem Sahoo wrote:
> Hello Karan
Hi Prem,
Which distribution of Spark are you using ?
how long does it take to launch the job ?
wrt Spark Shuffle, what is the approach you are using - storing shuffle
data in MinIO or using host path ?
regds,
Karan
On Fri, Apr 11, 2025 at 4:58 AM Prem Sahoo wrote:
> Hello Team,
> I have a pecu
