On Fri, 5 Jul 2024 at 01:44, Arun Ravi wrote:
> Hi Rajesh,
>
> We use it production at scale. We run spark on kubernetes on aws cloud and
> here are the key things that we do
> 1) we run driver on on-demand node
> 2) we have configured decommission along with fallback option on to S3,
> try the l
Hi Rajesh,
We use it production at scale. We run spark on kubernetes on aws cloud and
here are the key things that we do
1) we run driver on on-demand node
2) we have configured decommission along with fallback option on to S3, try
the latest single zone S3 for this.
3) We use pvc aware scheduling
