Re: spark executor pod has same memory value for request and limit

loss, damage or destruction. > > > > > On Fri, 10 Mar 2023 at 19:01, Ismail Yenigul > wrote: > >> Hi Mich, >> >> it is on AWS EKS >> >> >> Mich Talebzadeh , 10 Mar 2023 Cum, 21:11 >> tarihinde şunu yazdı: >> >

Re: spark executor pod has same memory value for request and limit

19:01 skrev Ismail Yenigul >: > >> and If you look at the code >> >> >> https://github.com/apache/spark/blob/e64262f417bf381bdc664dfd1cbcfaa5aa7221fe/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/BasicExecutorFeatur

Re: spark executor pod has same memory value for request and limit

for them if I use podtemplate? Ismail Yenigul , 10 Mar 2023 Cum, 20:52 tarihinde şunu yazdı: > Hi, > using spark version v.3.1.2 > > spark.executor.memory is set. > But the problem is not setting spark.executor.memory, the problem is that > whatever value I set spark.executor

Re: spark executor pod has same memory value for request and limit

estruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Fri, 10 Mar

spark executor pod has same memory value for request and limit

Hi, There is a cpu parameter to set spark executor on k8s spark.kubernetes.executor.limit.cores and spark.kubernetes.executor.request.cores but there is no parameter to set memory request different then limits memory (such as spark.kubernetes.executor.request.memory) For that reason, spark.executo