Sorry,the last configuration is also --conf
spark.dynamicAllocation.cachedExecutorIdleTimeout=60s, "--conf" was lost
when I copied it to mail.
-- Forwarded message --
From: Jy Chen
Date: 2016-03-10 10:09 GMT+08:00
Subject: Re: Dynamic allocation doesn't work on YARN
To: Saisai Sha
Hello everyone:
I'm trying the dynamic allocation in Spark on YARN. I have followed
configuration steps and started the shuffle service.
Now it can request executors when the workload is heavy but it cannot
remove executors. I try to open the spark shell and don’t run any command,
no executor is
