Re:Re: Spark 2.0 on YARN - Dynamic Resource Allocation Behavior change?

2016-07-28 Thread LONG WANG
ng “--conf spark.dynamicAllocation.enabled=false” in the command line. On Jul 28, 2016, at 15:44, LONG WANG wrote: Hi Spark Experts, Today I tried Spark 2.0 on YARN and also enabled Dynamic Resource Allocation feature, I just find that no matter I specify --num-executo

Spark 2.0 on YARN - Dynamic Resource Allocation Behavior change?

2016-07-28 Thread LONG WANG
Hi Spark Experts, Today I tried Spark 2.0 on YARN and also enabled Dynamic Resource Allocation feature, I just find that no matter I specify --num-executor in spark-submit command or not, the Dynamic Resource Allocation is used, but I remember when I specify --num-exe