Please see YARN-193 where 'yarn.scheduler.maximum-allocation-vcores' was introduced.
See also YARN-3823 which changed default value. Cheers On Tue, Jul 14, 2015 at 10:55 AM, Shushant Arora <shushantaror...@gmail.com> wrote: > Is yarn.scheduler.maximum-allocation-vcores the setting for max vcores per > container? > > Whats the setting for max limit of --num-executors ? > > On Tue, Jul 14, 2015 at 11:18 PM, Marcelo Vanzin <van...@cloudera.com> > wrote: > >> On Tue, Jul 14, 2015 at 10:40 AM, Shushant Arora < >> shushantaror...@gmail.com> wrote: >> >>> My understanding was --executor-cores(5 here) are maximum concurrent >>> tasks possible in an executor and --num-executors (10 here)are no of >>> executors or containers demanded by Application master/Spark driver program >>> to yarn RM. >>> >> >> --executor-cores requests cores from YARN. YARN is a resource manager, >> and you're requesting more resources than it has available, so it denies >> your request. If you want to make more than 4 cores available in your NMs, >> you need to change YARN's configuration. >> >> -- >> Marcelo >> > >
