Can you add an ability to set custom yarn labels instead/in addition to? On Feb 9, 2016 3:28 PM, "Jonathan Kelly" <jonathaka...@gmail.com> wrote:
> Oh, sheesh, how silly of me. I copied and pasted that setting name without > even noticing the "mapreduce" in it. Yes, I guess that would mean that > Spark AMs are probably running even on TASK instances currently, which is > OK but not consistent with what we do for MapReduce. I'll make sure we > set spark.yarn.am.nodeLabelExpression appropriately in the next EMR release. > > ~ Jonathan > > On Tue, Feb 9, 2016 at 1:30 PM Marcelo Vanzin <van...@cloudera.com> wrote: > >> On Tue, Feb 9, 2016 at 12:16 PM, Jonathan Kelly <jonathaka...@gmail.com> >> wrote: >> > And we do set yarn.app.mapreduce.am.labels=CORE >> >> That sounds very mapreduce-specific, so I doubt Spark (or anything >> non-MR) would honor it. >> >> -- >> Marcelo >> >
