http://spark.apache.org/docs/latest/running-on-yarn.html
Spark just a Yarn application
> 在 2014年8月14日,11:12,牛兆捷 写道:
>
> Dear all:
>
> Does spark can acquire resources from and give back resources to
> YARN dynamically ?
>
>
> --
> *Regards,*
> *Zhaojie*
---
@Crystal
You can use spark on yarn. Yarn have fair scheduler,modified yarn-site.xml.
发自我的 iPad
> 在 2014年8月11日,6:49,Matei Zaharia 写道:
>
> Hi Crystal,
>
> The fair scheduler is only for jobs running concurrently within the same
> SparkContext (i.e. within an application), not for separate appli