Checkout this page: http://spark.incubator.apache.org/docs/latest/cluster-overview.html
On Mon, Mar 31, 2014 at 9:11 AM, Nan Zhu <zhunanmcg...@gmail.com> wrote: > master is managing the resources in the cluster, e.g. ensuring all > components can work together, master/worker/driver > > e.g. you have to submit your application with the path: driver -> master > -> worker > > then > > the driver take most of the responsibility of running your application, > e.g. scheduling jobs/tasks > > the driver is more like a user-facing component, while master is more > transparent to the user > > Best, > > -- > Nan Zhu > > > On Monday, March 31, 2014 at 10:48 AM, Dan wrote: > > > Hi, > > > > I've been recently reading spark code and confused about driver and > > master. What's the difference between them? > > > > When I run spark in standalone cluster, from the log it seems that the > > driver has not been launched. > > > > Thanks, > > Dan > > > > > > > > > > -- > > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/The-difference-between-driver-and-master-in-Spark-tp6158.html > > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com (http://Nabble.com). > > > > > > >
