RE: The difference between driver and master in Spark

2014-04-03 Thread Xia, Junluan
Yes, driver is a client. Either single or different machine will be OK for driver and master -Original Message- From: Dan [mailto:zsh912...@gmail.com] Sent: Thursday, April 03, 2014 9:56 PM To: d...@spark.incubator.apache.org Subject: Re: The difference between driver and master in

Re: The difference between driver and master in Spark

2014-04-03 Thread Dan
Can I think driver as client? Driver and master can be located in a single machine or different machines, right? Thanks, Dan -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/The-difference-between-driver-and-master-in-Spark-tp6158p6192.html Sent fro

Re: The difference between driver and master in Spark

2014-03-31 Thread Patrick Wendell
Checkout this page: http://spark.incubator.apache.org/docs/latest/cluster-overview.html On Mon, Mar 31, 2014 at 9:11 AM, Nan Zhu wrote: > master is managing the resources in the cluster, e.g. ensuring all > components can work together, master/worker/driver > > e.g. you have to submit your appl

Re: The difference between driver and master in Spark

2014-03-31 Thread Nan Zhu
master is managing the resources in the cluster, e.g. ensuring all components can work together, master/worker/driver e.g. you have to submit your application with the path: driver -> master -> worker then the driver take most of the responsibility of running your application, e.g. scheduli