Re: Spark REPL question

2014-04-17 Thread Zhan Zhang
Clear to me now. Thanks. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-REPL-question-tp6331p6335.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

Re: Spark REPL question

2014-04-17 Thread Michael Armbrust
Yeah, I think that is correct. On Thu, Apr 17, 2014 at 2:47 PM, Zhan Zhang wrote: > Thanks a lot. > > By "spins up", do you mean using the same directory, specified by > following? > > /** Local directory to save .class files too */ > val outputDir = { > val tmp = System.get

Re: Spark REPL question

2014-04-17 Thread Zhan Zhang
Thanks a lot. By "spins up", do you mean using the same directory, specified by following? /** Local directory to save .class files too */ val outputDir = { val tmp = System.getProperty("java.io.tmpdir") val rootDir = new SparkConf().get("spark.repl.classdir", tmp)

Re: Spark REPL question

2014-04-17 Thread Michael Armbrust
The REPL spins up an org.apache.spark.HttpServer, which provides classes that are generated by the REPL as well as jars from addJar. Michael On Thu, Apr 17, 2014 at 1:58 PM, Zhan Zhang wrote: > Please help, I am knew to both Spark and scala. > > I am trying to figure out how spark distribute t