Re: Applications for Spark on HDFS

2014-03-11 Thread Paul Schooss
Thanks Sandy, I have not taken advantage of that yet but will research how to invoke that option when submitting the application to the spark master. Currently I am running a standalone spark master and using the run-class script to invoke the application we crafted as a test. On Tue, Mar 11, 20

Re: Applications for Spark on HDFS

2014-03-11 Thread Sandy Ryza
Hi Paul, What do you mean by distributing the jars manually? If you register jars that are local to the client with SparkContext.addJars, Spark should handle distributing them to the workers. Are you taking advantage of this? -Sandy On Tue, Mar 11, 2014 at 3:09 PM, Paul Schooss wrote: > Hell