Hi Paul, What do you mean by distributing the jars manually? If you register jars that are local to the client with SparkContext.addJars, Spark should handle distributing them to the workers. Are you taking advantage of this?
-Sandy On Tue, Mar 11, 2014 at 3:09 PM, Paul Schooss <paulmscho...@gmail.com>wrote: > Hello Folks, > > I was wondering if anyone had experience placing application jars for > Spark onto HDFS. Currently I have distributing the jars manually and would > love to source the jar via HDFS a la distributed caching with MR. Any > ideas? > > Regards, > > Paul >
