Is it possible to pass "-javaagent=customAgent.jar" into spark as a JAVA_OPTS

Hi, I'm interested in passing an agent that will expose jmx metrics from spark to my agent. I wanted to know if anyone has tried this and if so what environment variable do I need to set ? Do I set: $SPARK_DAEMON_JAVA_OPTS ?? http://docs.oracle.com/javase/7/docs/api/java/lang/instrument/package-

Question about using collaborative filtering in MLlib

Hi, I'm using the Java Api for Dataframe api for Spark-Mllib. Should I be using the RDD api instead as I'm not sure if this functionality has been ported over to dataframes, correct me if I'm wrong. My goal is to evaluate spark's recommendation capabilities. I'm looking at this example: http://s

Interesting in contributing to spark

Hi, I'd like to introduce myself. My name is Zak and I'm a software engineer. I'm interested in contributing to spark as a way to learn more. I've signed up to the mailing list and hope to learn more about spark. What do you recommend I start on as my first bug ? I have a working knowledge of scal