Hello
My spark based map tasks needs to access third party jar files. I found
below options to submit third party jar files to spark interpreter
1. export SPARK_SUBMIT_OPTIONS=<all the jar files with comma seprated> in
conf/zeppelin-env.sh
2. include the statement spark.jars <all the jar files with comma
separated> in <spark>?conf/spark-defaults.conf
3. use the z.load("the location of jar file in the local filesystem") in
zepelin notebook
I could test the first two and they both works fine. The third one does not
work. Here is the snippet i use
%dep
z.reset()
z.load("file:///home/bala/Projects/pocv8.new/mapreduce/build/libs/mapreduce.jar")
Further, the import of class belongs to the above jar file is working when
I use the statement import com..... in zeppelin notebook. However, I get
the class not found exception in the executor for the same class.
Any clue here would help greatly
regards
Bala
