when using spark-submit: which directory contains third party libraries that will be loaded on each of the slaves? I would like to scp one or more libraries to each of the slaves instead of shipping the contents in the application uber-jar.
Note: I did try adding to $SPARK_HOME/lib_managed/jars. But the spark-submit still results in a ClassNotFoundException for classes included in the added library.
