Here's my code (loaded the required jar using %dep):
import sys.process._
import test.{testData1,QueryData}
import com.stratio.deep.mongodb._
QueryData.statusCheck() //*goes through fine*
val readConfig = QueryData.runMongoJob() //*goes through fine*
val rdd = sqlContext.fromMongoDB(readConfig) //*fails*
rdd.registerTempTable("metadata").
"val rdd = sqlContext.fromMongoDB(readConfig)"
OR
QueryData.OtherMethod(sc, sqlContext):
Any of the above two attempts with sc/sqlContext throws the following
exception:
org.apache.spark.SparkException: Job aborted due to stage failure: Task 0
in stage 9.0 failed 1 times, most recent failure: Lost task 0.0 in stage
9.0 (TID 4, localhost): java.io.IOException: Server returned HTTP response
code: 504 for URL: http://<mysystemurl>/jars/Query-1.0.jar
