Re: "Spark.jars not adding jars to classpath"

2018-03-22 Thread Thakrar, Jayesh
If you add jars after the sparkcontext is created, its too late as the driver and executor processes (distributed) or threads (local) would have already been setup. From: Ankit Agrahari Date: Tuesday, March 20, 2018 at 11:34 PM To: Subject: "Spark.jars not adding jars to classpath" I

"Spark.jars not adding jars to classpath"

2018-03-20 Thread Ankit Agrahari
I am trying to add my custom jar in spark job using "spark.jars" property. Although I can read the info in logs of jar getting added but when I check the jars that are added to class path, I doesn't find it.Below are the functions that I also have tried it out. 1)spark.jars 2)spark.driver.extraLibr