If you add jars after the sparkcontext is created, its too late as the driver
and executor processes (distributed) or threads (local) would have already been
setup.
From: Ankit Agrahari
Date: Tuesday, March 20, 2018 at 11:34 PM
To:
Subject: "Spark.jars not adding jars to classpath"
I
I am trying to add my custom jar in spark job using "spark.jars" property.
Although I can read the info in logs of jar getting added but when I check
the jars that are added to class path, I doesn't find it.Below are the
functions that I also have tried it out.
1)spark.jars
2)spark.driver.extraLibr