Re: Path of jars added to a Spark Job - spark-submit // // Override jars in spark submit

2020-11-12 Thread Dominique De Vito
use a jar specified by --jars to be in driver-class-path, since the >> driver is already started and it's classpath is already set before any jars >> are moved. >> >> Some distributions may change this behavior though, but this is the jist >> of it. >> >>

Re: Path of jars added to a Spark Job - spark-submit // // Override jars in spark submit

2020-11-12 Thread Dominique De Vito
s-path, since the > driver is already started and it's classpath is already set before any jars > are moved. > > Some distributions may change this behavior though, but this is the jist > of it. > > On Thu, Nov 12, 2020 at 10:02 AM Dominique De Vito > wrote: > >&

Path of jars added to a Spark Job - spark-submit // // Override jars in spark submit

2020-11-12 Thread Dominique De Vito
Hi, I am using Spark 2.1 (BTW) on YARN. I am trying to upload JAR on YARN cluster, and to use them to replace on-site (alreading in-place) JAR. I am trying to do so through spark-submit. One helpful answer https://stackoverflow.com/questions/37132559/add-jars-to-a-spark-job-spark-submit/3734823