Re: Cluster deploy mode driver location

2016-11-22 Thread Masood Krohy
e) Masood -- Masood Krohy, Ph.D. Data Scientist, Intact Lab-R&D Intact Financial Corporation http://ca.linkedin.com/in/masoodkh De :Silvio Fiorito A : "saif.a.ell...@wellsfargo.com" , "user@spark.apache.org" Date : 2016-11-22 08:02 Objet : Re: C

Re: Cluster deploy mode driver location

2016-11-22 Thread Silvio Fiorito
submitting-applications.html#advanced-dependency-management Thanks, Silvio From: saif.a.ell...@wellsfargo.com Sent: Monday, November 21, 2016 2:04:06 PM To: user@spark.apache.org Subject: Cluster deploy mode driver location Hello there, I have a Spark progra

Cluster deploy mode driver location

2016-11-21 Thread Saif.A.Ellafi
Hello there, I have a Spark program in 1.6.1, however, when I submit it to cluster, it randomly picks the driver. I know there is a driver specification option, but along with it it is mandatory to define many other options I am not familiar with. The trouble is, the .jars I am launching need