, so Im
> thinking I can somehow use this if --jars doesn’t work.
>
> Really I need to understand how the spark class path is set when running
> on YARN.
>
>
> From: "ÐΞ€ρ@Ҝ (๏̯͡๏)"
> Date: Thursday, 16 April 2015 3:02 pm
> To: Nathan
> Cc: "user@spar
tium.com.au>>
Cc: "user@spark.apache.org<mailto:user@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: Re: SparkSQL JDBC Datasources API when running on YARN - Spark 1.3.0
Can you provide the JDBC connector jar version. Possibly the full JAR name and
full command y
From: Nathan
> Date: Wednesday, 15 April 2015 1:57 pm
> To: "user@spark.apache.org"
> Subject: SparkSQL JDBC Datasources API when running on YARN - Spark 1.3.0
>
> Hi guys,
>
> Trying to use a Spark SQL context’s .load(“jdbc", …) method to create a
> DF f
mailto:nathan.mccar...@quantium.com.au>>
Date: Wednesday, 15 April 2015 11:49 pm
To: "Wang, Daoyuan" mailto:daoyuan.w...@intel.com>>,
"user@spark.apache.org<mailto:user@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: RE: SparkSQL JDBC Datasources A
g
Subject: RE: SparkSQL JDBC Datasources API when running on YARN - Spark 1.3.0
Can you provide your spark version?
Thanks,
Daoyuan
From: Nathan McCarthy [mailto:nathan.mccar...@quantium.com.au]
Sent: Wednesday, April 15, 2015 1:57 PM
To: Nathan McCarthy; user@spark.apache.org
Subject: Re: Spar
Can you provide your spark version?
Thanks,
Daoyuan
From: Nathan McCarthy [mailto:nathan.mccar...@quantium.com.au]
Sent: Wednesday, April 15, 2015 1:57 PM
To: Nathan McCarthy; user@spark.apache.org
Subject: Re: SparkSQL JDBC Datasources API when running on YARN - Spark 1.3.0
Just an update
Just an update, tried with the old JdbcRDD and that worked fine.
From: Nathan
mailto:nathan.mccar...@quantium.com.au>>
Date: Wednesday, 15 April 2015 1:57 pm
To: "user@spark.apache.org<mailto:user@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: SparkS
Hi guys,
Trying to use a Spark SQL context’s .load(“jdbc", …) method to create a DF from
a JDBC data source. All seems to work well locally (master = local[*]), however
as soon as we try and run on YARN we have problems.
We seem to be running into problems with the class path and loading up the
