JDBC Drivers need to be on the system classpath.
try passing --jars /path/to/local/mysql-connector.jar when you submit the
job.
this will also copy the jars to each of the worker nodes and should set you
straight.
On Tue, Dec 22, 2015 at 11:42 AM, Igor Berman wrote:
> imho, if you succeeded to
imho, if you succeeded to fetch something from your mysql with same jar in
classpath, then Manifest is ok and you indeed should look at your spark sql
- jdbc configs
On 22 December 2015 at 12:21, David Yerrington wrote:
> Igor, I think it's available. After I extract the jar file, I see a
> dir
Igor, I think it's available. After I extract the jar file, I see a
directory with class files that look very relevant in "/com/mysql/jdbc".
After reading this, I started to wonder if MySQL connector was really the
problem. Perhaps it's something to do with SQLcontext? I just wired a
test endpo
David, can you verify that mysql connector classes indeed in your single
jar?
open it with zip tool available at your platform
another options that might be a problem - if there is some dependency in
MANIFEST(not sure though this is the case of mysql connector) then it might
be broken after prepar
Sure here it is:
import AssemblyKeys._
assemblySettings
// assemblyJarName in assembly := "recommender.jar"
test in assembly := {}
organization := "com.example"
version := "0.1"
scalaVersion := "2.11.6"
scalacOptions := Seq("-unchecked", "-deprecation", "-encoding", "utf8")
library
Can you paste your libraryDependencies from build.sbt ?
./Vijay
> On 22 Dec 2015, at 06:12, David Yerrington wrote:
>
> Hi Everyone,
>
> I'm building a prototype that fundamentally grabs data from a MySQL instance,
> crunches some numbers, and then moves it on down the pipeline. I've been
>
Hi Everyone,
I'm building a prototype that fundamentally grabs data from a MySQL
instance, crunches some numbers, and then moves it on down the pipeline.
I've been using SBT with assembly tool to build a single jar for deployment.
I've gone through the paces of stomping out many dependency proble
