Hi,
I have a Spark driver process that I have built into a single ‘fat jar’ this
runs fine, in Cygwin, on my development machine,
I can run:
scala -cp my-fat-jar-1.0.0.jar com.foo.MyMainClass
this works fine, it will submit Spark job, they process, all good.
However, on Linux (all Jars Spark(1.4) and Scala version (2.10.5) being the
same), I get this error:
18:59:14.358 [Curator-QueueBuilder-2] ERROR o.a.c.f.r.queue.DistributedQueue -
Exception processing queue item: queue-0000000000
java.lang.NoSuchMethodException:
akka.remote.RemoteActorRefProvider.<init>(java.lang.String,
akka.actor.ActorSystem$Settings, akka.event.EventStream, akka.actor.Scheduler,
akka.act
at java.lang.Class.getConstructor0(Class.java:3082) ~[na:1.8.0_60]
at java.lang.Class.getDeclaredConstructor(Class.java:2178)
~[na:1.8.0_60]
i.e. No such method exception. Can anyone suggest how I can fix this?
I’ve tried changing the scala to java and putting scale-lang on the class path,
but this just generates new errors about missing akka configuration.
Given the identical jars and scala version - I’m not sure why I’m getting this
error running driver on Linux.
Appreciate any help/pointers.
Thanks,
Mike Lewis
