I wonder if the following change would solve the problem you described (by shading jackson.core):
diff --git a/pom.xml b/pom.xml index fb77506..32a3237 100644 --- a/pom.xml +++ b/pom.xml @@ -2177,6 +2177,7 @@ <include>org.eclipse.jetty:jetty-util</include> <include>org.eclipse.jetty:jetty-server</include> <include>com.google.guava:guava</include> + <include>com.fasterxml.jackson.core</include> </includes> </artifactSet> <relocations> Cheers On Tue, Jan 26, 2016 at 9:34 AM, asdf zxcv <benjamin.ha...@gmail.com> wrote: > Hi all, > > I'm trying to run MaxMind GeoIP2 in a Spark task, but get a runtime error > at init due to a NoSuchMethodError for ArrayNode from > com.fasterxml.jackson.core:jackson-databind. > This succeeds locally in unit tests, but fails in Spark tasks. > > I've excluded jackson-databind from all other dependencies, including > Spark, since MaxMind is using the latest version of jackson-databind > (2.7.0). > > `mvn dependency:tree` shows no conflicts for jackson-databind. There are > numerous conflicts with other jackson utilities from org.codehaus, but this > shouldn't be a problem since it is in a different namespace, right? > > I think this may be a problem with the shaded jar produced by > maven-shade-plugin 2.4. Here is the config from pom.xml: > pastebin.com/QzrhM5Ee > > `jar tvf shaded.jar` yields an entry for the missing class, > com/fasterxml/jackson/databind/node/ArrayNode.class. > META-INF/maven/com.fasterxml.jackson.core/jackson-databind/pom.xml has > the correct version, 2.7.0. The shaded jar expanded jackson-databind into > its constituent *.class files instead of providing the jar itself; is this > normal? > > My other thought is there is some issue with the classpath. Is it > sufficient that the shaded jar contains the jackson-databind *.class files? > How else can I investigate this? I know that GeoIP databse init succeeds > locally with the jackson-databind jar in ~/.m2/ > > I've seen numerous issues with jackson-databind due to Spark using an old > version and not shading this particular dependency, but this seems to have > been resolved. I'm currently using version 1.3.1 and get the same result > bumping the version to 1.6.0 > > More detail here: > https://stackoverflow.com/questions/34958520/nosuchmethodexception-in-maxmind-geoip-dependency-jackson-databind-built-with-mv > > > Thanks, > > Ben >