Thanks Ted, I think I was able to resolve this issue without modifying
spark by setting a relocation for jackson in my shaded jar.
On Tue, Jan 26, 2016 at 12:11 PM, Ted Yu wrote:
> Then maybe changing the following in pom.xml to 2.7.0 and rebuild Spark ?
>
> 2.5.3
>
> On Tue, Jan 26, 2016 at
Then maybe changing the following in pom.xml to 2.7.0 and rebuild Spark ?
2.5.3
On Tue, Jan 26, 2016 at 11:53 AM, asdf zxcv
wrote:
> Hmm, this did not seem to resolve the issue. I also tried adding a
> relocation for jackson as well.
>
> On Tue, Jan 26, 2016 at 10:09 AM, Ted Yu wrote:
>
>>
Hmm, this did not seem to resolve the issue. I also tried adding a
relocation for jackson as well.
On Tue, Jan 26, 2016 at 10:09 AM, Ted Yu wrote:
> I wonder if the following change would solve the problem you described (by
> shading jackson.core):
>
> diff --git a/pom.xml b/pom.xml
> index fb77
w this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/NoSuchMethod-from-transitive-dependency-jackson-databind-in-MaxMind-GeoIP2-tp26077.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---
I wonder if the following change would solve the problem you described (by
shading jackson.core):
diff --git a/pom.xml b/pom.xml
index fb77506..32a3237 100644
--- a/pom.xml
+++ b/pom.xml
@@ -2177,6 +2177,7 @@
org.eclipse.jetty:jetty-util
org.eclipse.jetty:jetty-server
Hi all,
I'm trying to run MaxMind GeoIP2 in a Spark task, but get a runtime error
at init due to a NoSuchMethodError for ArrayNode from
com.fasterxml.jackson.core:jackson-databind.
This succeeds locally in unit tests, but fails in Spark tasks.
I've excluded jackson-databind from all other depende