Re: NoClassDefFoundError with ElasticsearchSink on Yarn

2016-09-09 Thread Fabian Hueske
> on the artefact that gets deployed on flink. >>> >>> What this practically does is to shade the guava dependencies. Instead >>> of containing references to com.google.common your build will reference >>> shaded.com.google.common and as a result it will use the

Re: NoClassDefFoundError with ElasticsearchSink on Yarn

2016-09-09 Thread Robert Metzger
with external deps shading stuff (something >> you have to do when using guava, joda, jackson etc). >> >> Let me know if this helped. >> >> Aris >> >> >> *From:* Steffen Hausmann

Re: NoClassDefFoundError with ElasticsearchSink on Yarn

2016-09-05 Thread Steffen Hausmann
c). Let me know if this helped. Aris *From:* Steffen Hausmann *Sent:* Thursday, September 1, 2016 8:58 AM *To:* user@flink.apache.org *Subject:* NoClassDefFoundError with ElasticsearchSink on Yarn Hi there, I’m run

Re: NoClassDefFoundError with ElasticsearchSink on Yarn

2016-09-01 Thread aris kol
ber 1, 2016 8:58 AM To: user@flink.apache.org Subject: NoClassDefFoundError with ElasticsearchSink on Yarn Hi there, I'm running a flink program that reads from a Kinesis stream and eventually writes to an Elasticsearch2 sink. When I'm running the program locally from the IDE, everything seems to work

Re: NoClassDefFoundError with ElasticsearchSink on Yarn

2016-09-01 Thread Fabian Hueske
Hi Steffen, this looks like a Guava version mismatch to me. Are you running exactly the same program on your local machine or did you add dependencies to run it on the cluster (e.g. Kinesis). Maybe Kinesis and Elasticsearch are using different Guava versions? Best, Fabian 2016-09-01 10:45 GMT+02

NoClassDefFoundError with ElasticsearchSink on Yarn

2016-09-01 Thread Steffen Hausmann
Hi there, I’m running a flink program that reads from a Kinesis stream and eventually writes to an Elasticsearch2 sink. When I’m running the program locally from the IDE, everything seems to work fine, but when I’m executing the same program on an EMR cluster with Yarn, a NoClassDefFoundError

NoClassDefFoundError with ElasticsearchSink on Yarn

2016-09-01 Thread Hausmann, Steffen
Hi there, I’m running a flink program that reads from a Kinesis stream and eventually writes to an Elasticsearch2 sink. When I’m running the program locally from the IDE, everything seems to work fine, but when I’m executing the same program on an EMR cluster with Yarn, a NoClassDefFoundError