Re: unclear exception when writing to elasticsearch

2017-03-02 Thread Martin Neumann
Hej, I finally found out what the problem was. I had added another dependency that was necessary to run things on hops for some reason that broke things. When I remove it, it works fine. I talking to the hops guys about it to understand what's going on. Thanks for the help. Cheers Martin On We

Re: unclear exception when writing to elasticsearch

2017-03-01 Thread Tzu-Li (Gordon) Tai
Hi Martin, I followed your setup: 1. Maven java quick start archetype (Flink version 1.1.3) 2. Added `flink-connector-elasticsearch2_2.10` version 1.1.3 dependency 3. Ran the example in the Flink Elasticsearch docs against a Elasticsearch 2.4.1 installation and everything worked fine. Just to

Re: unclear exception when writing to elasticsearch

2017-03-01 Thread Tzu-Li (Gordon) Tai
Hi Martin, Just letting you know I’m trying your setup right now, and will get back to you once I confirm the results. - Gordon On March 1, 2017 at 9:15:16 PM, Martin Neumann (mneum...@sics.se) wrote: I created the project using the maven archetype so I'm using the packaged version pulled by

Re: unclear exception when writing to elasticsearch

2017-03-01 Thread Martin Neumann
I created the project using the maven archetype so I'm using the packaged version pulled by maven. At this point, I just try to run it directly from inside the IDE (IntelliJ), mostly since I don't wan

Re: unclear exception when writing to elasticsearch

2017-03-01 Thread Flavio Pompermaier
Did you build Flink from sources or are you using the packeged version? Because I had an annoying problem when compiling Flink with maven > 3.3. >From https://ci.apache.org/projects/flink/flink-docs- release-1.2/setup/building.html#dependency-shading: Maven 3.0.x, 3.1.x, and 3.2.x It is sufficient

Re: unclear exception when writing to elasticsearch

2017-03-01 Thread Martin Neumann
I tried to change the elastic search version to 2.4.1 which results in a new exception: Caused by: java.lang.NoSuchMethodError: > com.google.common.util.concurrent.MoreExecutors.directExecutor()Ljava/util/concurrent/Executor; > at org.elasticsearch.threadpool.ThreadPool.(ThreadPool.java:192) > at

Re: unclear exception when writing to elasticsearch

2017-02-28 Thread Tzu-Li (Gordon) Tai
Hi Martin, You can do that by adding a dependency to the Elasticsearch client of your desired version in your project. You can also check what Elasticsearch client version the project is using by checking `mvn dependency:tree` from the base directory of your project. Cheers, Gordon On March 1

Re: unclear exception when writing to elasticsearch

2017-02-28 Thread Martin Neumann
Hej, thanks for the fast reply. I'm currently running things from inside my IDE so it should not be a packaging problem. That said I added the plugin from the link provided but I'm not sure what elastic search library is needed. Where do I override the elastic search version? The only thing I'm

Re: unclear exception when writing to elasticsearch

2017-02-28 Thread Tzu-Li (Gordon) Tai
Hi! This could be a Elasticsearch server / client version conflict, or that the uber jar of your code wasn’t built properly. For the first possible issue, we’re currently using Elasticsearch 2.3.5 to build the Flink Elasticsearch Connector. Could you try overriding this version to 2.4.1 when b

unclear exception when writing to elasticsearch

2017-02-28 Thread Martin Neumann
Hej, I'm trying to write to elastic search from a streaming application and I get a weird error message I that I can't decipher. Hopefully, someone here can help me. I'm trying to run the java example