Re: ElasticSearch 6 - error with UpdateRequest

2018-08-31 Thread Timo Walther
The problem is that BulkProcessorIndexer is located in flink-connector-elasticsearch-base which is compiled against a very old ES version. This old version is source code compatible but apparently not binary compatible with newer Elasticsearch classes. By copying this class you force to compile

Re: ElasticSearch 6 - error with UpdateRequest

2018-08-31 Thread Averell
Hi Timo, Thanks for your help. I don't get that error anymore after putting that file into my project. However, I don't understand how it could help. I have been using the Flink binary built on my same laptop, then how could it be different between having that java class in Flink project vs in my

Re: ElasticSearch 6 - error with UpdateRequest

2018-08-30 Thread Timo Walther
Hi Averell, sorry for my wrong other mail. I also observed this issue when implementing FLINK-3875. Currently, update requests are broken due to a binary incompatibility. I already have a fix for this in a different branch. I opened FLINK-10269 [1] to track the issue. As a work around you c

Re: ElasticSearch 6 - error with UpdateRequest

2018-08-30 Thread Timo Walther
Hi, thanks for your feedback. I agree that the the current interfaces are not flexible enough to fit to every use case. The unified connector API is a a very recent feature that still needs some polishing. I'm working on a design document to improve the situation there. For now, you can simp

ElasticSearch 6 - error with UpdateRequest

2018-08-30 Thread Averell
Good day everyone, I tried to send UpdateRequest(s) to ElasticSearch6, and I got the following error: Caused by: java.lang.NoSuchMethodError: org.elasticsearch.action.bulk.BulkProcessor.add(Lorg/elasticsearch/action/ActionRequest;)Lorg/elasticsearch/action/bulk/BulkProcessor; at org.apach

Re: ElasticSearch 6

2017-11-24 Thread Fabian Hueske
Hi Fritz, the ElasticSearch connector has not been updated for ES6 yet. There is a JIRA issue [1] to add support for ES6 and somebody working on it as it seems. Best, Fabian [1] https://issues.apache.org/jira/browse/FLINK-8101 2017-11-18 2:24 GMT+01:00 Fritz Budiyanto : > Hi, > > I've tried Fl

Re: ElasticSearch 6

2017-11-17 Thread Fritz Budiyanto
Hi, I've tried Flink with ES6, and its causing exception thrown in ES6. Is the fix just matter of bumping es client version to 5.6 ? Could anyone familiar with ES connector confirm ? If this is just a matter of bumping the es client version, can we have this simple change in Flink 1.4 ? Thanks,

ElasticSearch 6

2017-11-15 Thread Fritz Budiyanto
Hi All, ES6 is GA today, and I wonder if Flink-ES5 connector fully support ES6 ? Any caveat we need to know ? Thanks, Fritz