[ 
https://issues.apache.org/jira/browse/FLINK-13025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928149#comment-16928149
 ] 

Leonid Ilyevsky commented on FLINK-13025:
-----------------------------------------

[~aljoscha] I doubt that you can create one "modern" connector. Even though 7.x 
connector can probably be created from 6.x with few small changes, it will be 
still a different library. Elasticsearch 7 has some changes that are not quite 
compatible with 6.x, as was mentioned before.

The best example, again, is the 'type' element, which is mandatory in 6.x and 
deprecated in 7.x. While it is only deprecated, you cannot really send it to 
7.x server because of essential performance penalty.

This means that 7.x connector should use Elasticsearch 7  client library, which 
allows documents without 'type'. Obviously, it will not be compatible with 
older servers.

The good news is that such compatibility is not even required. There will be no 
use case when 6.x client needs to talk to 7.x server or vice versa, for two 
reasons: 1) Elasticsearch requires clients to use library from the same major 
version as the server 2) Everybody even needs to make changes to their own 
client code, specifically removing that 'type' field.

As I mentioned before, I have Elasticsearch installed and I can test the 
connector as soon as you have some beta version.

 

> Elasticsearch 7.x support
> -------------------------
>
>                 Key: FLINK-13025
>                 URL: https://issues.apache.org/jira/browse/FLINK-13025
>             Project: Flink
>          Issue Type: New Feature
>          Components: Connectors / ElasticSearch
>    Affects Versions: 1.8.0
>            Reporter: Keegan Standifer
>            Priority: Major
>
> Elasticsearch 7.0.0 was released in April of 2019: 
> [https://www.elastic.co/blog/elasticsearch-7-0-0-released]
> The latest elasticsearch connector is 
> [flink-connector-elasticsearch6|https://github.com/apache/flink/tree/master/flink-connectors/flink-connector-elasticsearch6]



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to