Re: Elasticsearch connector support?

2023-11-27 Thread Lasse Nedergaard
Hi HangThanks for the link. I will wait for 3.1 connector release and hope it will be included. Med venlig hilsen / Best regardsLasse NedergaardDen 27. nov. 2023 kl. 12.00 skrev Hang Ruan :Hi, Lasse.There is already a discussion about the connector releases for 1.18[1].Best,Hang[1] https://lists.a

Re: Elasticsearch connector support?

2023-11-27 Thread Hang Ruan
Hi, Lasse. There is already a discussion about the connector releases for 1.18[1]. Best, Hang [1] https://lists.apache.org/thread/r31f988m57rtjy4s75030pzwrlqybpq2 Lasse Nedergaard 于2023年11月24日周五 22:57写道: > Hi > > From the documentation I can see there isn’t any ES support in Flink 1.18 > righ

Re: Elasticsearch Connector 1.17 not on maven central.

2023-04-13 Thread Ruibin Xing
Thanks! On Fri, Apr 14, 2023 at 9:00 AM Shammon FY wrote: > Hi Ruibin > > I checked the maven central repository and found that there are no > versions 3.0.0-1.17 of flink-connector-elasticsearch6 and flink-connector- > elasticsearch7 available in > https://nightlies.apache.org/flink/flink-docs-

Re: Elasticsearch Connector 1.17 not on maven central.

2023-04-13 Thread Shammon FY
Hi Ruibin I checked the maven central repository and found that there are no versions 3.0.0-1.17 of flink-connector-elasticsearch6 and flink-connector- elasticsearch7 available in https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/datastream/elasticsearch/. I have created a

Re: ElasticSearch Connector

2019-01-16 Thread Dawid Wysakowicz
Hi Ramya, I think the problem is that you access the serializationSchema from the closure of ElasticsearchSinkFunction. Try creating ElasticsearchSinkFunction that will get the serializationSchema in ctor. If this is not the problem could you share the full stack of the error? Best, Dawid On 16

Re: ElasticSearch Connector for version 6.x and scala 2.11

2018-01-04 Thread Nico Kruber
Actually, Flink's netty dependency (4.0.27) is shaded away into the "org.apache.flink.shaded.netty4.io.netty" package now (since version 1.4) and should thus not clash anymore. However, other netty versions may come into play from the job itself or from the integration of Hadoop's classpath (if ava

Re: ElasticSearch Connector for version 6.x and scala 2.11

2017-12-01 Thread Jens Oberender
Hi A workmate of mine tried to migrate the existing flink connector to ElasticSearch 6 but we had problems with netty dependencies that clashed (Flink uses 4.0.27 and ES is on 4.1). You can change the flink-connector-elasticsearch5 connector to ES 5.6.4, but then you have to do some adaptions to g

Re: ElasticSearch Connector for version 6.x and scala 2.11

2017-12-01 Thread Fabian Hueske
Hi Rahul, Flink does not provide a connector for ElasticSearch 6 yet. There is this JIRA issue to track the development progress [1]. Best, Fabian [1] https://issues.apache.org/jira/browse/FLINK-8101 2017-12-01 7:22 GMT+01:00 Rahul Raj : > Hi All, > > Is there a Flink Elastic search connector

Re: Elasticsearch connector and number of shards

2016-08-25 Thread Flavio Pompermaier
I've just added a JIRA improvement ticket for this ( https://issues.apache.org/jira/browse/FLINK-4491). Best, Flavio On Wed, Jul 20, 2016 at 4:21 PM, Maximilian Michels wrote: > The connector doesn't cover this use case. Through the API you need to > use the IndicesAdminClient: > https://www.el

Re: Elasticsearch connector and number of shards

2016-07-20 Thread Maximilian Michels
The connector doesn't cover this use case. Through the API you need to use the IndicesAdminClient: https://www.elastic.co/guide/en/elasticsearch/client/java-api/current/java-admin-indices.html Otherwise Elasticsearch creates an index with shards automatically. We could add support for configuring

Re: Elasticsearch connector and number of shards

2016-07-18 Thread Flavio Pompermaier
Indeed, we've tried with the parameter *index.number_of_shards* but it didn't work so I fear that this parameter is not handled by the current implementation..am I wrong? On Mon, Jul 18, 2016 at 11:37 AM, Ufuk Celebi wrote: > I've never used the Elasticsearch sink, but the docs say: > > "Note ho

Re: Elasticsearch connector and number of shards

2016-07-18 Thread Ufuk Celebi
I've never used the Elasticsearch sink, but the docs say: "Note how a Map of Strings is used to configure the Sink. The configuration keys are documented in the Elasticsearch documentationhere. Especially important is the cluster.name parameter that must correspond to the name of your cluster." T

Re: Elasticsearch Connector

2016-06-16 Thread Till Rohrmann
Hi Eamon, in order to use the snapshot binaries you have to add the snapshot repository to your pom.xml: apache.snapshots Apache Development Snapshot Repository https://repository.apache.org/content/repositories/snapshots/ false true Cheers, Till