Re:Elasticsearch source

2023-11-14 Thread Xuyang
Hi, Tauseef. Currently flink community only supports sink and look up source for ES, but you can follow this JIRA[1] that supports ES source. [1] https://issues.apache.org/jira/browse/FLINK-25568 -- Best! Xuyang At 2023-11-15 14:33:53, "Tauseef Janvekar" wrote: Dear Team

Re: Elasticsearch source

2023-11-14 Thread Junrui Lee
Hi Tauseef, AFAIK, Flink does not support ElasticSearch as a source connector. It only supports ElasticSearch as a sink connector. Best regards, Junrui Tauseef Janvekar 于2023年11月15日周三 14:36写道: > Dear Team, > > We were looking for some elasticsearch source connector for flink and I > could not

Java 17 as default

2023-11-14 Thread Tauseef Janvekar
Dear Team, I saw the documentation for 1.18 and Java 17 is not supported and the image is created from Java11. I guess there is separate docker image for java_17. When do we plan to release main image with Java 17. Thanks, Tauseef

Elasticsearch source

2023-11-14 Thread Tauseef Janvekar
Dear Team, We were looking for some elasticsearch source connector for flink and I could not get any example though. Is it possible to read from elasticsearch, technically it is not streaming but somehow it should be supported as we want some transformation logic based on elastic entries. Any he

Re: unsubscribe

2023-11-14 Thread Yuxin Tan
Hi, Ralph, Please send an email to user-unsubscr...@flink.apache.org to unsubscribe the user mailing list. [1] [1] https://flink.apache.org/what-is-flink/community/ Best, Yuxin Ralph Matthias Debusmann 于2023年11月15日周三 06:18写道: > >

Re: unsubscribe

2023-11-14 Thread Junrui Lee
Hi, Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org. Ralph Matthias Debusmann 于2023年11月15日周三 07:29写道: > >

unsubscribe

2023-11-14 Thread Ralph Matthias Debusmann

Re: Kafka Topic Permissions Failure

2023-11-14 Thread Razin Bouzar via user
Hey Hang, We may have encountered a bug. It seems like deleting the job and redeploying "fixed" the issue. We will work on recreating this scenario and will follow-up at some point. On Mon, Nov 13, 2023 at 3:35 AM Hang Ruan wrote: > Hi, Razin. > > It seems like the issue you shared is a differe

Re: Apache Flink + Java 17 error module

2023-11-14 Thread xiangyu feng
Hi Patricia, Try to use this: --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED Regards, Xiangyu patricia lee 于2023年11月14日周二 15:43写道: > Hi, > > > I upgraded the project to Flink 1.18.0 and Java 17. I am also using > flink-kafka-connector 3.0.1-1.18 from

Re: dependency error with latest Kafka connector

2023-11-14 Thread Alexis Sarda-Espinosa
Isn't it expected that it points to 1.17? That version of the Kafka connector is meant to be compatible with both Flink 1.17 and 1.18, right? So the older version should be specified so that the consumer can decide which Flink version to compile against, otherwise the build tool could silently upda

The generated schema is not correct when using filesystem connector and avro format

2023-11-14 Thread julia bogdan
Hi! I'm facing an issue with the output schema for FileSystemTableSink. In FileSystemTableSink#createWriter (FileSystemTableSink.java#L29

Re: dependency error with latest Kafka connector

2023-11-14 Thread Alexey Novakov via user
Hi Günterh, It looks like a problem with the Kafka connector release. https://mvnrepository.com/artifact/org.apache.flink/flink-connector-kafka/3.0.1-1.18 Compile dependencies are still pointing to Flink 1.17. Release person is already contacted about this or will be contacted soon. Best regards