Re:FLINK CONNECTOR 1.18 and Kafka 2.7

2023-11-09 Thread Xuyang
Hi, the download link about kafka connector used for flink 1.18 is wrong, and this is the corresponding issue[1]. You can use the version '3.0.1-1.18' directly in maven repo[2] to work around. [1] https://issues.apache.org/jira/browse/FLINK-33512 [2] https://repo.maven.apache.org/maven2/org/ap

Re: FLINK CONNECTOR 1.18 and Kafka 3.4.1

2023-11-09 Thread patricia lee
Hi, I used the 3.0.1-1.18 connector flink 1.18.0 but it seems the *OffsetResetStrategy* no longer exists. Is there any way we can achieve the same startingoffset reset strategy in flink? E.g. (Kafka connector 1.17.1) kafka.setStartingOffsets(OffsetsInitializer.committedOffsets( *OffsetResetStra

Re: Flink-1.18 mvn test error

2023-11-09 Thread Yuxin Tan
Hi, zhao, IIRC, it seems that the error occurred because you ran the test before packaging. While running in flink-clients/pom.xml, maven can not find the packages. Based on your command, it seems that you want to run the tests. Have you tried running "mvn clean package" or "mvn clean install" d

Re: FLINK CONNECTOR 1.18 and Kafka 2.7

2023-11-09 Thread Junrui Lee
Hi, The externalized Flink Kafka connector v3.0.1 uses Kafka 3.2.3, see https://github.com/apache/flink-connector-kafka/blob/ea4fac3966c84f4cae8b80d70873254f03b1c333/pom.xml#L53 And you can download it from here: https://flink.apache.org/downloads/#apache-flink-kafka-connector-301 Best, Junrui

Profiling on flink jobs

2023-11-09 Thread Oscar Perez via user
hi [image: :wave:] I am trying to do profiling on one of our flink jobs according to these docs: https://nightlies.apache.org/flink/flink-docs-master/docs/ops/debugging/application_profiling/We are using OpenJDK 8.0. I am adding this line to the flink properties file in docker-compose: env.java.o

FLINK CONNECTOR 1.18 and Kafka 2.7

2023-11-09 Thread patricia lee
Hi, I am upgrading my project to Flink 1.18 but seems kafka connector 1.18.0 not available yet? I couldn't pull the jar file flink-kafka-connector. But when I check on mvn repo the versions available were: 3.0.1-1.18 3.0.1-1.17 But on the documentation it says -1.18 Questions: 1. Is 3.0.1-1.18