Hi experts, My application is using Apache Beam and with Flink to be the runner. My source and sink are kafka topics, and I am using KafkaIO connector provided by Apache Beam to consume and publish.
I am reading through Beam's java doc: https://beam.apache.org/releases/javadoc/2.16.0/org/apache/beam/sdk/io/kafka/KafkaIO.WriteRecords.html#withEOS-int-java.lang.String- It looks like Beam does not support Flink Runner for EOS: 1. Flink runner is one of the runners whose checkpoint semantics are not compatible with current implementation, in what aspects it is not compatible? 2. For this feature to work, must it enable checkpointing? even given I have no user states within DoFns? 3. Can someone please shad some lights on how to work around this problem? Thanks a lot! Eleanore
