Re: [Question] enable end2end Kafka exactly once processing

2020-03-01 Thread Arvid Heise
Hi Eleanore, the flink runner is maintained by the Beam developers, so it's best to ask on their user list. The documentation is, however, very clear. "Flink runner is one of the runners whose checkpoint semantics are not compatible with current implementation (hope to provide a solution in near

[Question] enable end2end Kafka exactly once processing

2020-03-01 Thread Jin Yi
Hi experts, My application is using Apache Beam and with Flink to be the runner. My source and sink are kafka topics, and I am using KafkaIO connector provided by Apache Beam to consume and publish. I am reading through Beam's java doc: https://beam.apache.org/releases/javadoc/2.16.0/org/apache/b