Re: Deduplicate messages from Kafka topic

2017-01-15 Thread Tzu-Li (Gordon) Tai
vel)? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Deduplicate-messages-from-Kafka-topic-tp11051.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Deduplicate messages from Kafka topic

2017-01-14 Thread ljwagerfield
"idempotent producers" as proposed by Jay Krepps (which, as I understand it, involves maintaining a "high watermark" on a message-by-message level)? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Deduplicate-messages-from