First of all, thanks for your time and quick response. I'm not completely sure I understood your example, but is this what you mean:
- Sink processes A, B, C - Checkpoint persisted with A, B, C - Notify checkpoint starts - Notify checkpoints ACKs A - Notify checkpoints ACKs B - Job crashes - Job resumes from checkpoint with A, B, C - Job will re-process C because it was not ACK'ed Was this it? On a non-failure scenario (e.g.: asking the job to stop) the job wouldn't finish before the notify is complete, even though it's asynchronous: - Sink processes A, B, C - Checkpoint persisted with A, B, C - Notify checkpoint starts - Notify checkpoints ACKs A - Notify checkpoints ACKs B - Job asked to stop - Job waiting for notify to end - Notify checkpoints ACKs C - Job stops This seems to be the behaviour of Kafka09Fetcher + KafkaConsumerThread, or is there anything I'm overlooking? -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
