Piotr Nowojski created FLINK-11038:
--------------------------------------

             Summary: Rewrite Kafka at-least-once it cases
                 Key: FLINK-11038
                 URL: https://issues.apache.org/jira/browse/FLINK-11038
             Project: Flink
          Issue Type: Bug
          Components: Kafka Connector
    Affects Versions: 1.7.0
            Reporter: Piotr Nowojski


Currently they are using {{NetworkFailuresProxy}} which is unstable both for 
Kafka 0.11 in exactly once mode (in 50% tests are live locking) and for Kafka 
2.0.

Those tests should either be rewritten to SIGKILL Flink's process doing the 
writing. Either as an ITCase SIGKILL-ing task manager or test harness 
SIGKILL-ing/exiting test harness process.

We can not simply use test harness and do not close it to simulate failure, 
because we want to make sure that we have flushed the records during 
checkpoint. If we do not SIGKILL the process, the background Kafka client's 
threads can just send those records for us.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to