Hi Team

Assume that we have a job (Checkpoint enabled) with Kafka source and a
stateless operator which consumes events from Kafka source.
We have a stream of records 1, 2, 3, 4, 5,...Let's say the event 1 reaches
the Flat Map operator and is being processed. Then the Kafka source has
made a successful checkpoint.
In this case, does the offset of event 1 will be part of the checkpoint?
Will Flink track the event from source to all downstream operators? If
this is a true case and If the processing of the event is failed (any third
party API/DB failure) in the Flat Map after a successful checkpoint, do we
need to manually re-process (retry using queue or any other business logic)
the event?

Job:
Kafka Source -> Flat Map

Thank you

-- 
Raghavendar T S
www.teknosrc.com

<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
Virus-free.
www.avast.com
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

Reply via email to