This should be supported in 1.14 if you enable checkpointing with
finished tasks[1], which has been added in 1.14. In 1.15 it will be
enabled by default.
Best,
Dawid
[1]
https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/fault-tolerance/checkpointing/#enabling-and-confi
One possible option is to look into the hybrid source released in Flink
1.14 to support your use-case:
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/hybridsource/
On Fri, Feb 25, 2022, 09:19 Jin Yi wrote:
> so we have a streaming job where the main work t
