This should be supported in 1.14 if you enable checkpointing with
finished tasks[1], which has been added in 1.14. In 1.15 it will be
enabled by default.
Best,
Dawid
[1]
https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/fault-tolerance/checkpointing/#enabling-and-confi
One possible option is to look into the hybrid source released in Flink
1.14 to support your use-case:
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/hybridsource/
On Fri, Feb 25, 2022, 09:19 Jin Yi wrote:
> so we have a streaming job where the main work t
so we have a streaming job where the main work to be done is processing
infinite kafka sources. recently, i added a fromCollection (finite) source
to simply write some state once upon startup. this all seems to work
fine. the finite source operators all finish, while all the infinite
source oper
