Re: Read kafka offsets from checkpoint - state processor

2021-05-10 Thread Dawid Wysakowicz
Hi, You would need to look into the internals of FlinkKafkaConsumerBase. In the current master the state for offsets is initialized in here: https://github.com/apache/flink/blob/fbf84acf63102db455c89cb8e497cda423a1c4d5/flink-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming

Re: Read kafka offsets from checkpoint - state processor

2021-05-07 Thread bat man
Anyone who has tried this or can help on this. Thanks. On Thu, May 6, 2021 at 10:34 AM bat man wrote: > Hi Users, > > Is there a way that Flink 1.9 the checkpointed data can be read using the > state processor api. > Docs [1] says - When reading operator state, users specify the operator > uid,

Read kafka offsets from checkpoint - state processor

2021-05-05 Thread bat man
Hi Users, Is there a way that Flink 1.9 the checkpointed data can be read using the state processor api. Docs [1] says - When reading operator state, users specify the operator uid, the state name, and the type information. What is the type for the kafka operator, which needs to be specified whil