lnbest0707 opened a new pull request, #264:
URL: https://github.com/apache/flink-connector-kafka/pull/264

   ## What is the purpose of the change
   
   Retain removed DynamicKafkaSource cluster split offsets and enumerator state 
in checkpoints for a configurable retention window so a temporarily removed 
cluster can resume from checkpointed offsets when it is added back.
   
   ## Brief change log
   
   - add `stream-metadata-removed-cluster-retention-ms` for DynamicKafkaSource 
and dynamic table source
   - retain removed-cluster reader split offsets and enumerator state until the 
retention window expires
   - keep serializer restore backward compatible
   - add restore/rescale/re-add integration coverage plus serializer, reader, 
enumerator, and table option tests
   
   ## Verifying this change
   
   - local UT and IT
   - E2e testing with local containers and real clusters
   
   JIRA: https://issues.apache.org/jira/browse/FLINK-39837


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to