smjn opened a new pull request, #19443:
URL: https://github.com/apache/kafka/pull/19443

   * There could be scenarios where share partition records in 
`__share_group_state` internal topic have not been updated for a while implying 
these partitions are basically cold.
   * In this situation, the presence of these basically holds back the pruner 
from keeping the topic clean and of manageable size.
   * To remedy the situation, we have added a periodic 
`setupSnapshotColdPartitions` in `ShareCoordinatorService` which does a 
writeAll operation on the associated shards in the coordinator and forces 
snapshot creation for them. In this way the pruner can continue. This job has 
been added as a timer task.
   * A new internal config 
`share.coordinator.cold.partition.snapshot.interval.ms` has been introduced to 
set the period of the job.
   * Any failures are logged and ignored.
   * New tests have been added to verify the feature. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to