dongnuo123 opened a new pull request, #19904:
URL: https://github.com/apache/kafka/pull/19904

   Consumers can subscribe to an RE2J SubscriptionPattern that will be resolved 
and maintained on the server-side (KIP-848). Currently, those regexes are 
refreshed on the coordinator when a consumer subscribes to a new regex, or if 
there is a new topic metadata image (to ensure regex resolution stays 
up-to-date with existing topics)
   
   But with [KAFKA-18813](https://issues.apache.org/jira/browse/KAFKA-18813), 
the topics matching a regex are filtered based on ACLs. This generates a new 
situation, as regexes resolution do not stay up-to-date as topics become 
visible (ACLs added/delete).
   
   This patch introduces time-based refresh for the subscribed regex by
   - Adding `group.consumer.regex.refresh.interval.ms` config that controls the 
refresh interval.
   - Periodically scheduling regex refresh task to the coordinator executor. 
The task is cancelled when the consumer group is no longer subscribed to any 
regex.
   - Creating a cache in `GroupMetadataManager` that keeps track of the latest 
context of the member used to filter unauthorized topics.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to