[
https://issues.apache.org/jira/browse/KAFKA-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14625460#comment-14625460
]
Jason Gustafson commented on KAFKA-2275:
----------------------------------------
[~singhashish], [~onurkaraman], one of the nice things that KAFKA-2123
introduces is a methodology for executing periodic tasks. It is currently used
for heartbeats and autocommits, but I think it could be used to periodically
send topic metadata requests to refresh regex subscriptions as well. You may
want to have a look at the active review board to see if this ticket can be
done in a way to keep that option available (or to see if something else is
needed). The only trickiness I see is that NetworkClient currently hijacks all
metadata responses.
> Add a ListTopics() API to the new consumer
> ------------------------------------------
>
> Key: KAFKA-2275
> URL: https://issues.apache.org/jira/browse/KAFKA-2275
> Project: Kafka
> Issue Type: Sub-task
> Components: consumer
> Reporter: Guozhang Wang
> Assignee: Ashish K Singh
> Priority: Critical
> Fix For: 0.8.3
>
>
> With regex subscription like
> {code}
> consumer.subscribe("topic*")
> {code}
> The partition assignment is automatically done at the Kafka side, while there
> are some use cases where consumers want regex subscriptions but not
> Kafka-side partition assignment, rather with their own specific partition
> assignment. With ListTopics() they can periodically check for topic list
> changes and specifically subscribe to the partitions of the new topics.
> For implementation, it involves sending a TopicMetadataRequest to a random
> broker and parse the response.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
