[ https://issues.apache.org/jira/browse/KAFKA-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929414#comment-15929414 ]
jaikiran pai commented on KAFKA-4631: ------------------------------------- Thanks [~hachikuji], am glad this made it to 0.10.x since that allows to get to this fix sooner > Refresh consumer metadata more frequently for unknown subscribed topics > ----------------------------------------------------------------------- > > Key: KAFKA-4631 > URL: https://issues.apache.org/jira/browse/KAFKA-4631 > Project: Kafka > Issue Type: Bug > Components: consumer > Reporter: Jason Gustafson > Assignee: Rajini Sivaram > Priority: Minor > Fix For: 0.11.0.0, 0.10.2.1 > > > By default, the consumer refreshes metadata every 5 minutes. In testing, it > can often happen that a topic is created at about the same time that the > consumer is started. In the worst case, creation finishes after the consumer > fetches metadata, and the test must wait 5 minutes for the consumer to > refresh metadata in order to discover the topic. To address this problem, > users can decrease the metadata refresh interval, but this means more > frequent refreshes even after all topics are known. An improvement would be > to internally let the consumer fetch metadata more frequently when the > consumer encounters unknown topics. Perhaps every 5-10 seconds would be > reasonable, for example. -- This message was sent by Atlassian JIRA (v6.3.15#6346)