Matthias J. Sax created KAFKA-6126:
--------------------------------------
Summary: Reduce rebalance time by not checking if created topics
are available
Key: KAFKA-6126
URL: https://issues.apache.org/jira/browse/KAFKA-6126
Project: Kafka
Issue Type: Bug
Components: streams
Affects Versions: 1.0.0
Reporter: Matthias J. Sax
Fix For: 1.1.0
Within {{StreamPartitionAssignor#assign}} we create new topics and afterwards
wait in an "infinite loop" until topic metadata propagated throughout the
cluster. We do this, to make sure topics are available when we start processing.
However, with this approach we "extend" the time in the rebalance phase and
thus are not responsive (no calls to `poll` for liveness check and
{{KafkaStreams#close}} suffers). Thus, we might want to remove this check and
handle potential "topic not found" exceptions in the main thread gracefully.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
