Hi all,

still doing disaster testing with Kafka cluster, when crashing several
brokers at once sometimes we observe exception in kafka-stream app about
inability to create internal topics:

[WARN ] [org.apache.kafka.streams.processor.internals.InternalTopicManager]
[Could not create internal topics: Found only 2 brokers,  but replication
factor is 3. Decrease replication factor for internal topics via
StreamsConfig parameter "replication.factor" or add more brokers to your
cluster. Retry #2]
[WARN ] [org.apache.kafka.streams.processor.internals.InternalTopicManager]
[Could not create internal topics: Found only 2 brokers,  but replication
factor is 3. Decrease replication factor for internal topics via
StreamsConfig parameter "replication.factor" or add more brokers to your
cluster. Retry #3]
[WARN ] [org.apache.kafka.streams.processor.internals.InternalTopicManager]
[Could not create internal topics: Found only 2 brokers,  but replication
factor is 3. Decrease replication factor for internal topics via
StreamsConfig parameter "replication.factor" or add more brokers to your
cluster. Retry #4]
[INFO ] [org.apache.kafka.streams.processor.internals.StreamThread]
[stream-thread [Shutting down]

The problem is that number of retries seems to be hardcoded to 5.
>From InternalTopicManager.MAX_TOPIC_READY_TRY constant.

Any way to make to configurable? It's really not nice that app is shutting
down, instead of just re-trying (potentially with exponential backoff)
until all broker are available back.

Should we open feature/issue request?

Thank you.

Reply via email to