Hello Apache Kafka community,

auto.create.topics.enable configuration option docs state:
"Enable auto creation of topic on the server. If this is set to true then
attempts to produce, consume, or fetch metadata for a non-existent topic
will automatically create it with the default replication factor and number
of partitions."

I read this that topic should be created on any attempt to consume
non-existing topic.

With auto.create.topics.enable left at default or explicitly set to true,
attempts to consume non existing topic, using blocking consumer, or a
non-blocking consumer with positive consumer.timeout.ms configured, will
not result in topic creation (I cannot see one registered in ZooKeeper).

Additionally, for non-blocking consumer with timeout, no offset will be
recorded. This further means, if such consumer had auto.offset.reset set to
largest, that it will miss at least one message (initial one that when
published creates the topic), even though consumer attempted to read before
first message was published.

I'm using Kafka 0.8.1.1 but I see same issue exists in current trunk.

Is this a known issue? Or are my expectations/assumptions wrong and this is
expected behavior?

Kind regards,
Stevo Slavic.

Reply via email to