Lukas Schmitt created KAFKA-3114:
------------------------------------
Summary: can't create as many partitions as brokers exists
Key: KAFKA-3114
URL: https://issues.apache.org/jira/browse/KAFKA-3114
Project: Kafka
Issue Type: Bug
Affects Versions: 0.9.0.0, 0.8.2.2
Environment: 3 server with ubuntu 15.04
zookeeper 3.4.6
Reporter: Lukas Schmitt
i have three kafka-brokers running (57, 58, 59)
when i try to create a topic with 3 partition and a replication factor higher
than 1, i get the following error in the broker logs over and over again until
i delete the topic:
{code}
ERROR [ReplicaFetcherThread-0-58], Error for partition [reptest,0] to broker
58:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server
does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
{code}
i use the following command to create the topic:
{code}
bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 3
--partitions 3 --topic reptest
{code}
when i execute the command on a follower broker, the leader spams the following:
{code}
WARN [Replica Manager on Broker 57]: While recording the replica LEO, the
partition [reptest,0] hasn't been created. (kafka.server.ReplicaManager)
{code}
each broker has the same configuration except the broker.id and the
advertised.host.name
{code}
broker.id=<ID>
port=9092
advertised.host.name=<ADVERTISED_HOST_IP_ADDRESS>
num.network.threads=3
num.io.threads=8
log.dirs=/tmp/kafka
num.partitions=1
num.recovery.threads.per.data.dir=1
log.cleaner.enable=true
log.cleanup.policy=compact
zookeeper.connect=localhost:2181
zookeeper.connection.timeout.ms=10000
delete.topic.enable=true
{code}
as long as the amount of partitions is smaller than the number of brokers i can
create topics without this error.
shouldn't it be possible to sync a topic over all brokers?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
