Kafka Users,

We are running a Kafka cluster (0.8.2-BETA), recently we have noticed an issue 
where consumer threads were not assigned to certain partitions ( for instance 
if we have 100 partitions per topic than I see partitions 40 to partitions 60 
are unclaimed/unassigned by running  consumer threads)

1.       The consumer threads are still available on other partitions and 
fetching messages.

2.       Overall application status is good and does not indicate any problems 
of any kind.

3.       Restarting the consumers (not the application) resolves the issue but 
this issue gets repeated after couple of hours (same or different set of 
partitions are again unassigned).

Kafka Cluster INFO:

1.       Kafka cluster (0.8.2-BETA version) contains 12 brokers with a 
replication factor of 4 per topic with 131 partitions.

2.       We are using kafka_2.10-0.8.2.1.jar for building our Application to 
consume messages from Kafka.

3.       Application is running on cloud foundry.

Question:

1.       Has anyone come across this issue and what are the necessary steps 
that needs to be taken to resolve this issue?


Note: we are currently working on an upgrade but this will still take some time.


Thank You

Diwakar

Reply via email to