Kafka Users, We are running a Kafka cluster (0.8.2-BETA), recently we have noticed an issue where consumer threads were not assigned to certain partitions ( for instance if we have 100 partitions per topic than I see partitions 40 to partitions 60 are unclaimed/unassigned by running consumer threads)
1. The consumer threads are still available on other partitions and fetching messages. 2. Overall application status is good and does not indicate any problems of any kind. 3. Restarting the consumers (not the application) resolves the issue but this issue gets repeated after couple of hours (same or different set of partitions are again unassigned). Kafka Cluster INFO: 1. Kafka cluster (0.8.2-BETA version) contains 12 brokers with a replication factor of 4 per topic with 131 partitions. 2. We are using kafka_2.10-0.8.2.1.jar for building our Application to consume messages from Kafka. 3. Application is running on cloud foundry. Question: 1. Has anyone come across this issue and what are the necessary steps that needs to be taken to resolve this issue? Note: we are currently working on an upgrade but this will still take some time. Thank You Diwakar