Hi Experts , I have a 3 node Kafka Cluster with inbound Traffic ~60Mbps. In the same cluster we are tying to consume the data using Java Kafka Consumer ( https://kafka.apache.org/0110/javadoc/index.html?org/apache/kafka/clients/consumer/KafkaConsumer.html) & i could notice few problem in Java Consumer.
#1 - CommitFailed Exception ( Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member ) #2 - Out of Memory .. Kafka Version : 0.11.0 Consumer Settings: group.id=<<XXXX>>> enable.auto.commit = true auto.commit.interval.ms = 5000 max.poll.interval.ms = 30000 poll.timeout = 200ms max.poll.records = 500 session.timeout.ms=30000 4GB memory for JVM .. Appreciate your inputs to tune Consumer ... --Senthil
