Hello, And sorry for posting the question again, since I didn't get any response last time, so I posted it,
I am using Kafka 1.0.1 and in Kafka Consumer side, I am regularly (every 10-20 min) seeing the following Kafka log message which causes the partition assignment to consumer ,... Consumer side logs: Marking the coordinator ip-XYZ:9092 (id: 2147482644 rack: null) dead for group MyGroup Does anyone know what is the source of this issue? I played with CONNECTIONS_MAX_IDLE_MS_CONFIG in Consumer side kafka configuration and it didn't effect the results. best, Shahab Here is the related logs I found in consumer side: 2016-12-08 20:41:12.559 INFO internals.AbstractCoordinator {} - Marking the coordinator ip-XYZ:9092 (id: 2147482644 rack: null) dead for group MyGroup 2016-12-08 20:41:12.560 WARN internals.ConsumerCoordinator {} - Auto offset commit failed for group MyGroup: Commit offsets failed with retriable exception. You should retry committing offsets. 2016-12-08 20:41:12.916 INFO internals.AbstractCoordinator {} - Discovered coordinator ip-xyz:9092 (id: 2147482644 rack: null) for group MyGroup. 2016-12-08 22:59:28.310 INFO internals.ConsumerCoordinator {} - Revoking previously assigned partitions [topic-1,topic-2,topic-3,topic-4] for group MyGroup 2016-12-08 22:59:28.310 INFO internals.AbstractCoordinator {} - (Re-)joining group MyGroup 2016-12-08 22:59:28.343 INFO internals.AbstractCoordinator {} - Successfully joined group MyGroup with generation 86 2016-12-08 22:59:28.343 INFO internals.ConsumerCoordinator {} - Setting newly assigned partitions [opic-1,topic-2,topic-3,topic-4] for group MyGroup