Hello,
And sorry for posting the question again, since I didn't get any response
last time, so I posted it,
I am using Kafka 1.0.1 and in Kafka Consumer side, I am regularly (every
10-20 min) seeing the following Kafka log message which causes the
partition assignment to consumer ,...
Consumer side logs: Marking the coordinator ip-XYZ:9092 (id: 2147482644
rack: null) dead for group MyGroup
Does anyone know what is the source of this issue?
I played with CONNECTIONS_MAX_IDLE_MS_CONFIG in Consumer side kafka
configuration and it didn't effect the results.
best,
Shahab
Here is the related logs I found in consumer side:
2016-12-08 20:41:12.559 INFO internals.AbstractCoordinator {} - Marking
the coordinator ip-XYZ:9092 (id: 2147482644 rack: null) dead for group
MyGroup
2016-12-08 20:41:12.560 WARN internals.ConsumerCoordinator {} - Auto
offset commit failed for group MyGroup: Commit offsets failed with
retriable exception. You should retry committing offsets.
2016-12-08 20:41:12.916 INFO internals.AbstractCoordinator {} - Discovered
coordinator ip-xyz:9092 (id: 2147482644 rack: null) for group MyGroup.
2016-12-08 22:59:28.310 INFO internals.ConsumerCoordinator {} - Revoking
previously assigned partitions [topic-1,topic-2,topic-3,topic-4] for group
MyGroup
2016-12-08 22:59:28.310 INFO internals.AbstractCoordinator {} -
(Re-)joining group MyGroup
2016-12-08 22:59:28.343 INFO internals.AbstractCoordinator {} -
Successfully joined group MyGroup with generation 86
2016-12-08 22:59:28.343 INFO internals.ConsumerCoordinator {} - Setting
newly assigned partitions [opic-1,topic-2,topic-3,topic-4] for group MyGroup
