[ https://issues.apache.org/jira/browse/KAFKA-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15854905#comment-15854905 ]
James Cheng commented on KAFKA-4739: ------------------------------------ I wonder if we're seeing the same thing as this. Kafka 0.9.0.1 consumer, talking to 0.10.0.1 broker. Our kafka cluster went down. While the cluster was down, this consumer wrote this into the logs at the rate of 1600 times per second for an extended period of time: 2016-12-23 04:42:46 [pool-2-thread-1] INFO o.a.k.c.c.i.AbstractCoordinator - Marking the coordinator 2147483643 dead. > KafkaConsumer poll going into an infinite loop > ---------------------------------------------- > > Key: KAFKA-4739 > URL: https://issues.apache.org/jira/browse/KAFKA-4739 > Project: Kafka > Issue Type: Bug > Components: consumer > Affects Versions: 0.9.0.1 > Reporter: Vipul Singh > > We are seeing an issue with our kafka consumer where it seems to go into an > infinite loop while polling, trying to fetch data from kafka. We are seeing > the heartbeat requests on the broker from the consumer, but nothing else from > the kafka consumer. > We enabled debug level logging on the consumer, and see these logs: > ---- > {quote} > DEBUG [2017-02-03 17:05:17,971] > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator: Committed > offset abc for partition topic1-partition0 > DEBUG [2017-02-03 17:05:17,971] > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator: Committed > offset abc1 for partition topic2-partition0 > DEBUG [2017-02-03 17:05:18,112] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:19,828] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:20,902] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:22,860] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:24,112] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:25,884] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:27,109] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:28,860] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:30,112] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:31,827] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:33,268] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:34,834] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:36,269] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:37,838] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:39,268] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:40,824] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:42,268] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:43,825] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:45,268] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:46,840] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:48,268] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:49,823] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:51,269] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:52,824] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:54,268] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:55,862] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:57,269] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:05:57,998] org.apache.kafka.clients.NetworkClient: > Disconnecting from node xyz due to request timeout. > DEBUG [2017-02-03 17:05:57,998] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 289 due to node xyz being > disconnected > DEBUG [2017-02-03 17:05:58,041] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:05:58,041] org.apache.kafka.clients.NetworkClient: > Sending metadata request ClientRequest() to node xyz_abc > DEBUG [2017-02-03 17:05:58,041] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 303 due to node xyz being > disconnected > DEBUG [2017-02-03 17:05:58,041] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:05:58,112] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 305 due to node xyz being > disconnected > DEBUG [2017-02-03 17:05:58,112] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:05:58,113] org.apache.kafka.clients.NetworkClient: > Initiating connection to node xyz at hostname. > DEBUG [2017-02-03 17:05:58,114] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.clients.consumer.internals.SendFailedException: null > DEBUG [2017-02-03 17:05:58,114] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.clients.consumer.internals.SendFailedException: null > DEBUG [2017-02-03 17:05:58,114] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.clients.consumer.internals.SendFailedException: null > DEBUG [2017-02-03 17:05:58,114] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.clients.consumer.internals.SendFailedException: null > DEBUG [2017-02-03 17:05:58,115] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.clients.consumer.internals.SendFailedException: null > DEBUG [2017-02-03 17:05:58,115] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.clients.consumer.internals.SendFailedException: null > DEBUG [2017-02-03 17:05:58,115] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.clients.consumer.internals.SendFailedException: null > DEBUG [2017-02-03 17:05:58,115] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.clients.consumer.internals.SendFailedException: null > DEBUG [2017-02-03 17:05:58,115] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.clients.consumer.internals.SendFailedException: null > DEBUG [2017-02-03 17:05:58,116] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.clients.consumer.internals.SendFailedException: null > DEBUG [2017-02-03 17:05:58,116] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.clients.consumer.internals.SendFailedException: null > DEBUG [2017-02-03 17:05:58,116] org.apache.kafka.clients.NetworkClient: > Completed connection to node xyz > DEBUG [2017-02-03 17:05:58,135] org.apache.kafka.clients.Metadata: Updated > cluster metadata version 4 to Cluster() > DEBUG [2017-02-03 17:05:58,848] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:00,268] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:01,827] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:03,269] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:06,268] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:07,825] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:09,269] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:10,826] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:12,268] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:13,826] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:15,269] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:16,827] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:18,269] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:19,825] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:21,269] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:22,836] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:24,269] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:25,864] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:27,269] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:28,849] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:30,269] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:31,826] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:33,270] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:34,827] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:36,270] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:37,888] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:38,168] org.apache.kafka.clients.NetworkClient: > Disconnecting from node xyz due to request timeout. > DEBUG [2017-02-03 17:06:38,168] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 317 due to node xyz being > disconnected > DEBUG [2017-02-03 17:06:38,168] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,168] org.apache.kafka.clients.NetworkClient: > Sending metadata request ClientRequest() with correlation id 332 due to node > xyz being disconnected > DEBUG [2017-02-03 17:06:38,169] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,202] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 334 due to node xyz being > disconnected > DEBUG [2017-02-03 17:06:38,203] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,203] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 335 due to node xyz being > disconnected > DEBUG [2017-02-03 17:06:38,203] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,203] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 336 due to node xyz being > disconnected > DEBUG [2017-02-03 17:06:38,203] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,203] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 337 due to node xyz being > disconnected > DEBUG [2017-02-03 17:06:38,203] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,204] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest(expectResponse=true, > callback=org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler@7a4c84fb, > request=RequestSend() with correlation id 338 due to node xyz being > disconnected > DEBUG [2017-02-03 17:06:38,204] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,204] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 339 due to node xyz being > disconnected > DEBUG [2017-02-03 17:06:38,204] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,204] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest(e) with correlation id 340 due to node xyz being > disconnected > DEBUG [2017-02-03 17:06:38,204] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,204] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 341 due to node xyz being > disconnected > DEBUG [2017-02-03 17:06:38,204] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,205] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 342 due to node xyz being > disconnected > DEBUG [2017-02-03 17:06:38,205] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,206] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 343 due to node xyz being > disconnected > DEBUG [2017-02-03 17:06:38,206] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,206] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 344 due to node xyz being > disconnected > DEBUG [2017-02-03 17:06:38,206] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,251] org.apache.kafka.clients.Metadata: Updated > cluster metadata version 5 to Cluster() > DEBUG [2017-02-03 17:06:38,253] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 345 due to node xyz being > disconnected > DEBUG [2017-02-03 17:06:38,254] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:06:38,254] org.apache.kafka.clients.NetworkClient: > Initiating connection to node xyz at hostname. > DEBUG [2017-02-03 17:06:38,260] org.apache.kafka.clients.NetworkClient: > Completed connection to node xyz > DEBUG [2017-02-03 17:06:39,269] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:40,828] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:42,269] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:43,828] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:45,270] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:47,021] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:48,270] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:49,827] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:51,448] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:52,828] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:54,446] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:55,829] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:57,446] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:06:58,831] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:00,570] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:01,841] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:03,567] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:04,858] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:06,567] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:07,840] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:09,567] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:10,830] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:12,567] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:13,830] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:15,568] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:16,844] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:18,311] org.apache.kafka.clients.NetworkClient: > Disconnecting from node xyz due to request timeout. > DEBUG [2017-02-03 17:07:18,311] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 346 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:18,311] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:18,311] org.apache.kafka.clients.NetworkClient: > Sending metadata request ClientRequest() to node xyz_abc > DEBUG [2017-02-03 17:07:18,312] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 360 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:18,312] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:18,411] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 362 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:18,411] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:18,411] org.apache.kafka.clients.NetworkClient: > Initiating connection to node xyz at hostname > DEBUG [2017-02-03 17:07:18,413] org.apache.kafka.clients.NetworkClient: > Completed connection to node xyz > DEBUG [2017-02-03 17:07:18,554] org.apache.kafka.clients.Metadata: Updated > cluster metadata version 6 to Cluster() > DEBUG [2017-02-03 17:07:18,567] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:19,832] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:21,568] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:22,830] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:24,569] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:25,891] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:27,567] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:28,875] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:30,568] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:31,831] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:33,576] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:34,856] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:36,576] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:37,841] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:39,577] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:40,832] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:42,577] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:43,832] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:45,578] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:46,907] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:48,577] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:49,841] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:51,764] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:52,833] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:54,761] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:55,883] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:57,762] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:07:58,508] org.apache.kafka.clients.NetworkClient: > Disconnecting from node xyz due to request timeout. > DEBUG [2017-02-03 17:07:58,508] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 363 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,508] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,508] org.apache.kafka.clients.NetworkClient: > Sending metadata request ClientRequest() with correlation id 377 due to node > xyz being disconnected > DEBUG [2017-02-03 17:07:58,509] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,527] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 379 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,527] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,528] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 380 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,528] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,528] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 381 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,528] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,528] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 382 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,528] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,528] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 383 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,528] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,529] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 384 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,529] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,529] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 385 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,529] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,529] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 386 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,529] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,529] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 387 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,529] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,529] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 388 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,530] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,530] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 389 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,530] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,530] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 390 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,530] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,530] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 391 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,531] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,531] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 392 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,531] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,531] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 393 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,533] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,544] org.apache.kafka.clients.Metadata: Updated > cluster metadata version 7 to Cluster() > DEBUG [2017-02-03 17:07:58,544] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 394 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,544] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,608] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 395 due to node xyz being > disconnected > DEBUG [2017-02-03 17:07:58,609] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:07:58,609] org.apache.kafka.clients.NetworkClient: > Initiating connection to node xyz at hostname > DEBUG [2017-02-03 17:07:58,610] org.apache.kafka.clients.NetworkClient: > Completed connection to node xyz > DEBUG [2017-02-03 17:07:58,843] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:00,772] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:01,887] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:03,769] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:04,835] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:06,769] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:07,836] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:09,769] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:10,844] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:12,769] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:13,841] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:15,774] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:16,864] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:18,772] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:19,838] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:21,772] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:22,976] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:24,773] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:25,847] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:27,773] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:28,840] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:30,773] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:31,836] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:33,772] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:34,844] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:36,772] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:37,837] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:38,706] org.apache.kafka.clients.NetworkClient: > Disconnecting from node xyz due to request timeout. > DEBUG [2017-02-03 17:08:38,706] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 396 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,706] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,706] org.apache.kafka.clients.NetworkClient: > Sending metadata request ClientRequest() to node xyz_abc > DEBUG [2017-02-03 17:08:38,706] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 411 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,707] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,748] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 413 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,748] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,748] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 414 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,749] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,749] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 415 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,749] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,749] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 416 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,749] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,749] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 417 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,749] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,749] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 418 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,750] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,753] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 419 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,753] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,753] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 420 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,754] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,754] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 421 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,754] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,754] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 422 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,754] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,754] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 423 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,755] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,755] > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient: Cancelled > FETCH request ClientRequest() with correlation id 424 due to node xyz being > disconnected > DEBUG [2017-02-03 17:08:38,755] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.common.errors.DisconnectException: null > DEBUG [2017-02-03 17:08:38,756] org.apache.kafka.clients.NetworkClient: > Initiating connection to node xyz at hostname. > DEBUG [2017-02-03 17:08:38,771] org.apache.kafka.clients.Metadata: Updated > cluster metadata version 8 to Cluster() > DEBUG [2017-02-03 17:08:38,771] > org.apache.kafka.clients.consumer.internals.Fetcher: Fetch failed > ! org.apache.kafka.clients.consumer.internals.SendFailedException: null > DEBUG [2017-02-03 17:08:38,771] org.apache.kafka.clients.NetworkClient: > Completed connection to node xyz > DEBUG [2017-02-03 17:08:39,773] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:40,837] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:42,776] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:43,841] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:45,774] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:46,989] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:48,774] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:49,878] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:51,776] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:52,845] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:54,795] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:55,837] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:57,792] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:08:58,902] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:09:00,793] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:09:01,838] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:09:03,794] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:09:04,839] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:09:06,803] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:09:07,903] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:09:09,799] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:09:10,837] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:09:12,798] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:09:13,837] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:09:15,798] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:09:16,838] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > DEBUG [2017-02-03 17:09:18,798] > org.apache.kafka.clients.consumer.internals.AbstractCoordinator: Received > successful heartbeat response. > {quote} > ---- > And this just goes on. The way we have been able to replicate this issue, is > by restarting the process in multiple successions. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
