Ayyandurai Mani created KAFKA-13265:
---------------------------------------
Summary: Kafka consumers disappearing after certain point of time
Key: KAFKA-13265
URL: https://issues.apache.org/jira/browse/KAFKA-13265
Project: Kafka
Issue Type: Test
Components: consumer
Affects Versions: 2.4.0
Reporter: Ayyandurai Mani
Attachments: Consumer_Disappear_Issue_Screen.png, server.log
Dear Kafka Team,
We are facing one issue for past few days in our development environment. We
have topic called 'search-service-topic-dev' and consumer group
'search-service-group' with 10 partitions, and concurrency also 10 at consumer
side.
When we publish more messages( each message is 115kb) into the topic after some
certain point of the time consumers disappeared from the consumer group (note :
consumer service are running). Have attached screenshot for reference (filename
: Consumer_Disappear_Issue_Screen.png)
>From screenshot when i execute describe command for the consumer group at
>14:35:32 (IST) consumers were available but when i execute at 14:38:17(IST)
>consumers were not there.
Attached kafka server.log for that particular time(kafka is running in UTC
timezone server).
Note : Message size in each partitions is around 2GB.
We are kind of blocked due to this behavior. Please help me to resolve this.
Thanks in advance.
Ayyandurai
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
