Hi Waseem This sounds like either an environment issue (i.e. something other than the kafka client/broker), or a client issue. In any case, you probably want to ask the developers of the ruby client instead.
Regards, ________________________________ From: Waseem Anwar <was...@evolverstech.com> Sent: Friday, August 1, 2025 14:55 To: dev-subscr...@kafka.apache.org <dev-subscr...@kafka.apache.org>; dev@kafka.apache.org <dev@kafka.apache.org> Subject: Kafka Consumer Not Receiving Messages Until Restart [You don't often get email from was...@evolverstech.com. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ] EXTERNAL SENDER. Do not click links or open attachments unless you recognize the sender and know the content is safe. DO NOT provide your username or password. Dear Apache Kafka Development Team, I hope you're doing well. I'm encountering an issue with our Kafka setup where the consumer stops receiving messages after running for a period of time, even though: - The Kafka producer continues to send payloads successfully - The consumer remains connected and shows no visible errors - Restarting the consumer causes it to start receiving messages again temporarily - The messages are confirmed to be in the Kafka topic (e.g., via kafka-console-consumer) - There are no signs of consumer crashes or disconnections in the logs Our Kafka version is ruby-kafka (1.5.0) as we have integrated it into the Ruby on Rails application. This behavior appears intermittent, and we’re unsure whether it's related to offset management, consumer group behavior, or something else. We would greatly appreciate your help in identifying what could be causing this issue, or any suggestions on additional debugging steps we can take. Please let me know if further configuration or log details would be helpful. Best regards, Waseem Anwar Senior Software Engineer CONFIDENTIALITY NOTICE: This email message (and any attachment) is intended only for the individual or entity to which it is addressed. The information in this email is confidential and may contain information that is legally privileged or exempt from disclosure under applicable law. If you are not the intended recipient, you are strictly prohibited from reading, using, publishing or disseminating such information and upon receipt, must permanently delete the original and destroy any copies. We take steps to protect against viruses and other defects but advise you to carry out your own checks and precautions as Kambi does not accept any liability for any which remain. Thank you for your co-operation.