Hi all,
A Kafka Streams application sometimes stops consuming events during load
testing. Please find below the details:
Details of the app:
* Kafka Streams Version: 3.5.1
* Kafka: AWS MSK v3.6.0
* Consumes events from 6 topics
* Calls APIs to enrich events
* Sometimes join
s
On 3/10/24 5:56 PM, Venkatesh Nagarajan wrote:
> Hi all,
>
> A Kafka Streams application sometimes stops consuming events during load
> testing. Please find below the details:
>
> Details of the app:
>
>
>* Kafka Streams Version: 3.5.1
>* Kafka: AWS MSK
metadata for member during Stable; client reason: triggered
followup rebalance scheduled for 0) (kafka.coordinator.group.GroupCoordinator)
Thank you.
Kind regards,
Venkatesh
From: Venkatesh Nagarajan
Date: Wednesday, 13 March 2024 at 12:06 pm
To: users@kafka.apache.org
Subject: Re: [EXTERNAL] Re
mer/internals/ConsumerCoordinator.java#L882C39-L882C66>
On 3/13/24 2:34 AM, Venkatesh Nagarajan wrote:
> Just want to share another variant of the log message which is also related
> to metadata and rebalancing but has a different client reason:
>
> INFO [GroupCoordinator 3]: Preparing
.
Kind regards,
Venkatesh
From: Venkatesh Nagarajan
Date: Friday, 15 March 2024 at 8:30 AM
To: users@kafka.apache.org
Subject: Re: [EXTERNAL] Re: Kafka Streams 3.5.1 based app seems to get stalled
Apologies for the delay in responding to you, Bruno. Thank you very much for
your important inputs
mit-london-2023/kafka-streams-rebalances-and-assignments-the-whole-story/<https://www.confluent.io/events/kafka-summit-london-2023/kafka-streams-rebalances-and-assignments-the-whole-story>
Best,
Bruno
On 3/14/24 11:11 PM, Venkatesh Nagarajan wrote:
> Just want to make a correction, Br
you:
https://www.responsive.dev/blog/a-size-for-every-stream<https://www.responsive.dev/blog/a-size-for-every-stream>
Best,
Bruno
On 3/19/24 4:14 AM, Venkatesh Nagarajan wrote:
> Thanks very much for sharing the links and for your important inputs, Bruno!
>
>> We recommend to
ou see "no follow up rebalance request" but you actually do get
rebalances, it would indicate an issue.
-Matthias
On 4/3/24 2:24 PM, Venkatesh Nagarajan wrote:
> Apologies for the delay, Bruno. Thank you so much for the excellent link and
> for your inputs! Also, I would like to t