Kafka Streams 3.5.1 based app seems to get stalled

2024-03-10 Thread Venkatesh Nagarajan
Hi all, A Kafka Streams application sometimes stops consuming events during load testing. Please find below the details: Details of the app: * Kafka Streams Version: 3.5.1 * Kafka: AWS MSK v3.6.0 * Consumes events from 6 topics * Calls APIs to enrich events * Sometimes join

Re: [EXTERNAL] Re: Kafka Streams 3.5.1 based app seems to get stalled

2024-03-12 Thread Venkatesh Nagarajan
s On 3/10/24 5:56 PM, Venkatesh Nagarajan wrote: > Hi all, > > A Kafka Streams application sometimes stops consuming events during load > testing. Please find below the details: > > Details of the app: > > >* Kafka Streams Version: 3.5.1 >* Kafka: AWS MSK

Re: [EXTERNAL] Re: Kafka Streams 3.5.1 based app seems to get stalled

2024-03-12 Thread Venkatesh Nagarajan
metadata for member during Stable; client reason: triggered followup rebalance scheduled for 0) (kafka.coordinator.group.GroupCoordinator) Thank you. Kind regards, Venkatesh From: Venkatesh Nagarajan Date: Wednesday, 13 March 2024 at 12:06 pm To: users@kafka.apache.org Subject: Re: [EXTERNAL] Re

Re: [EXTERNAL] Re: Kafka Streams 3.5.1 based app seems to get stalled

2024-03-14 Thread Venkatesh Nagarajan
mer/internals/ConsumerCoordinator.java#L882C39-L882C66> On 3/13/24 2:34 AM, Venkatesh Nagarajan wrote: > Just want to share another variant of the log message which is also related > to metadata and rebalancing but has a different client reason: > > INFO [GroupCoordinator 3]: Preparing

Re: [EXTERNAL] Re: Kafka Streams 3.5.1 based app seems to get stalled

2024-03-14 Thread Venkatesh Nagarajan
. Kind regards, Venkatesh From: Venkatesh Nagarajan Date: Friday, 15 March 2024 at 8:30 AM To: users@kafka.apache.org Subject: Re: [EXTERNAL] Re: Kafka Streams 3.5.1 based app seems to get stalled Apologies for the delay in responding to you, Bruno. Thank you very much for your important inputs

Re: [EXTERNAL] Re: Kafka Streams 3.5.1 based app seems to get stalled

2024-03-18 Thread Venkatesh Nagarajan
mit-london-2023/kafka-streams-rebalances-and-assignments-the-whole-story/<https://www.confluent.io/events/kafka-summit-london-2023/kafka-streams-rebalances-and-assignments-the-whole-story> Best, Bruno On 3/14/24 11:11 PM, Venkatesh Nagarajan wrote: > Just want to make a correction, Br

Re: [EXTERNAL] Re: Kafka Streams 3.5.1 based app seems to get stalled

2024-04-03 Thread Venkatesh Nagarajan
you: https://www.responsive.dev/blog/a-size-for-every-stream<https://www.responsive.dev/blog/a-size-for-every-stream> Best, Bruno On 3/19/24 4:14 AM, Venkatesh Nagarajan wrote: > Thanks very much for sharing the links and for your important inputs, Bruno! > >> We recommend to

Re: [EXTERNAL] Re: Kafka Streams 3.5.1 based app seems to get stalled

2024-04-14 Thread Venkatesh Nagarajan
ou see "no follow up rebalance request" but you actually do get rebalances, it would indicate an issue. -Matthias On 4/3/24 2:24 PM, Venkatesh Nagarajan wrote: > Apologies for the delay, Bruno. Thank you so much for the excellent link and > for your inputs! Also, I would like to t