Re: Kafka Streams Consumer Constantly Rebalance over 100k tps

2025-01-22 Thread Matthias J. Sax
As I said: you first should try to understand the root cause. A `DisconnectException` sounds like a network issue to me. So it might not have anything to do with KS configurations, but seems to be an environment question. Of course, it could mean that heartbeats are not sent, and that a threa

Re: Kafka Streams Consumer Constantly Rebalance over 100k tps

2025-01-21 Thread Martinus Elvin
Hello, Thank you for the response! Some info that I forgot to include is the machine where service deployed. We have several server dedicated to deploy the services with 16 core with 32GB RAM, ad 32 core with 64GB RAM. FYI, This particular service is deployed in 32 core, 64GB RAM machine. We

Re: Kafka Streams Consumer Constantly Rebalance over 100k tps

2025-01-17 Thread Matthias J. Sax
Hi, In general, we recommend one StreamThread per core, so 48 threads sounds excessive; I don't think that a single pod would get 48 cores? So using more pods with fewer threads each, might be a first good step. The only config that sticks out is > - max.poll.records = 1 Not sure why you re

Kafka Streams Consumer Constantly Rebalance over 100k tps

2025-01-09 Thread Martinus Elvin
Hello, We have a kafka streams service that performs a left join (KStreams) operation by their message key. The message size is 1 KB more or less. The left topic has around two hundred thousand (200,000) messages per second, while the right topic has around two thousand (2000) message per seco