Re: count of number of producers and consumers in a kafka cluster

2022-02-03 Thread Luke Chen
Hi Dhirendra, Not sure what's the purpose of knowing the count of number of producers and consumers? Theres's metrics: `Consumer Group Count` to know the total number of Consumer Groups. For consumers, they go up and down from time to time, and the consumer group will rebalance the partitions aut

Re: Error triming topology

2022-02-03 Thread Guozhang Wang
Hello Murilo, Could you elaborate a bit more on how you "trimmed" the topology? For example: 1) Did you change the code so that only 6 sub-topologies will be built, and their sub-topology ids stays the same? i.e. you just trimmed the last 3 sub-topologies with id 6,7,8? 2) Did you delete the loca

Kafka Control Center and Threads Error ...

2022-02-03 Thread jhebeler
I tried this with version 6.2 and 7.0. When the control center starts up it fails (under docker-compose) on saying a thread limit of 200 and it needs 276. I am running these versions on 2 other machines without any problems. I have not been able to find anyone who has the problem. Any idea of w

Re: Kafka streams uneven task allocation

2022-02-03 Thread Guozhang Wang
Hello Navneeth, Could you describe how you ended up with more than one partition assigned to the same thread after certain rebalance(s)? Do you override any default config values such as instance.id (for static consumer members), etc? Also I'd suggest upgrading to a newer version --- we just rele

Only Internal being replicated | Mirrormaker2

2022-02-03 Thread Saqib Mehraj
Greetings, I have a kafka cluster and wanted to replicate the cluster with all the topics. I tried replication using MirrorMaker2 but somehow it only shows some internal topics being replicated in the destination cluster. With this email I am attaching my mm2.properties file and relevant screensh