Why is Kafka's QPS performance very poor with a large number of partitions
(such as 10,000 partitions)? What is the reason for this? Do you have any plans
to optimize this in the future? Or are there already optimizations in newer
versions?
As far as I know, there is no way for MM2 to be notified when a new topic
is created, so it polls at a configurable interval. You can try adjusting
the refresh.topics.interval.seconds property. It sounds like it's
configured for 10 minutes.
Ryanne
On Mon, Feb 20, 2023, 11:35 AM Fares Oueslati
wr
Hello,
I am currently using Kafka mirror maker v2 v3.2.0 to replicate a Kafka
cluster version 3.2.0 to another Kafka cluster version 3.2.0. However, I am
experiencing a delay issue where it takes around 10 minutes for a topic to
be created in the destination cluster after it has been created in th
Hi David,
these two metrics have two different objectives.
> kafka.server:type=BrokerTopicMetrics,name=TotalProduceRequestsPerSec <
Produce request rate per topic. Omitting 'topic=(...)' will yield the
all-topic rate.
*
while
>kafka.network:type=RequestMetrics,name=RequestsPerSec,re
