Hi Team,
We are trying to set MM2 syncbetween 2 clusters (Active\Passive)
We have ~3000 topics
Using CFK clusters 7.3.0
The problem
MM2 tries to create in 1 batchtopics on target cluster (~3000)
In the broker's logs, there is an error
Could not create topicactive-north-2316.
java.util.concurrent.CompletionException:org.apache.kafka.common.errors.PolicyViolationException:
Unable to performexcessively large batch operation.
Possible Cause?
The Kraft controller metadataimplementation has an 8kb limitation for more
detail:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-868+Metadata+Transactions.
Suggested Resolution
As a resolution, we got a suggestion to set a few MM2 instances.
The question:
Is there some way to limit the batch size by MM2 configuration only so that
topics are created in small batches?
