Tommi Vainikainen created KAFKA-12893:
-----------------------------------------
Summary: MM2 fails to replicate if starting two+ nodes same time
Key: KAFKA-12893
URL: https://issues.apache.org/jira/browse/KAFKA-12893
Project: Kafka
Issue Type: Bug
Components: mirrormaker
Affects Versions: 2.8.0
Reporter: Tommi Vainikainen
I've observed a situation where starting more than one MM2 node in parallel,
MM2 fails to start replication ie. replication flow seems to be stuck without
action. I used exactly same mm2.properties file to start only one at a time,
and the replication flow was proceeding smoothly.
In my setup dc1 has topic "mytopic1" and there is a producer with approx 1
msg/sec, and I'm trying to repilcate this to dc2. What I observed is that
dc1.mytopic1 is created when initially launching two paraller MM2 instances,
but no messages gets written into the topic as I would expect. If I kill MM2
instances, and only start one MM2 node, then MM2 starts replicating the
messages in mytopic1.
My mm2.properties:
clusters=dc2, dc1
dc1->dc2.emit.heartbeats.enabled=true
dc1->dc2.enabled=true
dc1->dc2.sync.group.offsets.enabled=false
dc1->dc2.sync.group.offsets.interval.seconds=45
dc1->dc2.topics=mytopic1
dc1->dc2.topics.exclude=
dc1.bootstrap.servers=tvainika-dc1-dev-sandbox.aivencloud.com:12693
dc1.security.protocol=SSL
dc1.ssl.keystore.type=PKCS12
dc1.ssl.keystore.location=dc1/client.keystore.p12
dc1.ssl.keystore.password=secret
dc1.ssl.key.password=secret
dc1.ssl.truststore.location=dc1/client.truststore.jks
dc1.ssl.truststore.password=secret
dc2.bootstrap.servers=tvainika-dc2-dev-sandbox.aivencloud.com:12693
dc2.security.protocol=SSL
dc2.ssl.keystore.type=PKCS12
dc2.ssl.keystore.location=dc2/client.keystore.p12
dc2.ssl.keystore.password=secret
dc2.ssl.key.password=secret
dc2.ssl.truststore.location=dc2/client.truststore.jks
dc2.ssl.truststore.password=secret
tasks.max=3
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
