George Yang created KAFKA-17784:
-----------------------------------

             Summary: Mirror Maker2 Pod CrashLoopbackOff
                 Key: KAFKA-17784
                 URL: https://issues.apache.org/jira/browse/KAFKA-17784
             Project: Kafka
          Issue Type: Bug
          Components: mirrormaker
    Affects Versions: 3.7.1
            Reporter: George Yang
         Attachments: connect-1.log

When I use k8s deployment with mirrormaker v3.7.1, and deploy one kafka node in 
each data center, I always got the crashloopbackoff error, please see the 
attachment. 

 

The configuration of mirrormaker is:

```configuration

# specify any number of cluster aliases
clusters = idca, idcb

# connection information for each cluster
# This is a comma separated host:port pairs for each cluster
# for e.g. "A_host1:9092, A_host2:9092, A_host3:9092"
idca.bootstrap.servers = 192.168.2.146:13399
idcb.bootstrap.servers = 192.168.2.147:13399

# enable and configure individual replication flows
idca->idcb.enabled = true

# regex which defines which topics gets replicated.
idca->idcb.topics = .*

idcb->idca.enabled = true
idcb->idca.topics = .*

# Setting replication factor of newly created remote topics
replication.factor=1

tasks.max=6
emit.checkpoints.interval.seconds=5
idca.producer.acks=all
idca.producer.batch.size=50000
#idcb.producer.enable.idempotence=true

idca.consumer.auto.offset.reset=latest
idcb.consumer.auto.offset.reset=latest
idca.consumer.max.poll.interval.ms=20000
idcb.consumer.max.poll.interval.ms=20000

refresh.topics.enabled=true
refresh.topics.interval.seconds=5

refresh.groups.enabled=true
refresh.groups.interval.seconds=5

dedicated.mode.enable.internal.rest = true
idca.scheduled.rebalance.max.delay.ms=20000
idcb.scheduled.rebalance.max.delay.ms=20000

############################# Internal Topic Settings  
#############################
# The replication factor for mm2 internal topics "heartbeats", 
"idcb.checkpoints.internal" and
# "mm2-offset-syncs.idcb.internal"
# For anything other than development testing, a value greater than 1 is 
recommended to ensure availability such as 3.
checkpoints.topic.replication.factor=3
heartbeats.topic.replication.factor=3
offset-syncs.topic.replication.factor=3

# The replication factor for connect internal topics 
"mm2-configs.idcb.internal", "mm2-offsets.idcb.internal" and
# "mm2-status.idcb.internal"
# For anything other than development testing, a value greater than 1 is 
recommended to ensure availability such as 3.
offset.storage.replication.factor=3
status.storage.replication.factor=3

```



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to