[
https://issues.apache.org/jira/browse/KAFKA-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226507#comment-17226507
]
Sarita commented on KAFKA-7500:
-------------------------------
Was able to fix the bootstrap-server disconnect issue. Went through all logs
and noticed that the sasl mechanism being used by
producer/consumer/adminclinet/mirrormakerconnectors was not same. Had to
manually set sasl mechanism for each of these configs to fix the issue. Below
are the details of worker configs and connector configs.
Worker configs are as follows:
```
bootstrap.servers=abc-broker-1:9093
security.protocol=SASL_SSL
sasl.mechanism=PLAIN
sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule
required username="abc-broker-superuser"
password="abc-broker-superuser-password";
producer.security.protocol=SASL_SSL
producer.sasl.mechanism=PLAIN
producer.sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule
required username="abc-broker-superuser"
password="abc-broker-superuser-password";
group.id=connect-tails
key.converter=org.apache.kafka.connect.json.JsonConverter
value.converter=org.apache.kafka.connect.json.JsonConverter
key.converter.schemas.enable=false
value.converter.schemas.enable=false
internal.key.converter=org.apache.kafka.connect.json.JsonConverter
internal.value.converter=org.apache.kafka.connect.json.JsonConverter
internal.key.converter.schemas.enable=false
internal.value.converter.schemas.enable=false
offset.storage.topic=connect-offsets-test
config.storage.topic=connect-configs-test
status.storage.topic=connect-status-test
producer.ssl.truststore.password=truststore_password
producer.ssl.truststore.location=/opt/projects/confluent/wildcard.kafka.iggroup.local.jks
producer.ssl.keystore.password=keystore_password
producer.ssl.keystore.location=/opt/projects/confluent/wildcard.kafka.iggroup.local.jks
```
Connector configs:
```
{
"name": "MM9",
"config": {
"connector.class": "org.apache.kafka.connect.mirror.MirrorSourceConnector",
"producer.sasl.jaas.config":
"org.apache.kafka.common.security.plain.PlainLoginModule required
username='xyz-broker-superuser' password='xyz-broker-superuser-password';",
"errors.log.include.messages": "true",
"target.cluster.sasl.jaas.config":
"org.apache.kafka.common.security.plain.PlainLoginModule required
username='abc-broker-superuser' password='abc-broker-superuser-password';",
"sync.topic.acls.enabled": "false",
"tasks.max": "3",
"source.cluster.producer.security.protocol": "SASL_SSL",
"emit.checkpoints.interval.seconds": "1",
"source.cluster.alias": "xyz-broker",
"target.cluster.producer.sasl.jaas.config":
"org.apache.kafka.common.security.plain.PlainLoginModule required
username='abc-broker-superuser' password='abc-broker-superuser-password';",
"source.cluster.producer.sasl.mechanism": "PLAIN",
"target.cluster.producer.bootstrap.servers":
"abc-broker-3:9093,abc-broker-2:9093",
"enabled": "true",
"target.cluster.admin.bootstrap.servers":
"abc-broker-3:9093,abc-broker-2:9093",
"target.cluster.producer.security.protocol": "SASL_SSL",
"target.cluster.security.protocol": "SASL_SSL",
"target.cluster.consumer.sasl.mechanism": "PLAIN",
"value.converter": "org.apache.kafka.connect.converters.ByteArrayConverter",
"errors.log.enable": "true",
"source.cluster.admin.bootstrap.servers":
"xyz-broker-1:9093,xyz-broker-2:9093",
"key.converter": "org.apache.kafka.connect.converters.ByteArrayConverter",
"clusters": "xyz-broker, abc-broker",
"source.cluster.producer.bootstrap.servers":
"xyz-broker-1:9093,xyz-broker-2:9093",
"target.cluster.consumer.sasl.jaas.config":
"org.apache.kafka.common.security.plain.PlainLoginModule required
username='abc-broker-superuser' password='abc-broker-superuser-password';",
"producer.security.protocol": "SASL_SSL",
"topics": "messaging_ops_mm8",
"source.cluster.producer.sasl.jaas.config":
"org.apache.kafka.common.security.plain.PlainLoginModule required
username='xyz-broker-superuser' password='xyz-broker-superuser-password';",
"target.cluster.sasl.mechanism": "PLAIN",
"source.cluster.consumer.security.protocol": "SASL_SSL",
"groups": "consumer-group-.*",
"source.cluster.consumer.sasl.mechanism": "PLAIN",
"source.cluster.sasl.jaas.config":
"org.apache.kafka.common.security.plain.PlainLoginModule required
username='xyz-broker-superuser' password='xyz-broker-superuser-password';",
"source.cluster.bootstrap.servers": "xyz-broker-1:9093,xyz-broker-2:9093",
"source.cluster.sasl.mechanism": "PLAIN",
"producer.sasl.mechanism": "PLAIN",
"target.cluster.alias": "abc-broker",
"target.cluster.consumer.security.protocol": "SASL_SSL",
"task.class": "org.apache.kafka.connect.mirror.MirrorSourceTask",
"target.cluster.consumer.bootstrap.servers":
"abc-broker-3:9093,abc-broker-2:9093",
"name": "MM9",
"target.cluster.bootstrap.servers": "abc-broker-3:9093,abc-broker-2:9093",
"emit.heartbeats.interval.seconds": "1",
"task.assigned.partitions": "heartbeats-0",
"source.cluster.security.protocol": "SASL_SSL",
"target.cluster.producer.sasl.mechanism": "PLAIN",
"source.cluster.consumer.bootstrap.servers":
"xyz-broker-1:9093,xyz-broker-2:9093"
}
}
```
> MirrorMaker 2.0 (KIP-382)
> -------------------------
>
> Key: KAFKA-7500
> URL: https://issues.apache.org/jira/browse/KAFKA-7500
> Project: Kafka
> Issue Type: New Feature
> Components: KafkaConnect, mirrormaker
> Affects Versions: 2.4.0
> Reporter: Ryanne Dolan
> Assignee: Ryanne Dolan
> Priority: Major
> Labels: pull-request-available, ready-to-commit
> Fix For: 2.4.0
>
> Attachments: Active-Active XDCR setup.png
>
>
> Implement a drop-in replacement for MirrorMaker leveraging the Connect
> framework.
> [https://cwiki.apache.org/confluence/display/KAFKA/KIP-382%3A+MirrorMaker+2.0]
> [https://github.com/apache/kafka/pull/6295]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
