Edoardo Comar created KAFKA-15144:
-------------------------------------
Summary: Checkpoint downstreamOffset stuck to 1
Key: KAFKA-15144
URL: https://issues.apache.org/jira/browse/KAFKA-15144
Project: Kafka
Issue Type: Bug
Components: mirrormaker
Reporter: Edoardo Comar
Attachments: edo-connect-mirror-maker-sourcetarget.properties
Steps to reproduce :
Start source cluster
Start target cluster
start connect-mirror-maker.sh using a config like the attached
create topic in source cluster
produce a few messages
consume them all with autocmiit enabled
then dumping the Checkpoint topic content e.g.
% bin/kafka-console-consumer.sh --bootstrap-server localhost:9192 --topic
source.checkpoints.internal --from-beginning --formatter
org.apache.kafka.connect.mirror.formatters.CheckpointFormatter
Checkpoint\{consumerGroupId=edogroup,
topicPartition=source.vf-mirroring-test-edo-0, upstreamOffset=3,
downstreamOffset=1, metadata=}
the downstreamOffset remains at 1, while, in a fresh cluster pair like with the
source topic created while MM2 is running, I'd expect the downstreamOffset to
match the upstreamOffset.
dumping the offset sync topic
% bin/kafka-console-consumer.sh --bootstrap-server localhost:9192 --topic
mm2-offset-syncs.source.internal --from-beginning --formatter
org.apache.kafka.connect.mirror.formatters.OffsetSyncFormatter
shows matching initial offsets
OffsetSync\{topicPartition=vf-mirroring-test-edo-0, upstreamOffset=0,
downstreamOffset=0}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
