[ 
https://issues.apache.org/jira/browse/KAFKA-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332583#comment-15332583
 ] 

James Cheng commented on KAFKA-3848:
------------------------------------

Better documentation might help. Unfortunately, setting {{auto.offset.reset}} 
to {{smallest}} could have some other undesirable effects. See 
https://issues.apache.org/jira/browse/KAFKA-3370?focusedCommentId=15299148&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15299148
 

> Mirror Maker sometimes fails to mirror first batch of messages
> --------------------------------------------------------------
>
>                 Key: KAFKA-3848
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3848
>             Project: Kafka
>          Issue Type: Bug
>    Affects Versions: 0.9.0.1, 0.10.0.0
>            Reporter: James Clarke
>
> I am seeing an intermittent issue in Mirror Maker where the first batch of 
> messages are not always mirrored to the target cluster. All messages after 
> the first batch are mirrored.
> I have a github repo 
> ([jc/kafka-mirror-maker-test|https://github.com/jc/kafka-mirror-maker-test]) 
> which reproduces the issue using Confluent's docker containers (running 
> 0.10.0). However on our environment we are using our own kafka containers 
> running 0.9.0.1.
> Environment:
> - edge datacenter dc1. 1 zk server, 1 kafka server.
> - aggregate datacenter dc2. 1 zk server, 1 kafka server, 1 mirror maker.
> - kafka server setup to auto create topics
> - Mirrror maker configured mirror from dc1 to dc2 using a whitelist 
> containing both explicitly topics and regex topics.
> Steps to reproduce:
> - Send message to a non-existent topic in dc1.
> - Send a second message to topic in dc1.
> Observed:
> - After first message the topic is not created in dc2.
> - After second message topic is present in dc2.
> - Consuming from topic in dc1 shows both messages.
> - Consuming from topic in dc2 shows only the second message.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to