Shallow iteration should be enabled for the consumer, not producer. Ryanne
On Mon, May 6, 2019, 8:02 AM ASHOK MACHERLA <iash...@outlook.com> wrote: > Dear Team Members > > > > Please find these below configurations for mirror maker tool scripts > > > > *source-cluster.config* > > > > bootstrap.servers=192.168.175.128:9092,192.168.175.129:9092, > 192.168.175.130:9092 > > group.id=mirror-maker-consumer > > exclude.internal.topics=true > > client.id=mirror_maker_consumer > > security.protocol=SSL > > ssl.truststore.location=/opt/kafka/certificates/client.truststore.jks > > ssl.truststore.password=Sbi#123 > > auto.offset.reset=earliest > > max.poll.records=100 > > > > > > *target-cluster.config* > > > > bootstrap.servers=192.128.145.253:9092,192.128.145.254:9092, > 192.128.145.255:9092 > > acks=1 > > client.id=mirror_maker_producer > > security.protocol=SSL > > ssl.truststore.location=/opt/kafka/certificates/client.truststore.jks > > ssl.truststore.password=Sbi#123 > > *shallow.iterator.enable=true* > > > > As you suggested after that i added * shallow.iterator.enable=true* > target side configuration. > > Still we are facing same issues, > > > > *********************** Mirror maker Errors****************************** > > > > [2019-05-06 13:33:30,769] ERROR Error when sending message to topic > audit-logs with key: null, value: 1829 bytes with error: > (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback) > > java.lang.IllegalStateException: Producer is closed forcefully. > > at > org.apache.kafka.clients.producer.internals.RecordAccumulator.abortBatches(RecordAccumulator.java:513) > > at > org.apache.kafka.clients.producer.internals.RecordAccumulator.abortIncompleteBatches(RecordAccumulator.java:493) > > at > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:156) > > at java.lang.Thread.run(Thread.java:748) > > [2019-05-06 13:33:30,801] FATAL [mirrormaker-thread-11] Mirror maker > thread exited abnormally, stopping the whole mirror maker. > (kafka.tools.MirrorMaker$MirrorMakerThread) > > ************************************************************************** > > what is type of parameters we have to use either in source side or else in > producer side ??????????? > > > > > > Please tell me due to this we are not getting data from DC to DR cluster. > > Please help to resolve this , Thanks a lot > > > > Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for > Windows 10 > > > ------------------------------ > *From:* ASHOK MACHERLA <iash...@outlook.com> > *Sent:* Sunday, May 5, 2019 11:19:48 PM > *To:* users@kafka.apache.org > *Subject:* Re: Mirror Maker tool is not running > > Dear Ryanne > > Where can I use that compression method either source side or target > side??? > > What type of parameters can I required ?? > > What is the configuration ??? > Can please tell Ryanne. > > Thanks for your help.. > Sent from Outlook >