Re: Mirror Maker tool is not running

2019-05-05 Thread Kidong Lee
Hi, I have written a tool like mirror maker: https://github.com/mykidong/kafka-spiegel/blob/master/README.md You can try this. Cheers, Kidong Lee 2019년 5월 4일 (토) 오후 8:38, ASHOK MACHERLA 님이 작성: > > > Sent from Outlook > > On 30-Apr-2019 3:37 PM, ASHOK MACHERLA wrote: > > Dear Team > > > > Pl

Re: Mirror Maker tool is not running

2019-05-05 Thread ASHOK MACHERLA
Hello This is new tool and our client doesn't give permission to use this tool. Currently mirror maker is working fine. But in server.properties DC cluster we set 75KB in message.max.bytes=75000 DR cluster we set 1.5 MB message.max.bytes=150 Here , source is DC, target is DR, Data going

Re: Mirror Maker tool is not running

2019-05-05 Thread Ryanne Dolan
This can be caused by compressed messages being decompressed by the MirrorMaker consumer but not recompressed by the producer. In order to prevent this, enable shallow iteration in the consumer, or enable compression in the producer. Ryanne On Sun, May 5, 2019, 8:35 AM ASHOK MACHERLA wrote: > H

Re: Mirror Maker tool is not running

2019-05-05 Thread ASHOK MACHERLA
Dear Ryanne Where can I use that compression method either source side or target side??? What type of parameters can I required ?? What is the configuration ??? Can please tell Ryanne. Thanks for your help.. Sent from Outlook

Kafka hardware requirements

2019-05-05 Thread Jean-Marc Hyppolite
Hello, I would like to know the impact of running kafka in production on virtual machines connected to a SAN (Storage Area Network)? (I mean the impact on kafka performance, what would be a max limit in terms of number of messages per second, number of producers and consumers, kafka can deal wi