Re: Cant Able to start Kafka MirrorMaker

2020-05-01 Thread nitin agarwal
There is typo in your consumer configuration, it should be auto.offset.reset. Thanks, Nitin On Fri, May 1, 2020 at 12:28 PM vishnu murali wrote: > Hey Guys, > > I am trying to move data between one cluster to another cluster > > > > *Source* > > *Destination* > > *Zookeeper* > > 2181 > > 2182 >

Re: Kafka: Messages disappearing from topics, largestTime=0

2020-05-01 Thread Goran Sliskovic
Yes, that's a clean shutdown log, with few exceptions that are expected (connected clients get disconnected during shutdown). Add fsync after kafka shutdown should force OS to flush buffers to disk. I somehow suspect there is some problems during unmounting/mounting disks.However I don't know

Connector For MirrorMaker

2020-05-01 Thread vishnu murali
Hi Guys Previously I asked question about the Mirror maker and it is solved now. So Now I need to know is there any connectors available for that same. Like JdbcConnector acts as a source and sink for DB connection is there any connector available for performing mirror operations or does some

Re: Connector For MirrorMaker

2020-05-01 Thread Robin Moffatt
Are you talking about MirrorMaker 2? That runs as a connector. If not, perhaps you can clarify your question a bit as to what it is you are looking for. -- Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff On Fri, 1 May 2020 at 13:57, vishnu murali wrote: > Hi Guys >

Re: Connector For MirrorMaker

2020-05-01 Thread vishnu murali
Hi Robin I am using Apache Kafka there is service called kafka-mirror-maker.bat with the consumer and producer properties to copy topic from one cluster to another. I want to do that by using connector.. I didn't aware anything about MirrorMaker 2 and I didn't know how to download and configure

Request for adding into contributors list

2020-05-01 Thread Jun Wang
Hi, Please add my JIRA ID into the contributors list of Apache Kafka. Here is my JIRA profile: Username: wj1918 Full name: Jun Wang Thanks

Re: can kafka state stores be used as a application level cache by application to modify it from outside the stream topology?

2020-05-01 Thread Matthias J. Sax
Both stores sever a different purpose. Regular stores allow you to store state the application computes. Writing into the changelog is a fault-tolerance mechanism. Global store hold "axially" data that is provided from "outside" of the app. There is no changelog topic, but only the input topic (t

Re: Request for adding into contributors list

2020-05-01 Thread Matthias J. Sax
Done. On 5/1/20 11:21 AM, Jun Wang wrote: > Hi, > > Please add my JIRA ID into the contributors list of Apache Kafka. > > Here is my JIRA profile: > > Username: wj1918 > Full name: Jun Wang > > Thanks > signature.asc Description: OpenPGP digital signature

Re: Request for adding into contributors list

2020-05-01 Thread Jun Wang
Thank You ! From: Matthias J. Sax Sent: Friday, May 1, 2020 4:29 PM To: users@kafka.apache.org Subject: Re: Request for adding into contributors list Done. On 5/1/20 11:21 AM, Jun Wang wrote: > Hi, > > Please add my JIRA ID into the contributors list of Apache K