You should just kill the process without the -9. That will send a SIGHUP. This allows the process to shut down cleanly and flush offset commits before exiting. Otherwise you’re going to have more duplicate messages (or dropped messages, depending on your configuration for offset commits). You should also stop all the mirror maker instances in a given consumer group in parallel, as this will minimize the number of rebalances and how long it takes for you to start passing messages again.
-Todd On Tue, Feb 21, 2017 at 5:14 PM, Qian Zhu <qi...@trulia.com> wrote: > Hi, > For now, I am doing “kill –9 processID” to stop the Kafka Mirror > Maker. I am wondering whether there is a better way (e.g. a command) to do > so? I don’t expect to stop the mirror maker frequently but I would like to > have a script to automate the start and stop. > > Thanks a lot! > Qian Zhu > -- *Todd Palino* Staff Site Reliability Engineer Data Infrastructure Streaming linkedin.com/in/toddpalino
