Hi, We are managing our kafka clusters by doing rolling restarts (e.g. we cleanly shutdown and restart each broker one at a time).
I'm working through an issue, whereby we are losing messages sent to a kafka broker, right before the broker is shutdown cleanly. I'm still using 0.7.2, so not sure if this is also the behavior in 0.8. I am trying to cleanly shutting down the kafka server by calling kafka.server.KafkaServer.shutdown(). I then wait for the shutdown to complete, by calling awaitShutdown(). However, it looks like this does not attempt to flush all logs before quitting, as I had assumed was the case. Is there a way to make sure this happens before the server stops? Jason