Re: Intended behavior when a broker loses its log volume

2020-10-12 Thread Tom Bentley
Hi Peter, When an unexpected IOException happens when accessing a file in a log directory, the broker will take that log directory offline. That means follower fetchers for partitions on that log dir will be stopped, the broker will stop serving requests from those logs and a notification is sent

Intended behavior when a broker loses its log volume

2020-10-11 Thread Peter Bukowinski
Greeting, all. What is the expected behavior of a broker when it loses its only configured data log directory? I’m running kafka 2.2.1 in aws and we had an outage caused by the loss of an attached volume on one of the brokers. The broker did not relinquish leadership of its topic partitions wh