When you say the Kafka dies, did you mean a kill -9 or kill -15 ? I agree that Kafka should try and delete/rebuild index files, but in this case, it sounds like a bug. Can you file a JIRA?
Thanks, Neha On Fri, Nov 1, 2013 at 1:51 AM, Kane Kane <kane.ist...@gmail.com> wrote: > When machine with kafka dies, most often broker cannot start itself with > errors about index files being corrupt. After i delete them manually broker > usually can boot up successfully. Shouldn't kafka try to delete/rebuild > broken index files itself? > > Also this exception looks a bit weird: > java.lang.IllegalArgumentException: requirement failed: Corrupt index > found, index file > (/disk1/kafka-logs/benchmark-2/00000000000000385258.index) has non-zero > size but the last offset is 385258 and the base offset is 385258 > > Thanks. >