In a test in staging environment, we kill -9 the broker. It was started back up by runit and started recovering. We are seeing errors like this:
WARN Found an corrupted index file, /mnt/services/kafka/data/TOPIC-17/00000000000016763460.index, deleting and rebuilding index... (kafka.log.Log) The file is a multiple of 8 (10485760) and has entries. So this leads me to believe that lastOffset <= baseOffset ( https://code.hq.twilio.com/data/kafka/blob/35003fd51b80d605d40339dead623012442a92ab/core/src/main/scala/kafka/log/OffsetIndex.scala#L354 ) Was wondering how that could happen ? Isn't baseOffset taken from the filename and therefore is the FIRST entry in the log ? All other entries should be greater then that.
