Filed a bug meanwhile, https://issues.apache.org/jira/browse/KAFKA-1112
On Fri, Nov 1, 2013 at 8:15 AM, Neha Narkhede <neha.narkh...@gmail.com>wrote: > Jun, > > I've seen this happen in the latest code in trunk, need to remember how to > reproduce it. > > Thanks, > Neha > On Nov 1, 2013 7:59 AM, "Jun Rao" <jun...@gmail.com> wrote: > > > Are you using the latest code in the 0.8 branch? > > > > Thanks, > > > > Jun > > > > > > On Fri, Nov 1, 2013 at 7:36 AM, Kane Kane <kane.ist...@gmail.com> wrote: > > > > > Neha, yes when i kill it with -9, sure I will file a bug. > > > > > > Thanks. > > > > > > > > > On Fri, Nov 1, 2013 at 3:43 AM, Neha Narkhede <neha.narkh...@gmail.com > > > >wrote: > > > > > > > When you say the Kafka dies, did you mean a kill -9 or kill -15 ? I > > agree > > > > that Kafka should try and delete/rebuild index files, but in this > case, > > > it > > > > sounds like a bug. Can you file a JIRA? > > > > > > > > Thanks, > > > > Neha > > > > > > > > > > > > On Fri, Nov 1, 2013 at 1:51 AM, Kane Kane <kane.ist...@gmail.com> > > wrote: > > > > > > > > > When machine with kafka dies, most often broker cannot start itself > > > with > > > > > errors about index files being corrupt. After i delete them > manually > > > > broker > > > > > usually can boot up successfully. Shouldn't kafka try to > > delete/rebuild > > > > > broken index files itself? > > > > > > > > > > Also this exception looks a bit weird: > > > > > java.lang.IllegalArgumentException: requirement failed: Corrupt > index > > > > > found, index file > > > > > (/disk1/kafka-logs/benchmark-2/00000000000000385258.index) has > > non-zero > > > > > size but the last offset is 385258 and the base offset is 385258 > > > > > > > > > > Thanks. > > > > > > > > > > > > > > >