Hello Kane, do you mind attach your index file causing the issue if you still have it?
Guozhang On Fri, Nov 1, 2013 at 8:42 AM, Guozhang Wang <wangg...@gmail.com> wrote: > Currently the index files will only be deleted on startup if there are any > .swap file indicating the server crashed while opening the log segments. We > should probably change this logic. > > Guozhang > > > On Fri, Nov 1, 2013 at 8:16 AM, Kane Kane <kane.ist...@gmail.com> wrote: > >> Filed a bug meanwhile, https://issues.apache.org/jira/browse/KAFKA-1112 >> >> >> On Fri, Nov 1, 2013 at 8:15 AM, Neha Narkhede <neha.narkh...@gmail.com >> >wrote: >> >> > Jun, >> > >> > I've seen this happen in the latest code in trunk, need to remember how >> to >> > reproduce it. >> > >> > Thanks, >> > Neha >> > On Nov 1, 2013 7:59 AM, "Jun Rao" <jun...@gmail.com> wrote: >> > >> > > Are you using the latest code in the 0.8 branch? >> > > >> > > Thanks, >> > > >> > > Jun >> > > >> > > >> > > On Fri, Nov 1, 2013 at 7:36 AM, Kane Kane <kane.ist...@gmail.com> >> wrote: >> > > >> > > > Neha, yes when i kill it with -9, sure I will file a bug. >> > > > >> > > > Thanks. >> > > > >> > > > >> > > > On Fri, Nov 1, 2013 at 3:43 AM, Neha Narkhede < >> neha.narkh...@gmail.com >> > > > >wrote: >> > > > >> > > > > When you say the Kafka dies, did you mean a kill -9 or kill -15 ? >> I >> > > agree >> > > > > that Kafka should try and delete/rebuild index files, but in this >> > case, >> > > > it >> > > > > sounds like a bug. Can you file a JIRA? >> > > > > >> > > > > Thanks, >> > > > > Neha >> > > > > >> > > > > >> > > > > On Fri, Nov 1, 2013 at 1:51 AM, Kane Kane <kane.ist...@gmail.com> >> > > wrote: >> > > > > >> > > > > > When machine with kafka dies, most often broker cannot start >> itself >> > > > with >> > > > > > errors about index files being corrupt. After i delete them >> > manually >> > > > > broker >> > > > > > usually can boot up successfully. Shouldn't kafka try to >> > > delete/rebuild >> > > > > > broken index files itself? >> > > > > > >> > > > > > Also this exception looks a bit weird: >> > > > > > java.lang.IllegalArgumentException: requirement failed: Corrupt >> > index >> > > > > > found, index file >> > > > > > (/disk1/kafka-logs/benchmark-2/00000000000000385258.index) has >> > > non-zero >> > > > > > size but the last offset is 385258 and the base offset is 385258 >> > > > > > >> > > > > > Thanks. >> > > > > > >> > > > > >> > > > >> > > >> > >> > > > > -- > -- Guozhang > -- -- Guozhang
