Re: uncontrolled shutdown

2013-11-01 Thread Kane Kane
Hello, yes, I can easily reproduce it, will send it to you asap. Thanks. On Fri, Nov 1, 2013 at 2:05 PM, Guozhang Wang wrote: > Hello Kane, do you mind attach your index file causing the issue if you > still have it? > > Guozhang > > > On Fri, Nov 1, 2013 at 8:42 AM, Guozhang Wang wrote: > >

Re: uncontrolled shutdown

2013-11-01 Thread Guozhang Wang
Hello Kane, do you mind attach your index file causing the issue if you still have it? Guozhang On Fri, Nov 1, 2013 at 8:42 AM, Guozhang Wang wrote: > Currently the index files will only be deleted on startup if there are any > .swap file indicating the server crashed while opening the log seg

Re: uncontrolled shutdown

2013-11-01 Thread Guozhang Wang
Currently the index files will only be deleted on startup if there are any .swap file indicating the server crashed while opening the log segments. We should probably change this logic. Guozhang On Fri, Nov 1, 2013 at 8:16 AM, Kane Kane wrote: > Filed a bug meanwhile, https://issues.apache.org

Re: uncontrolled shutdown

2013-11-01 Thread Kane Kane
Filed a bug meanwhile, https://issues.apache.org/jira/browse/KAFKA-1112 On Fri, Nov 1, 2013 at 8:15 AM, Neha Narkhede wrote: > Jun, > > I've seen this happen in the latest code in trunk, need to remember how to > reproduce it. > > Thanks, > Neha > On Nov 1, 2013 7:59 AM, "Jun Rao" wrote: > > >

Re: uncontrolled shutdown

2013-11-01 Thread Neha Narkhede
Jun, I've seen this happen in the latest code in trunk, need to remember how to reproduce it. Thanks, Neha On Nov 1, 2013 7:59 AM, "Jun Rao" wrote: > Are you using the latest code in the 0.8 branch? > > Thanks, > > Jun > > > On Fri, Nov 1, 2013 at 7:36 AM, Kane Kane wrote: > > > Neha, yes when

Re: uncontrolled shutdown

2013-11-01 Thread Kane Kane
Hello Jun Rao, not it's not the head, I've compiled it a couple of weeks ago. Should i try with latest? On Fri, Nov 1, 2013 at 7:58 AM, Jun Rao wrote: > Are you using the latest code in the 0.8 branch? > > Thanks, > > Jun > > > On Fri, Nov 1, 2013 at 7:36 AM, Kane Kane wrote: > > > Neha, yes w

Re: uncontrolled shutdown

2013-11-01 Thread Jun Rao
Are you using the latest code in the 0.8 branch? Thanks, Jun On Fri, Nov 1, 2013 at 7:36 AM, Kane Kane wrote: > Neha, yes when i kill it with -9, sure I will file a bug. > > Thanks. > > > On Fri, Nov 1, 2013 at 3:43 AM, Neha Narkhede >wrote: > > > When you say the Kafka dies, did you mean a

Re: uncontrolled shutdown

2013-11-01 Thread Kane Kane
Neha, yes when i kill it with -9, sure I will file a bug. Thanks. On Fri, Nov 1, 2013 at 3:43 AM, Neha Narkhede wrote: > When you say the Kafka dies, did you mean a kill -9 or kill -15 ? I agree > that Kafka should try and delete/rebuild index files, but in this case, it > sounds like a bug. Ca

Re: uncontrolled shutdown

2013-11-01 Thread Neha Narkhede
When you say the Kafka dies, did you mean a kill -9 or kill -15 ? I agree that Kafka should try and delete/rebuild index files, but in this case, it sounds like a bug. Can you file a JIRA? Thanks, Neha On Fri, Nov 1, 2013 at 1:51 AM, Kane Kane wrote: > When machine with kafka dies, most often

uncontrolled shutdown

2013-11-01 Thread Kane Kane
When machine with kafka dies, most often broker cannot start itself with errors about index files being corrupt. After i delete them manually broker usually can boot up successfully. Shouldn't kafka try to delete/rebuild broken index files itself? Also this exception looks a bit weird: java.lang.I