Re: too many open files - broker died

2013-11-02 Thread Kane Kane
Thanks, Jun. On Sat, Nov 2, 2013 at 8:31 PM, Jun Rao wrote: > The # of required open file handlers is # client socket connections + # log > segment and index files. > > Thanks, > > Jun > > > On Fri, Nov 1, 2013 at 10:28 PM, Kane Kane wrote: > >> I had only 1 topic with 45 partitions replicated a

Re: Controlled shutdown failure, retry settings

2013-11-02 Thread Jun Rao
replica.lag.time.max.ms is used to detect a failed broker. replica.lag.max.messages is used to detect a slow broker. Thanks, Jun On Fri, Nov 1, 2013 at 10:36 PM, Jason Rosenberg wrote: > In response to Joel's point, I think I do understand that messages can be > lost, if in fact we have dropp

Re: too many open files - broker died

2013-11-02 Thread Jun Rao
The # of required open file handlers is # client socket connections + # log segment and index files. Thanks, Jun On Fri, Nov 1, 2013 at 10:28 PM, Kane Kane wrote: > I had only 1 topic with 45 partitions replicated across 3 brokers. > After several hours of uploading some data to kafka 1 broke