Re: Closing socket connections during extended message delivery

2013-05-21 Thread Neha Narkhede
Yes. This was added to get around the VIP hard killing connections that are idle. If your producer doesn't use a VIP you can set this high enough so it rarely reconnects. Thanks, Neha On May 21, 2013 8:13 AM, "Jason Weiss" wrote: > Ahh - I see, thank you. > > Would you describe this as a "tunabl

Re: Closing socket connections during extended message delivery

2013-05-21 Thread Jason Weiss
Ahh - I see, thank you. Would you describe this as a "tunable" parameter to achieve higher performance? For example, is it in a producer's interest to bump this figure up to say 250,000 from 30,000? Thanks again for the prompt response! Jason On 5/21/13 11:07 AM, "Jun Rao" wrote: >In 0.7, ea

Re: Closing socket connections during extended message delivery

2013-05-21 Thread Jun Rao
In 0.7, each producer reconnects to the broker periodically. Take a look at reconnect.interval in http://kafka.apache.org/07/configuration.html Thanks, Jun On Tue, May 21, 2013 at 7:35 AM, Jason Weiss wrote: > I've made some good progress on tuning Kafka for our needs, reaching about > 40,000

Closing socket connections during extended message delivery

2013-05-21 Thread Jason Weiss
I've made some good progress on tuning Kafka for our needs, reaching about 40,000 events per second in our environment. One thing that I noticed in all of the Kafka server logs is an inordinate amount (I think?) of Closing socket connection INFO statements. I realize they are INFO, so I assume