Re: Possible Memory Leak in Record Accumulator

2015-08-20 Thread Drew Goya
The producer did not recover on its own. The app froze for upwards of 10 minutes. Long after net connectivity was restored. I could telnet to port 9092 on the broker in the error logs. After collecting the heap dump I had to kill and restart the app. The stack trace of the producer-network-threa

Re: Possible Memory Leak in Record Accumulator

2015-08-20 Thread Gwen Shapira
It will also be interesting to see stack trace from "kafka-producer-network-thread" (which is the one that should be sending the batches but maybe got stuck), and if this issue is reproducible for you in a test environment - maybe generate logs in TRACE level. On Thu, Aug 20, 2015 at 5:35 PM, Gwen

Re: Possible Memory Leak in Record Accumulator

2015-08-20 Thread Gwen Shapira
Hi, I didn't see this issue during our network hiccups. You wrote you saw: Got error produce response with correlation id 17717 on topic-partition event.beacon-38, retrying (8 attempts left). Error: NETWORK_EXCEPTION What did you see after? Especially once the network issue was resolved? more re

Possible Memory Leak in Record Accumulator

2015-08-20 Thread Drew Goya
I've been running into an issue with the 0.8.2.1 new producer for a few weeks now and I haven't been able to figure it out. Hopefully someone on the list can help! First off my producer config looks like this: props.put(ProducerConfig.ACKS_CONFIG, "1") props.put(ProducerConfig.RETRIES_CO