Re: Error messages in logs

2013-08-12 Thread Joel Koshy
The closed by interrupt exception is because the underlying "leader-finder-thread" has been interrupted - this is done for e.g., on a rebalance. Do you see any rebalancing messages in your consumer logs? How many topics are you consuming? Are the topics present on the broker and is there a leader f

Re: Error messages in logs

2013-08-12 Thread Eric Sites
Very clean logs. Just deletes and rolls messages: [2013-08-12 16:49:15,371] INFO [Kafka Log on Broker 4], Rolling incoming-6 due to full data log (kafka.log.Log) [2013-08-12 16:49:15,429] INFO [Kafka Log on Broker 4], Rolling log 'incoming-6' to /mnt/data/kafka/incoming-6/00434346.log

Re: Error messages in logs

2013-08-12 Thread Joel Koshy
The consumer uses a sync.producer to look up topic metadata for topics that it consumes. For some reason, it is unable to establish a connection to the brokers. Are the brokers all up with clean logs? On Mon, Aug 12, 2013 at 8:39 AM, Eric Sites wrote: > I am getting some new messages in my 0.8 Ja

Error messages in logs

2013-08-12 Thread Eric Sites
I am getting some new messages in my 0.8 Java producer app. I am running 6 Kafka brokers. The app producing these logs messages is not doing anything, i.e. Not producing messages. Anywhere form every 5 minutes to 10 seconds sometimes. [2013-08-12 14:45:20,714] ERROR Producer connection to kafk