Re: Issues Running Kafka Producer Java example

2014-11-22 Thread Stream Processing
I tried running the example on another topic with single partition and single replica and same example Java Producer works On Sat, Nov 8, 2014 at 4:25 PM, Hardik Pandya wrote: > Hello Champs, > > I am trying to run first java producer example. > > Upon running this example, producer successfull

Re: Kafka restart takes a long time

2014-11-22 Thread Harsha
It might logs check your kafka logs dir (server logs) . Kafka can produce lot of logs in a quick time make sure thats whats in play here. -Harsha On Sat, Nov 22, 2014, at 01:37 PM, Rajiv Kurian wrote: > Actually see a bunch of errors. One of the brokers is out of space and > this > might be causin

Re: Kafka restart takes a long time

2014-11-22 Thread Rajiv Kurian
Actually see a bunch of errors. One of the brokers is out of space and this might be causing everything to spin out of control. Some logs: On *broker 1* (the one that has run out of space): 2014-11-22T21:20:42.790Z FATAL [ReplicaFetcherThread-1-13 ] [kafka.server.ReplicaFetcherThread

Re: Kafka restart takes a long time

2014-11-22 Thread Harsha
Rajiv , which version of kafka are you using and do you see any errors when the server goes down after sending few messages. -Harsha On Sat, Nov 22, 2014, at 01:05 PM, Rajiv Kurian wrote: > The brokers also seem unavailable while this is going on. Each of these > log messages

Re: Kafka restart takes a long time

2014-11-22 Thread Rajiv Kurian
The brokers also seem unavailable while this is going on. Each of these log messages takes 2-3 seconds so at about 1200 partitions it takes up quite a bit of time. Ultimately it does recover though but sadly it goes down soon enough after I start sending it messages. On Sat, Nov 22, 2014 at 11:2

Kafka restart takes a long time

2014-11-22 Thread Rajiv Kurian
A 3 node kafka broker cluster went down yesterday (all nodes) and I just noticed it this morning. When I restarted it this morning, I see a lengthy list of messages like this: Loading log 'mytopic-partitionNum" Recovering unflushed segment 'some number' of in log mytopic-partitionNum. Completed lo