How to tune Kafka High Level Consumer for Production

2017-07-24 Thread Rachana Srivastava
I want to know how to tune/setup high level Kafka Client to a Kafka server in EC2 I set zookeeper.session.timeout.ms=5. I found that after some time I got following error in the logs. I want to know how to tune Kafka parameters to run the consumer for ever. I checked and found ZK is running

Why?? Kafka High Level Consumer is 0.8.2.2 Stop Responding After Few Hours... Timeout in Broker Log

2017-08-01 Thread Rachana Srivastava
I have written a high level Kafka consumer which is not responding on event sent after 2 hours. Only error I see in broker log like this. 2017-08-01 05:29:42,102 INFO kafka.network.Processor: Closing socket connection to /10.202.138.126. 2017-08-01 07:34:24,957 ERROR kafka.network.Proce