Re: Kafka stream receiver stops input

2014-08-27 Thread Dibyendu Bhattacharya
I think this is a known issue in Existing KafkaUtils. Even we had this issue. The problem is in Existing KafkaUtil there is no way to control the message flow. You can refer to another mail thread on Low Level Kafka Consumer which I have written to solve this issue along with many other.. Dib On

Kafka stream receiver stops input

2014-08-27 Thread Tim Smith
Hi, I have Spark (1.0.0 on CDH5) running with Kafka 0.8.1.1. I have a streaming jobs that reads from a kafka topic and writes output to another kafka topic. The job starts fine but after a while the input stream stops getting any data. I think these messages show no incoming data on the stream: 1