Re: Continuous warning while consuming using new kafka-spark010 API

2016-11-04 Thread Cody Koeninger
I answered the duplicate post on the user mailing list, I'd say keep the discussion there. On Fri, Nov 4, 2016 at 12:14 PM, vonnagy wrote: > Nitin, > > I am getting the similar issues using Spark 2.0.1 and Kafka 0.10. I have to > jobs, one that uses a Kafka stream and one that uses just the Kafka

Re: Continuous warning while consuming using new kafka-spark010 API

2016-11-04 Thread vonnagy
Nitin, I am getting the similar issues using Spark 2.0.1 and Kafka 0.10. I have to jobs, one that uses a Kafka stream and one that uses just the KafkaRDD. With the KafkaRDD, I continually get the "Failed to get records". I have adjusted the polling with `spark.streaming.kafka.consumer.poll.ms` a