Re: question on spark.streaming.kafka.maxRetries

2016-02-03 Thread Cody Koeninger
KafkaRDD will use the standard kafka configuration parameter refresh.leader.backoff.ms if it is set in the kafkaParams map passed to createDirectStream. On Tue, Feb 2, 2016 at 9:10 PM, Chen Song wrote: > For Kafka direct stream, is there a way to set the time between successive > retries? From m

question on spark.streaming.kafka.maxRetries

2016-02-02 Thread Chen Song
For Kafka direct stream, is there a way to set the time between successive retries? From my testing, it looks like it is 200ms. Any way I can increase the time?