Re: spark.streaming.receiver.maxRate Not taking effect

2015-07-01 Thread Ted Yu
This might be related: SPARK-6985 Cheers On Wed, Jul 1, 2015 at 10:27 AM, Laeeq Ahmed wrote: > Hi, > > I have set "spark.streaming.receiver.maxRate" to "100". My batch interval > is 4sec but still sometimes there are more than 400 records per batch. I am > using spark 1.2.0. > > Regards, > Lae

spark.streaming.receiver.maxRate Not taking effect

2015-07-01 Thread Laeeq Ahmed
Hi, I have set "spark.streaming.receiver.maxRate" to "100". My batch interval is 4sec but still sometimes there are more than 400 records per batch. I am using spark 1.2.0. Regards,Laeeq