Re: Spark Streaming - Duration 1s not matching reality

2015-03-05 Thread Tathagata Das
> I'm not sure where to get from here or how to benchmark the time to > actually > process the events > > Any hint or useful link would be appreciated. > Thanks for your help. > > > > > -- > View this message in co

Spark Streaming - Duration 1s not matching reality

2015-03-05 Thread eleroy
ore 4 to 5sec to get 600,000 - 1,000,000 events counted. I'm not sure where to get from here or how to benchmark the time to actually process the events Any hint or useful link would be appreciated. Thanks for your help. -- View this message in context: http://apache-spark-user-list.1001