-dev +user

Hi Sandeep,

Perhaps (flat)mapping values and using an accumulator?


> El 29/10/2015, a las 23:08, Sandeep Giri <sand...@knowbigdata.com> escribió:
> 
> Dear All,
> 
> If a continuous stream of text is coming in and you have to keep publishing 
> the overall word count so far since 0:00 today, what would you do?
> 
> Publishing the results for a window is easy but if we have to keep 
> aggregating the results, how to go about it?
> 
> I have tried to keep an StreamRDD with aggregated count and keep doing a 
> fullouterjoin but didn't work. Seems like the StreamRDD gets reset.
> 
> Kindly help.
> 
> Regards,
> Sandeep Giri
> 

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

Reply via email to