If there is somewhere I can +1 this feature let me know.

My use case is for financial indicators (math formulas) and a lot of them go by 
window count like moving average.

Thanks
A

From: Tathagata Das [mailto:tathagata.das1...@gmail.com]
Sent: February-26-14 2:05 PM
To: user@spark.apache.org
Cc: u...@spark.incubator.apache.org
Subject: Re: window every n elements instead of time based

Currently, all in-built DStream operation is time-based windowing. We may 
provide count-based windowing in the future.

On Wed, Feb 26, 2014 at 9:34 AM, Adrian Mocanu 
<amoc...@verticalscope.com<mailto:amoc...@verticalscope.com>> wrote:
Hi
Is there a way to do window processing but not based on time but every 6 items 
going through the stream?

Example:
Window of size 3 with 1 item "duration"
Stream data: 1,2,3,4,5,6,7
[1,2,3]=window 1
[2,3,4]=window 2
[3,4,5]=window 2
etc

-Adrian


Reply via email to