n <[hidden email]> wrote:
>> Hi,
>>
>> I also have a use for count-based windowing. I'd like to process data
>> batches by size as opposed to time. Is this feature on the development
>> roadmap? Is there a JIRA ticket for it?
>>
&g
based windowing. I'd like to process data
>> batches by size as opposed to time. Is this feature on the development
>> roadmap? Is there a JIRA ticket for it?
>>
>> Thank you,
>>
>> Michael
>>
>>
>>
>> --
>> View this mess
ss data
> batches by size as opposed to time. Is this feature on the development
> roadmap? Is there a JIRA ticket for it?
>
> Thank you,
>
> Michael
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/window-ever
ize as opposed to time. Is this feature on the development
> roadmap? Is there a JIRA ticket for it?
>
> Thank you,
>
> Michael
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/window-every-n-elements-instead-of-time-ba
e.com/window-every-n-elements-instead-of-time-based-tp2085p15701.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e
go by window count like moving average.
>
>
>
> Thanks
>
> A
>
>
>
> *From:* Tathagata Das [mailto:tathagata.das1...@gmail.com]
> *Sent:* February-26-14 2:05 PM
> *To:* user@spark.apache.org
> *Cc:* u...@spark.incubator.apache.org
> *Subject:* Re: window every
: u...@spark.incubator.apache.org
Subject: Re: window every n elements instead of time based
Currently, all in-built DStream operation is time-based windowing. We may
provide count-based windowing in the future.
On Wed, Feb 26, 2014 at 9:34 AM, Adrian Mocanu
mailto:amoc...@verticalscope.com
Currently, all in-built DStream operation is time-based windowing. We may
provide count-based windowing in the future.
On Wed, Feb 26, 2014 at 9:34 AM, Adrian Mocanu wrote:
> Hi
>
> Is there a way to do window processing but not based on time but every 6
> items going through the stream?
>
>
>
Hi
Is there a way to do window processing but not based on time but every 6 items
going through the stream?
Example:
Window of size 3 with 1 item "duration"
Stream data: 1,2,3,4,5,6,7
[1,2,3]=window 1
[2,3,4]=window 2
[3,4,5]=window 2
etc
-Adrian
