reduceByKeyAndWindow with initial state

2015-07-10 Thread Imran Alam
We have a streaming job that makes use of reduceByKeyAndWindow . We want this to work with an initial state. The idea is to avoid losing state if the streami

Re: reduceByKeyAndWindow with initial state

2015-07-12 Thread Imran Alam
. After 1s, I'd want the oldest batch to be dropped off, and the inverse reduce being applied to all RDDs as usual. On Sat, Jul 11, 2015 at 6:50 AM, Tathagata Das wrote: > Are you talking about reduceByKeyAndWindow with or without inverse reduce? > > TD > > On Fri, Jul 1