Re: reduceByKeyAndWindow with initial state

I'm talking about the variant with inverseReduce. For example, if my batch duration is 1s and window duration is 10s, when I start the streaming job I'd want to start with a complete window instead of empty window, given I already have the RDDs for the batches that are missing at startup. After 1s,

Re: reduceByKeyAndWindow with initial state

Are you talking about reduceByKeyAndWindow with or without inverse reduce? TD On Fri, Jul 10, 2015 at 2:07 AM, Imran Alam wrote: > We have a streaming job that makes use of reduceByKeyAndWindow >

reduceByKeyAndWindow with initial state

We have a streaming job that makes use of reduceByKeyAndWindow . We want this to work with an initial state. The idea is to avoid losing state if the streami