Re: 'Custom' mapping function on keyed WindowedStream

2018-02-26 Thread Seth Wiesman
I had to solve a similar problem, we use a process function with rocksdb and map state for the sub keys. So while we hit rocks on every element, only the specified sub keys are ever read from disk. Seth Wiesman| Software Engineer4 World Trade Center, 46th Floor, New York, NY 10007swies...@medi

'Custom' mapping function on keyed WindowedStream

2018-02-26 Thread Marchant, Hayden
I would like to create a custom aggregator function for a windowed KeyedStream which I have complete control over - i.e. instead of implementing an AggregatorFunction, I would like to control the lifecycle of the flink state by implementing the CheckpointedFunction interface, though I still want