Re: FlinkCEP for large key spaces and long timeouts between events

2016-09-20 Thread Till Rohrmann
Hi David, you should be able to solve this kind of problem with Flink's CEP library. The important thing here is to define a pattern interval length so that patterns can time out. Otherwise, you will end up accumulating state which is never purged. This will eventually cause an OOM exception. How

FlinkCEP for large key spaces and long timeouts between events

2016-09-15 Thread David Koch
Hello, Is FlinkCEP applicable to large key spaces with potentially long timeouts between events that define a pattern? Ideally, without ridiculous hardware. More concretely, we segment users (one key per user) based on sequences of events for that user. A segment "Abandoned Cart" may be defined