Re: CEP & checkpoints/savepoints

2018-09-18 Thread Dawid Wysakowicz
Hi Ron, Fabian is absolutely right. CEP library uses standard checkpointing mechanisms of Flink. You do not need any additional configuration. The only consideration one has to think of is that if you change some conditions in your Pattern, and restart from checkpoint/savepoint you might get some

Re: CEP & checkpoints/savepoints

2018-09-17 Thread Fabian Hueske
Hi Ron, The CEP library is built on top of the DataStream / ProcessFunction API and holds all necessary state (the state of the pattern matching state machine) in regular keyed MapState. Hence, CEP does not require a dedicated configuration for checkpoints and savepoints, besides the regular appli

CEP & checkpoints/savepoints

2018-09-17 Thread Ron Crocker
I’m working with CEP to detect when something stops reporting (which is very simple), but I need to show the team that the jobs will survive being shutdown and restarted without either a) declaring that everything stopped reporting (false positives) or b) missing things that have indeed stopped