Re: Flink 1.3.2 with CEP Pattern, Memory usage increases results in OOM

2018-04-16 Thread Kostas Kloudas
Hi Abiramalakshmi, Thanks for reporting this! As a starting point I would recommend: 1) use RocksDB as your backend, so that state is not accumulated in memory 2) enable incremental checkpoints 3) the “new IterativeCondition() {…}” can become “new SimpleCondition() {}”, as this is more eff

Flink 1.3.2 with CEP Pattern, Memory usage increases results in OOM

2018-04-14 Thread Abiramalakshmi Natarajan
I am using Flink 1.3.2 CEP pattern to detect a frequently occurring condition. On scale testing this pattern with 10k events per minute, memory leak happens finally OOM. I found a related JIRA FLINK-7606 where it mentioned to specifiying EventTime as streamTimeCharacteristic. I have also config