Re: Looking for suggestions about multithreaded CEP to be used with flink

2021-08-23 Thread Arvid Heise
I'm afraid that Flink CEP is built rather for lots of data on a couple of rules. Using any kind of other library would push down the state management and data distribution onto you and negate the main idea of using CEP in the first place. The question is if some of the patterns could be aggregate

Re: Looking for suggestions about multithreaded CEP to be used with flink

2021-08-23 Thread Schwalbe Matthias
Hi Tejas, I had your question sit in my mind for a while before I realized I had something to say about it 😊 Although not related to CEP, we had had a very similar problem with too many threads/tasks in an overwhelming split-join-pattern of about 1600 concurrent paths. A colleague of

Looking for suggestions about multithreaded CEP to be used with flink

2021-08-19 Thread Tejas B
Hi, Here's our use case : We are planning to build a rule based engine on top of flink with huge number of rules(1000s). the rules could be stateless or stateful. Example stateless rule is : A.id = 3 && A.name = 'abc' || A.color = red. Example stateful rule is : A is event.id =3, B is event.name