Folks, Plenty of very good points but I see this discussion digressing from what I originally asked for. We need a dashboard to let the Business Analysts to define rules and the CEP to run them.
My original question was how to solve this with Flink CEP? >From what I see, this is not a solved problem. Correct me if I am wrong. On Fri, Jun 23, 2017 at 6:52 PM, Kostas Kloudas <k.klou...@data-artisans.com > wrote: > Hi all, > > Currently there is an ongoing effort to integrate FlinkCEP with Flink's > SQL API. > There is already an open FLIP for this: > > https://cwiki.apache.org/confluence/display/FLINK/FLIP- > 20%3A+Integration+of+SQL+and+CEP > <https://cwiki.apache.org/confluence/display/FLINK/FLIP-20:+Integration+of+SQL+and+CEP> > > So, if there was an effort for integration of different > libraries/tools/functionality as well, it > would be nice to go a bit more into details on i) what is already there, > ii) what is planned to be > integrated for the SQL effort, and iii) what else is required, and > consolidate the resources > available. > > This will allow the community to move faster and with a clear roadmap. > > Kostas > > On Jun 23, 2017, at 2:51 PM, Suneel Marthi <smar...@apache.org> wrote: > > FWIW, here's an old Cloudera blog about using Drools with Spark. > > https://blog.cloudera.com/blog/2015/11/how-to-build-a- > complex-event-processing-app-on-apache-spark-and-drools/ > > It should be possible to invoke Drools from Flink in a similar way (I have > not tried it). > > It all depends on what the use case and how much of present Flink CEP > satisfies the use case before considering integration with more complex > rule engines. > > > Disclaimer: I work for Red Hat > > On Fri, Jun 23, 2017 at 8:43 AM, Ismaël Mejía <ieme...@gmail.com> wrote: > >> Hello, >> >> It is really interesting to see this discussion because that was one >> of the questions on the presentation on CEP at Berlin Buzzwords, and >> this is one line of work that may eventually make sense to explore. >> >> Rule engines like drools implement the Rete algorithm that if I >> understood correctly optimizes the analysis of a relatively big set of >> facts (conditions) into a simpler evaluation graph. For more details >> this is a really nice explanation. >> https://www.sparklinglogic.com/rete-algorithm-demystified-part-2/ >> >> On flink's CEP I have the impression that you define this graph by >> hand. Using a rule engine you could infer an optimal graph from the >> set of rules, and then this graph could be translated into CEP >> patterns. >> >> Of course take all of this with a grain of salt because I am not an >> expert on both CEP or the Rete algorithm, but I start to see the >> connection of both worlds more clearly now. So if anyone else has >> ideas of the feasibility of this or can see some other >> issues/consequences please comment. I also have the impression that >> distribution is less of an issue because the rete network is >> calculated only once and updates are not 'dynamic' (but I might be >> wrong). >> >> Ismaël >> >> ps. I add Thomas in copy who was who made the question in the >> conference in case he has some comments/ideas. >> >> >> On Fri, Jun 23, 2017 at 1:48 PM, Kostas Kloudas >> <k.klou...@data-artisans.com> wrote: >> > Hi Jorn and Sridhar, >> > >> > It would be worth describing a bit more what these tools are and what >> are >> > your needs. >> > In addition, and to see what the CEP library already offers here you can >> > find the documentation: >> > >> > https://ci.apache.org/projects/flink/flink-docs-release-1.3/ >> dev/libs/cep.html >> > >> > >> > Thanks, >> > Kostas >> > >> > On Jun 23, 2017, at 1:41 PM, Jörn Franke <jornfra...@gmail.com> wrote: >> > >> > Hallo, >> > >> > It si possible, but some caveat : flink is a distributed system, but in >> > drools the fact are only locally available. This may lead to strange >> effects >> > when rules update the fact base. >> > >> > Best regards >> > >> > On 23. Jun 2017, at 12:49, Sridhar Chellappa <flinken...@gmail.com> >> wrote: >> > >> > Folks, >> > >> > I am new to Flink. >> > >> > One of the reasons why I am interested in Flink is because of its CEP >> > library. Our CEP logic comprises of a set of complex business rules >> which >> > will have to be managed (Create, Update, Delete) by a bunch of business >> > analysts. >> > >> > Is there a way I can integrate other third party tools (Drools, >> OpenRules) >> > to let Business Analysts define rules and execute them using Flink's >> CEP >> > library? >> > >> > >> > > >
