Re: Advice - Drools in Flink

2016-06-23 Thread Maciek Próchniak
Hi Anton, I think I start to understand what you want to achieve. I would be a very interesting thing to do ;) If the drools are the piece that decides what is interesting and what is not, then probably also drools should be responisble for keeping state/aggregates - otherwise Flink would kee

Re: Advice - Drools in Flink

2016-06-23 Thread Anton
Hi Maciek Firstly, thanks for your replies and interest. It is really appreciated. I am familiar with Drools but am new to Flink. Whereas you seem familiar with both - so your feedback is really appreciated. On Thu, Jun 23, 2016 at 8:30 AM, Maciek Próchniak wrote: > > you mean - keeping working

Re: Advice - Drools in Flink

2016-06-22 Thread Maciek Próchniak
Hi Anton, you mean - keeping working memory facts in Flink state and with each event throw them into stateless session? Can you elaborate a bit on your use case? What would be the state? Would it be for example some event aggregations, which would be filtered by the rules? maciek On 22/06/2

Re: Advice - Drools in Flink

2016-06-22 Thread Anton
Thanks Maiek On Wed, Jun 22, 2016 at 9:00 PM, Maciek Próchniak wrote: > This is straightforward, it also shouldn't be problematic performance wise > OTOH, if you want to use stateful sessions things are getting more > complicated - because if you want to play well with Flink you'd have to > integ

Re: Advice - Drools in Flink

2016-06-22 Thread Maciek Próchniak
Hi, I've been using drools in a few projects. Embedding Drools in Flink is certainly possible, however there are a few points you have to consider. - are you going to use Drools in stateful or stateless way? The blog post you mention uses flink in stateless way - that is, each event is process

Re: Advice - Drools in Flink

2016-06-21 Thread Aljoscha Krettek
Hi, you can also take a look at this: https://techblog.king.com/rbea-scalable-real-time-analytics-king/. From a high level it seems Drools implements something similar to the system that they developed on top of Flink. Cheers, Aljoscha On Tue, 21 Jun 2016 at 12:04 Robert Metzger wrote: > Hi Ant

Re: Advice - Drools in Flink

2016-06-21 Thread Robert Metzger
Hi Anton, I think embedding Drools into Flink should be doable. Drools seems to be implemented in Java, so you can probably call the engine from Flink. I would start putting a flatMap() operator into a stream. In the operator, I would start the Drools engine (probably in the open() method) and the

Advice - Drools in Flink

2016-06-20 Thread Anton
Hello Firstly, I am an absolute Flink newbie. I am interested in using Drools in Flink - in a similar case to what is described in this blog, where Drools is used in Spark. http://blog.cloudera.com/blog/2015/11/how-to-build-a-complex-event-processing-app-on-apache-spark-and-drools/ The basic ide