Re: Flink CEP Pattern Matching

2016-03-19 Thread Till Rohrmann
Hi Jerry and Vitor, sorry for my late reply, but I was on vacation last week. I think that Flink's CEP library should indeed head function-wise in the direction of the standard you've linked. The next steps would be to enrich the expressiveness of the pattern language to support regular expressio

Re: Flink CEP Pattern Matching

2016-03-03 Thread Vitor Vieira
I believe that most of functionalities regarding transformation and projection of windowed events will only be implemented in the next releases. I'm looking forward to contribute! 2016-03-03 15:29 GMT-03:00 Jerry Lam : > Hi Till, > > The idea of having CEP functionalities in Flink is very excit

Re: Flink CEP Pattern Matching

2016-03-03 Thread Jerry Lam
Hi Till, The idea of having CEP functionalities in Flink is very exciting. I really appreciate your work on this. Will you consider in the future adding the similar functionalities described in this standard ( http://web.cs.ucla.edu/classes/fall15/cs240A/notes/temporal/row-pattern-recogniton-11.pd

Re: Flink CEP Pattern Matching

2016-03-03 Thread Till Rohrmann
Hi Vitor, the CEP operators are not working on real windows. What they do is to use a NFA to track the state of multiple ongoing sequences. In order to store the element efficiently, a kind of shared buffer with versioning is used. Once a sequence has reached a final state, the sequence of element

Re: Flink CEP Pattern Matching

2016-03-03 Thread Vitor Vieira
Hi Till, Idk if the windowing package should provide functions to operate on the internal elements. What is the easiest way, or is it possible to get, for example, the last event of a window, lets say a 5 second window? Rgds, Vitor Vieira @notvitor 2016-03-03 7:29 GMT-03:00 Till Rohrmann : >

Re: Flink CEP Pattern Matching

2016-03-03 Thread Till Rohrmann
Hi Jerry, at the moment it is not yet possible to access previous elements in the filter function of an individual element. Therefore, you have to check for the condition “B is 5 days after A” in the final select statement. Giving this context to the where clause would be indeed a nice addition to

Re: Flink CEP Pattern Matching

2016-03-02 Thread Vitor Vieira
Hi Jerry, I'm currently evaluating the CEP library too, probably doing something similar. Something like... comparing the 'offset' of the last event in different time windows, each window, based on the event type, occurring like realtime, with this same day/hour/minute a week ago/15d/1month/etc..

Re: Flink CEP Pattern Matching

2016-03-02 Thread Fabian Hueske
Hi Jerry, I haven't used the CEP features yet, so I cannot comment on your requirements. In case you are looking for the CEP documentation, here it is: --> https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/libs/cep.html The CEP features will be included in the upcoming 1.0.0

Flink CEP Pattern Matching

2016-03-02 Thread Jerry Lam
Hi Flink users and developers, I'm trying to learn the CEP library. How can I express A-followBy->B-next->C where B is 5 days after A occurs. What I'm trying to get a hold of is the events that matches A when I'm processing B. Is this supported? Best Regards, Jerry