Re: Add CEP library to Flink

2016-01-11 Thread Till Rohrmann
Thanks for the valuable feedback. @Stephan, you're totally right that the CEP DSLs and SQLs strongly resemble each other. It's probably mainly a question of syntax how a pattern definition can be exposed in stream SQL. For that we should take a closer look at Oracle's Pattern Matching extension on

[jira] [Created] (FLINK-3215) Add CEP library to Flink

2016-01-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-3215: Summary: Add CEP library to Flink Key: FLINK-3215 URL: https://issues.apache.org/jira/browse/FLINK-3215 Project: Flink Issue Type: New Feature

Re: Add CEP library to Flink

2016-01-10 Thread Paris Carbone
+1 for the cool design proposal. I also agree with Stephan’s point to focus on the Pattern operator. Ultimately in the future this could be merged into the SQL lib. There are a few “standards" you could check out such as Oracle’s Pattern Matching extension on SQL [1], apart from EPL. [1] https

Re: Add CEP library to Flink

2016-01-09 Thread Henry Saputra
HI Till, Have you created JIRA ticket to keep track of this proposed new feature? We should create one to keep track updates on the effort. Thanks, Henry On Fri, Jan 8, 2016 at 6:54 AM, Till Rohrmann wrote: > Hi everybody, > > recently we've seen an increased interest in complex event process

Re: Add CEP library to Flink

2016-01-08 Thread Stephan Ewen
Looks super cool, Till! Especially the section about the Patterns is great. For the other parts, I was wondering about the overlap with the TableAPI and the SQL efforts. I was thinking that a first version could really focus on the Patterns and make the assumption that they are always applied on

Re: Add CEP library to Flink

2016-01-08 Thread 戴資力
A definite +1 for this feature, thanks for your effort Till! Really look forward to the POC foundation and would like to help contribute where-ever possible. Pattern matching along with event time support seems to be another major breakthrough for stream processing framework options currently on t

Re: Add CEP library to Flink

2016-01-08 Thread Ufuk Celebi
> On 08 Jan 2016, at 15:54, Till Rohrmann wrote: > > Hi everybody, > > recently we've seen an increased interest in complex event processing (CEP) > by Flink users. Even though most functionality is already there to solve > many use cases it would still be helpful for most users to have an easy

Re: Add CEP library to Flink

2016-01-08 Thread Kostas Tzoumas
This is a very comprehensive document, incredible job! It seems that most of the machinery is already in place in Flink, which would make this a very valuable addition taking into account the implementation effort. On Fri, Jan 8, 2016 at 3:54 PM, Till Rohrmann wrote: > Hi everybody, > > recent

Add CEP library to Flink

2016-01-08 Thread Till Rohrmann
Hi everybody, recently we've seen an increased interest in complex event processing (CEP) by Flink users. Even though most functionality is already there to solve many use cases it would still be helpful for most users to have an easy to use library. Having such a library which allows to define co