Re: Question on Pattern Matching

2020-07-23 Thread Basanth Gowda
I understand, it provides you hooks for processing matched/timed > out patterns. > > On 16/07/2020 20:23, Basanth Gowda wrote: > > Hello, > > We have a use case where we want to know when a certain pattern doesn't > complete within a given time frame. > > For Ex

Question on Pattern Matching

2020-07-16 Thread Basanth Gowda
Hello, We have a use case where we want to know when a certain pattern doesn't complete within a given time frame. For Example A -> B -> C -> D (needs to complete in 10 minutes) Now with Flink if event D doesn't happen in 10 minutes, the pattern is discarded and we can get notified. We also want

Re: Flink CEP questions

2017-08-18 Thread Basanth Gowda
.3/dev/stream/process_function.html) > > > On 18 Aug 2017, at 03:28, Basanth Gowda wrote: > > > > Hi Kostas, > > > > For 3 -> I was able to do the following and it worked perfectly fine. Is > there a way we could reset? Looks like the following code behaves

Re: Flink CEP questions

2017-08-17 Thread Basanth Gowda
erns in > the docs above) > > I am not aware of any examples but you can check this slides: > https://www.slideshare.net/dataArtisans/kostas-kloudas- > complex-event-processing-with-flink-the-state-of-flinkcep > for an overview of the CEP library or you can watch the related v

Flink CEP questions

2017-08-17 Thread Basanth Gowda
All, New to Flink and more so with Flink CEP. I want to write a sample program that does the following : Lets suppose data cpu usage of a given server. 1. Want to Alert when CPU usage is above or below certain value 2. Want to Alert when CPU usage falls in a range 3. Want to Alert when

Re: Aggregation by key hierarchy

2017-08-16 Thread Basanth Gowda
herwise here. > > Maybe Aljoscha (cc'd) has an idea of how to do this better > > > Nico > > On Monday, 14 August 2017 19:08:29 CEST Basanth Gowda wrote: > > Hi Nico, > > Thank you . This is pretty much what I am doing , was wondering if there > is > >

Aggregation on multiple Key combinations and multiple Windows

2017-08-14 Thread Basanth Gowda
Hello, Posted this yesterday, but not sure if it went through or not. I am fairly new to Flink. I have a use case which needs aggregation on different combination of keys and windowing for different intervals. I searched through but couldn't find anything that could help. Came across this model

Re: Aggregation by key hierarchy

2017-08-13 Thread Basanth Gowda
r","aggregators":["SUM"]}, {"name":"revenue","type":"integer"}], "dimensions": [{"combination":["campaignId","adId"]}, {"combination":["creativeId","campaignId"]},

Aggregation by key hierarchy

2017-08-13 Thread Basanth Gowda
Hi, I want to aggregate hits by Country, State, City. I would these as tags in my sample data. How would I do aggregation at different levels ? Input data would be single record Should I do flatMap transformation first and create 3 records from 1 input record, or is there a better way to do it ?

Apache beam and Flink

2017-08-13 Thread Basanth Gowda
I wasn't able to find much info on Flink and Beam wrt CEP & Graph functionalities. Is it supported with Apache Beam ? Is it possible to mix and match Flink and Beam in a single use case ? thank you, Basanth

Does Flink support long term storage and complex queries

2017-07-31 Thread Basanth Gowda
We are looking at Druid for long term storage and roll up metrics and adhoc queries on time series data. If Flink can support dynamic queries and rollups like Druid does, we would like to just use Flink and leave Druid aside. Does Flink support such kind of queries and what are the guidelines for

GRPC source in Flink

2017-07-31 Thread Basanth Gowda
Hi, Is there a way to get data from GRPC source in flink. If we can how we guarantee that events are not lost once submitted to Flink. thank you

Flatbuffers and Flink

2017-07-31 Thread Basanth Gowda
Hi, This is 1 of 3 questions I had for Flink. Didn't want to club all of them together, as this might be useful for some one else in the future. Do we have Flatbuffers support in Flink ? If there is no support, is there a way to implement it ? Trying to see if we could use the byte[] that has com