Re: Global Window, Trigger and Watermarks, Parallelism

2018-03-14 Thread dim5b
By adding , AfterMatchSkipStrategy.skipPastLastEvent() it returns what i want. Is there a way to track/emit "ongoing" events i.e before the pattern matchs the end event type? -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Global Window, Trigger and Watermarks, Parallelism

2018-03-14 Thread dim5b
I see you replied on https://stackoverflow.com/questions/48028061/flink-cep-greedy-matching with a known bug issue on the https://issues.apache.org/jira/browse/FLINK-8914 In my case my pattern looks like Pattern tripPattern = Pattern.begin("start").times(1).where(START_CONDI

Re: Global Window, Trigger and Watermarks, Parallelism

2018-03-13 Thread dim5b
I have looked into the CEP library. I have posted an issued on stackoverflow. https://stackoverflow.com/questions/49047879/global-windows-in-flink-using-custom-triggers-vs-flink-cep-pattern-api However the pattern matches all possible solution on the stream of events.Does pattern have a notion o

Re: Global Window, Trigger and Watermarks, Parallelism

2018-03-13 Thread Chesnay Schepler
Hello, Event-time and watermarks can be used to deal with out-of-order events, but since you're using global windows (opposed to time-based windows) you have to implement the logic for doing this yourself. Conceptually, what you would have to do is to not create your TripEv when receiving a

Global Window, Trigger and Watermarks, Parallelism

2018-03-12 Thread dim5b
Could someone clarify how exactly event time/watermarks and allow lateness work. I have created the program below and I have an input file such as... device_id,trigger_id,event_time,messageId 1,START,1520433909396,1 1,TRACKING,1520433914398,2 1,TRACKING,1520433919398,3 1,STOP,152

Re: global window trigger

2017-07-20 Thread Aljoscha Krettek
the result seems the opposite of what I meant... >>>> instead of throwing away previous windows' contents, I wanna keep them >>>> all the way till the end. >>>> that way I can get the cumulative counts of all input. >>>> >>>> wonder

Re: global window trigger

2017-07-20 Thread Aljoscha Krettek
t;>> GlobalWindows, the GC horizon is never reached, that leaves Triggers. >>> >>> You can create a Trigger that purges every time it fires by wrapping it in >>> a PurgingTrigger, i.e. >>> >>> .window(PurgingTrigger.of()) >>> >>> Best, >>&

Re: global window trigger

2017-07-16 Thread Aljoscha Krettek
gt;> >> does anyone have any idea on this? >> thanks a lot in advance, >> jad >> >> >> On Thu, Jul 13, 2017 at 10:55 AM, prashantnayak >> mailto:prash...@intellifylearning.com>> >> wrote: >> Hi >> >> We'v

Re: global window trigger

2017-07-14 Thread jad mad
Hi Aljoscha thanks for the comment. is wrapping by a PurgingTrigger.of() the same as doing "return TriggerResult.FIRE_AND_PURGE;" inside of a custom trigger? gave it a test and the result seems the opposite of what I meant... instead of throwing away previous windows' contents, I wanna keep them

Re: global window trigger

2017-07-13 Thread Aljoscha Krettek
gt; We've have custom operators using global windows and are using event time. > > How are you specifying event time as the time characteristic? > > Prashant > > > > -- > View this message in context: > http://apache-flink-user-mailing-list-archive.2336050

Re: global window trigger

2017-07-13 Thread jad mad
k-user- > mailing-list-archive.2336050.n4.nabble.com/global-window- > trigger-tp14206p14239.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. >

Re: global window trigger

2017-07-12 Thread prashantnayak
Hi We've have custom operators using global windows and are using event time. How are you specifying event time as the time characteristic? Prashant -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/global-window-trigger-tp14206p14239

global window trigger

2017-07-12 Thread jad mad
for a global window with a custom event time trigger that fires every 1 minute and then apply a custom window function to it, the trigger firing seems working but the element collection i get inside of my custom WindowFunction is always the whole inputs from start to end rather than inputs subset