Re: Generate timestamps in front of event for event time windows

2016-08-04 Thread Jason Brelloch
Thanks Aljoscha, Looking forward to the 1.1. release. I managed to solve my problem using this example code: https://bitbucket.org/snippets/vstoyak/o9Rqp (courtesy of Vladimir Stoyak) I had to create a custom window and window assigner. Hopefully that will help someone else. On Wed, Aug 3, 20

Re: Generate timestamps in front of event for event time windows

2016-08-03 Thread Aljoscha Krettek
Hi, a watermark cannot be sent before the element that makes you send that watermark. A watermark of time T tells the system that no element will arrive in the future with timestamp T or less, thus you cannot send it before. It seems that what you are trying to achieve can be solved by using sessio

Re: Generate timestamps in front of event for event time windows

2016-08-03 Thread Jason Brelloch
A little more info. Here is a simplified version of my trigger: (windowConfiguration.timespan is the duration of the window) class CustomTrigger extends Trigger[QualifiedEvent, Window] { val stateTimeDescr = new ValueStateDescriptor[Long]("relevantTimestamp", classOf[Long], 0) override def

Generate timestamps in front of event for event time windows

2016-08-03 Thread Jason Brelloch
Hey guys, I am trying to use event time along with a custom window to capture a subset of events. The problem I am running into is that it seems that event that generates the timestamp/watermark arrives in the window before the onEventTime() call is made that closes the window. Example: Window