Re: Question about Window Tigger

2018-09-26 Thread Till Rohrmann
You configure the ExecutionConfig#setAutoWatermarkInterval on the StreamExecutionEnvironment by calling getConfig(). Cheers, Till On Tue, Sep 25, 2018 at 11:54 PM Chang Liu wrote: > Hi Till, > > You mean use AssignerWithPeriodicWatermarks but combine the logic of Event > time and Processing Tim

Re: Question about Window Tigger

2018-09-25 Thread Chang Liu
Hi Till, You mean use AssignerWithPeriodicWatermarks but combine the logic of Event time and Processing Time (or to say depend on the time difference/interval of Processing time, but the Watermark value is still depending on the Event time right)? One additional question: where do I config thi

Re: Question about Window Tigger

2018-09-25 Thread Till Rohrmann
Hi Chang Liu, maybe you could use the AssignerWithPeriodicWatermarks to build a custom watermark assigner which creates the watermarks based on the incoming events and if it detects that no events are coming, that it progresses the watermark with respect to the wall clock time. Cheers, Till On T

Re: Question about Window Tigger

2018-09-25 Thread Chang Liu
Hi Rong, Thanks for your reply. :) Best regards/祝好, Chang Liu 刘畅 > On 19 Sep 2018, at 18:20, Rong Rong wrote: > > Hi Chang, > > There were some previous discussion regarding how to debug watermark and > window triggers[1]. > Basically if there's no data for some partitions there's no way t

Re: Question about Window Tigger

2018-09-19 Thread Rong Rong
Hi Chang, There were some previous discussion regarding how to debug watermark and window triggers[1]. Basically if there's no data for some partitions there's no way to advance watermark. As it would not be able to determine whether this is due to network failure or actually there's no data arriv

Question about Window Tigger

2018-09-19 Thread Chang Liu
Dear All, I have a question about the Window Trigger: let’s say i would like like use the SlidingEventTimeWindow (60 seconds window size + 1 second window shift) to count the number of records per window. And I am using Event Time with periodic watermarking with certain maxOurOfOrderness time.