Re: Watermark options for TwoInputStreamOperator

2020-01-02 Thread Victor Wong
Hi Jocean, How about assigning the control data stream with Long.MAX_VALUE as watermark? Best, Victor Jocean shi 于2019年12月25日周三 上午9:53写道: > Hi Congxian, > > It is not the same with Idling Source > > Best > Ocean > > Congxian Qiu 于2019年12月24日周二 下午4:39写道: > > > > Hi > > > > Maybe the doc[1] abo

Re: Watermark options for TwoInputStreamOperator

2019-12-24 Thread Jocean shi
Hi Congxian, It is not the same with Idling Source Best Ocean Congxian Qiu 于2019年12月24日周二 下午4:39写道: > > Hi > > Maybe the doc[1] about Idling Source can help there. > [1] > https://ci.apache.org/projects/flink/flink-docs-stable/dev/event_time.html#idling-sources > > Best, > Congxian > > > Jocea

Re: Watermark options for TwoInputStreamOperator

2019-12-24 Thread Congxian Qiu
Hi Maybe the doc[1] about Idling Source can help there. [1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/event_time.html#idling-sources Best, Congxian Jocean shi 于2019年12月24日周二 下午3:05写道: > Hi Jark, > > I got you. We have discussed this question in Flink Forward 2019. > I know t

Re: Watermark options for TwoInputStreamOperator

2019-12-23 Thread Jocean shi
Hi Jark, I got you. We have discussed this question in Flink Forward 2019. I know that i can custom operator to resolve this problem. but also has some other problems: First, This is a very common scene that we often meet I have to rewrite "BroadcastConnectedStream","ConnectedStreams" ... and "Tw

Re: Watermark options for TwoInputStreamOperator

2019-12-23 Thread Jark Wu
Hi Ocean, You can implement your custom operator by the "TwoInputStreamOperator" interface. The TwoInputStreamOperator interface provides "processWatermark1" and "processWatermark2" which handles watermarks for left stream and right stream. You can then ignore the watermarks from right stream and

Watermark options for TwoInputStreamOperator

2019-12-23 Thread Jocean shi
Hi all: Currently, The "TwoInputStreamOperator" such as "CoBroadcastWithKeyedOperator" "KeyedCoProcessOperator" and the (Co)stream such as "ConnectedStreams" "BroadcastConnectedStream" only support compute watermark by two stream. but we just need one stream to compute watermark in some case.