Re: Alternate to PreserveWatermark() in recent Flink versions

2021-10-25 Thread JING ZHANG
Hi Arujit, I got it, sorry for misunderstanding your requirements before. Yes, if you already specify watermark strategy on the source (please see more in document [1]), you don't need to call `DataStream. assignTimestampsAndWatermarks` after source anymore. The watermark would be kept by default.

Re: Alternate to PreserveWatermark() in recent Flink versions

2021-10-25 Thread Arujit Pradhan
Hey JING, Thanks a lot for replying to the thread! Yeah, we are looking at `PreserveWatermarks`. But the issue is that the datastream.assignTimestampsAndWatermarks() takes `WatermarkStrategy`(from org.apache.flink.api.common.eventtime) and there is no default method to define preserveWaterMark St

Re: Alternate to PreserveWatermark() in recent Flink versions

2021-10-25 Thread JING ZHANG
Hi, I'm not sure I understand your requirement. However, are you looking for `PreserveWatermarks` in package `org.apache.flink.table.sources.wmstrategies`? Best, JING ZHANG Arujit Pradhan 于2021年10月25日周一 下午4:02写道: > Hi all, > > > We maintain an Open-sourced project for protobuf data processing

Alternate to PreserveWatermark() in recent Flink versions

2021-10-25 Thread Arujit Pradhan
Hi all, We maintain an Open-sourced project for protobuf data processing using Flink dagger . But we are currently on Flink-1.9 and want to migrate to the latest stable 1.14. In the older version, we use `*StreamTableSource` *and ` *DefinedRowtimeAttributes` *APIs