Re: Overwriting watermarks in DataStream

2022-08-22 Thread Peter Schrott
Hi David, Thanks a lot for clarification. Best, Peter > On 21. Aug 2022, at 18:36, David Anderson wrote: > > If you have two watermark strategies in your job, the downstream > TimestampsAndWatermarksOperator will absorb incoming watermarks and not > forward them downstream, but it will have

Re: Overwriting watermarks in DataStream

2022-08-21 Thread David Anderson
If you have two watermark strategies in your job, the downstream TimestampsAndWatermarksOperator will absorb incoming watermarks and not forward them downstream, but it will have no effect upstream. The only exception to this is that watermarks equal to Long.MAX_VALUE are forwarded downstream, sin

Overwriting watermarks in DataStream

2022-08-18 Thread Peter Schrott
Hi there, While still struggling with events and watermarks out of order after sorting with a buffer process function (compare [1]) I tired to solve the issue by assigning a new watermark after the mentioned sorting function. The Flink docs [2] are not very certain about the impact of assigning