Re: Watermarks lagging behind events that generate them

2023-03-16 Thread David Anderson
Watermarks are not included in checkpoints or savepoints. See [1] for some head-scratchingly-complicated info about restarts, watermarks, and unaligned checkpoints. [1] https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/ops/state/checkpointing_under_backpressure/#interplay-with-wate

Re: Is it possible to preserve chaining for multi-input operators?

2023-03-16 Thread Viacheslav Chernyshev
Hi Matthias, Just wanted to thank you for the hints! I've successfully developed a multi-stream operator that allows doing things like this: KeyedMultiInputStream.builder(environment, new UserDefinedFunction()) .addKeyedStream(fooSource, fooMapper, UserDefinedFunction::processFoo)

Re: IntervalJoin invisibly becomes a regular Join - why?

2023-03-16 Thread mark
Is there anything that an author can do to prevent a well-formed Interval Join from being 'optimised' into a regular, non-interval join by later queries? Does the Flink runtime make any guarantees that when it alters an interval join into a regular join, that the safety of the original interval joi

Re: [ANNOUNCE] Apache Flink 1.15.4 released

2023-03-16 Thread Martijn Visser
Hi Danny, Thanks a lot for driving this release! Best regards, Martijn On Wed, Mar 15, 2023 at 5:38 PM Danny Cranmer wrote: > The Apache Flink community is very happy to announce the release of Apache > Flink 1.15.4, which is the fourth bugfix release for the Apache Flink 1.15 > series. > > A