Re: Empty Kafka topics and watermarks

2021-10-11 Thread Piotr Nowojski
r Nowojski > *Sent:* 08 October 2021 13:17 > *To:* James Sandys-Lumsdaine > *Cc:* user@flink.apache.org > *Subject:* Re: Empty Kafka topics and watermarks > > Hi James, > > I believe you have encountered a bug that we have already fixed [1]. The > small problem is t

Re: Empty Kafka topics and watermarks

2021-10-11 Thread James Sandys-Lumsdaine
Kafka topics and watermarks Hi James, I believe you have encountered a bug that we have already fixed [1]. The small problem is that in order to fix this bug, we had to change some `@PublicEvolving` interfaces and thus we were not able to backport this fix to earlier minor releases. As such, this

Re: Empty Kafka topics and watermarks

2021-10-08 Thread Piotr Nowojski
Hi James, I believe you have encountered a bug that we have already fixed [1]. The small problem is that in order to fix this bug, we had to change some `@PublicEvolving` interfaces and thus we were not able to backport this fix to earlier minor releases. As such, this is only fixed starting from

Empty Kafka topics and watermarks

2021-10-08 Thread James Sandys-Lumsdaine
Hi everyone, I'm putting together a Flink workflow that needs to merge historic data from a custom JDBC source with a Kafka flow (for the realtime data). I have successfully written the custom JDBC source that emits a watermark for the last event time after all the DB data has been emitted but