That looks exactly like what we hit, thank you! On Thu, Jun 15, 2023 at 10:57 PM Ken Krugler <kkrugler_li...@transpac.com> wrote:
> I think you’re hitting this issue: > > https://issues.apache.org/jira/browse/FLINK-31632 > > Fixed in 1.16.2, 1.171. > > — Ken > > > On Jun 15, 2023, at 1:39 PM, Piotr Domagalski <pi...@domagalski.com> > wrote: > > Hi all! > > We've been experimenting with watermark alignment in Flink 1.15 and > observed an odd behaviour that I couldn't find any mention of in the > documentation. > > With the following strategy: > > WatermarkStrategy.<Event>forBoundedOutOfOrderness(Duration.ofSeconds(60)) > .withTimestampAssigner((e, t) -> e.timestamp) > .withIdleness(Duration.ofSeconds(3600)) > .withWatermarkAlignment("group-1", Duration.ofSeconds(15)); > > Kafka sources stop consuming completely after 3600s (even when the data is > flowing into all the partitions). Is this an expected behaviour? Where > could I find more information on this? > > -- > Piotr Domagalski > > > -------------------------- > Ken Krugler > http://www.scaleunlimited.com > Custom big data solutions > Flink, Pinot, Solr, Elasticsearch > > > > -- Piotr Domagalski
