RE: Idleness not working if watermark alignment is used

2024-02-05 Thread Schwalbe Matthias
Good morning Alexis, withIdleness(…) is easily misunderstood, it actually means that the thus configured stream is exempt from watermark processing after 5 seconds (in your case). Hence also watermark alignment is turned off for the stream until a new event arrives. .withIdleness(…) is good fo

退订

2024-02-05 Thread 杨作青

Re:Re: Re: DESCRIBE CATALOG not available?

2024-02-05 Thread Xuyang
Hi, Yunhong. Thanks for your volunteering :) -- Best! Xuyang 在 2024-02-06 09:26:55,"yh z" 写道: Hi, Xuyang, I hope I can also participate in the development of the remaining flip features. Please cc me if there are any further developments. Thank you ! Xuyang 于2024年1月29日周一 13:54

Re: Idleness not working if watermark alignment is used

2024-02-05 Thread Alexis Sarda-Espinosa
Ah and I forgot to mention, this is with Flink 1.18.1 Am Mo., 5. Feb. 2024 um 18:00 Uhr schrieb Alexis Sarda-Espinosa < sarda.espin...@gmail.com>: > Hello, > > I have 2 Kafka sources that are configured with a watermark strategy > instantiated like this: > > WatermarkStrategy.forBoundedOutOfOrder

Idleness not working if watermark alignment is used

2024-02-05 Thread Alexis Sarda-Espinosa
Hello, I have 2 Kafka sources that are configured with a watermark strategy instantiated like this: WatermarkStrategy.forBoundedOutOfOrderness(maxAllowedWatermarkDrift) .withIdleness(idleTimeout) // 5 seconds currently .withWatermarkAlignment(alignmentGroup, maxAllowedWate

Watermark alignment with different allowed drifts

2024-02-05 Thread Alexis Sarda-Espinosa
Hello, is the behavior for this configuration well defined? Assigning two different (Kafka) sources to the same alignment group but configuring different max allowed drift in each one. Regards, Alexis.