Re: What happens when all input partitions become idle

2020-12-09 Thread Dongwon Kim
Hi Benchao, Thanks for the input. The code is self-explanatory. Best, Dongwon On Thu, Dec 10, 2020 at 12:20 PM Benchao Li wrote: > Hi Dongwon, > > I think you understand it correctly. > You can find this logic here[1] > > [1] > https://github.com/apache/flink/blob/master/flink-streaming-jav

Re: What happens when all input partitions become idle

2020-12-09 Thread Benchao Li
Hi Dongwon, I think you understand it correctly. You can find this logic here[1] [1] https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/streamstatus/StatusWatermarkValve.java#L108 Dongwon Kim 于2020年12月10日周四 上午12:21写道: > Hi, > > Let

What happens when all input partitions become idle

2020-12-09 Thread Dongwon Kim
Hi, Let's consider two operators: A (parallelism=2) and B (parallelism=1). B has two input partitions, B_A1 and B_A2, which are connected to A1 and A2 respectively. At some point, - B_A1's watermark : 12 - B_A2's watermark : 10 - B's event-time clock : 10 = min(12, 10) - B has registered a timer