tartarus created FLINK-22716:
--------------------------------

             Summary: Add metrics watermarkAlignedChannelNum 
                 Key: FLINK-22716
                 URL: https://issues.apache.org/jira/browse/FLINK-22716
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Metrics
            Reporter: tartarus

WatermarkStrategy#withIdleness will introduce IDLE state;
When the downstream Watermark is aligned, the subtask Watermark will be ignored.
When the status of the subtask changes from IDLE to ACTIVE, the watermark of 
the subtask is not immediately considered when the downstream Watermark is 
aligned, until its Watermark is greater than the lastOutputWatermark of the 
Operator. 
For details, please refer to class StatusWatermarkValve.
If the downstream is a window operator and delay is not allowed, the data may 
be drop.
We should add some metrics to identify the current Watermark alignment, 
considering the data of multiple channels.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to