Ufuk Celebi created FLINK-3310:
----------------------------------

             Summary: Add back pressure statistics to web frontend
                 Key: FLINK-3310
                 URL: https://issues.apache.org/jira/browse/FLINK-3310
             Project: Flink
          Issue Type: Improvement
          Components: Webfrontend
            Reporter: Ufuk Celebi
            Assignee: Ufuk Celebi
            Priority: Minor


When a task is receiving data at a higher rate than it can process, the task is 
back pressuring preceding tasks. Currently, there is no way to tell whether 
this is the case or not. An indicator for back pressure is tasks being stuck in 
buffer requests on the network stack. This means that they have filled all 
their buffers with data, but the following tasks/network are not consuming them 
fast enough.

A simple way to measure back pressure is to sample running tasks and report 
back pressure if they are stuck in the blocking buffers calls.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to