Shammon created FLINK-25334:
-------------------------------

             Summary: Manage and share gateways of taskmanagers between jobs in 
session cluster
                 Key: FLINK-25334
                 URL: https://issues.apache.org/jira/browse/FLINK-25334
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Coordination
    Affects Versions: 1.13.3, 1.12.4, 1.14.0
            Reporter: Shammon


Flink session cluster launches a certain number of taskmanagers and they won't 
exit during the cluster running. When a job is submitted to the cluster, 
taskmanagers will offer slots to `JobMaster` with location info. Then 
`JobMaster` will get `InetAddress` from the location and connect the 
taskmanager. This cause some performance loss and it isn't necessary in session 
cluster. 

It's better to manager the gateways of taskmanagers in JM and share them 
between jobs. When a taskmanager's gateway is exist and valid, the `JobMaster` 
can use it directly instead of creating a new one.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to