fa zheng created FLINK-16595: -------------------------------- Summary: Support extra hadoop filesystem URLs for which to request delegation tokens Key: FLINK-16595 URL: https://issues.apache.org/jira/browse/FLINK-16595 Project: Flink Issue Type: Improvement Components: Deployment / YARN Affects Versions: 1.10.0 Reporter: fa zheng Fix For: 1.11.0
When the cluster has multiple nameservices, the client only can obtain the tokens of default nameservice. We should add an configuration in YarnConfigOptions to obtain all nameservices refer to spark. [yarn-specific-kerberos-configuration|https://spark.apache.org/docs/latest/running-on-yarn.html#yarn-specific-kerberos-configuration]. I encountered this problem when the directory of yarn logs is in another nameservice. It will lead a long waiting for application to run and the log can not be aggregated finally. -- This message was sent by Atlassian Jira (v8.3.4#803005)