Paul Lin created FLINK-10601: -------------------------------- Summary: Make user home dir consistent with Flink default filesystem Key: FLINK-10601 URL: https://issues.apache.org/jira/browse/FLINK-10601 Project: Flink Issue Type: Improvement Components: YARN Affects Versions: 1.6.1 Reporter: Paul Lin
Currently, Flink client uses the raw default Hadoop filesystem to upload local files, and this could be problematic when using a non-default filesystem for HA or checkpointing in delegation tokens scenarios. The jobmanager only has the delegation tokens for the default FS, so it gets authentication errors when trying to connect a non-default filesystem. So I propose to replace the default FS property in yarn configuration with the Flink filesystem property `fs.default-scheme` on the client side (AbstractYarnClusterDescriptor), to avoid this problem and also make the client behavior more configurable. -- This message was sent by Atlassian JIRA (v7.6.3#76005)