Íñigo Goiri created HDFS-13894: ---------------------------------- Summary: Access HDFS through a proxy and natively Key: HDFS-13894 URL: https://issues.apache.org/jira/browse/HDFS-13894 Project: Hadoop HDFS Issue Type: New Feature Reporter: Íñigo Goiri Assignee: Íñigo Goiri
HDFS deployments are usually behind a firewall where one can access the Namenode but not the Datanodes. To mitigate this situation there are proxies that catch the DN requests (e.g., HttpFS). However, if a user submits a job using the HttpFS endpoint, all the workers will use such endpoint which will usually be a bottleneck. We should create a new filesystem that supports accessing both: * HttpFS for submission from outside the firewal * HDFS from within the cluster -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org