Authority-based lookup of proxy provider fails if path becomes canonicalized
----------------------------------------------------------------------------

                 Key: HDFS-2683
                 URL: https://issues.apache.org/jira/browse/HDFS-2683
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: ha, hdfs client
    Affects Versions: HA branch (HDFS-1623)
            Reporter: Todd Lipcon
            Assignee: Todd Lipcon
            Priority: Critical


When testing MapReduce on top of an HA cluster we ran into the following bug: 
some uses of HDFS paths go through a canonicalization step which ensures that 
the authority component in the URI includes a port number. So our 
hdfs://logical-nn-uri/foo path turned into hdfs://logical-nn-uri:8020/foo. The 
code which looks up the failover proxy provider then failed to find the 
associated config. We should only compare the hostname portion of the URI when 
looking up proxy providers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to