Chris Douglas created HDFS-9808:
-----------------------------------

             Summary: Combine READ_ONLY_SHARED DatanodeStorages with the same ID
                 Key: HDFS-9808
                 URL: https://issues.apache.org/jira/browse/HDFS-9808
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Chris Douglas


In HDFS-5318, each datanode that can reach a (read only) block reports itself 
as a valid location for the block. While accurate, this increases (redundant) 
block report traffic and- without partitioning on the backend- may return an 
overwhelming number of replica locations for each block.

Instead, a DN could report only that the shared storage is reachable. The 
contents of the storage could be reported separately/synthetically to the block 
manager, which can collapse all instances into a single storage. A subset of 
locations- closest to the client, etc.- can be returned, rather than all 
possible locations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to