Local data node may need to reconsider for read, while reading a very big file 
as it may get recover in some time.
------------------------------------------------------------------------------------------------------------------

                 Key: HDFS-3085
                 URL: https://issues.apache.org/jira/browse/HDFS-3085
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: data-node, hdfs client
    Affects Versions: 0.24.0
            Reporter: Uma Maheswara Rao G


While reading the file, we will add the DN to deadNodes list and will skip from 
reads.
If we are reading very huge file (may take hours), and failed read from local 
datanode, then this will be added to deadnode list and will be excluded for the 
further reads for that file.
If the local node recovered immediately,but that will not used for further 
read. Read may continue with the remote nodes. It will effect the read 
performance.

It will be good if we reconsider the local node after certain period based on 
some factors.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to