Lin Xiao created HDFS-5389:
------------------------------

             Summary: Remove INode limitations in Namenode
                 Key: HDFS-5389
                 URL: https://issues.apache.org/jira/browse/HDFS-5389
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: namenode
    Affects Versions: 0.23.1
            Reporter: Lin Xiao
            Priority: Minor


Current HDFS Namenode stores all of its metadata in RAM. This has allowed 
Hadoop clusters to scale to 100K concurrent tasks. However, the memory limits 
the total number of files that a single NN can store. While Federation allows 
one to create multiple volumes with additional Namenodes, there is a need to 
scale a single namespace and also to store multiple namespaces in a single 
Namenode. When inodes are also stored on persistent storage, the system's boot 
time can be significantly reduced because there is no need to replay edit logs. 
It also provides the potential to support extended attributes once the memory 
size is not the bottleneck.




--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to