Konstantin Shvachko created HDFS-11313:
------------------------------------------
Summary: Segmented Block Reports
Key: HDFS-11313
URL: https://issues.apache.org/jira/browse/HDFS-11313
Project: Hadoop HDFS
Issue Type: Bug
Components: datanode, namenode
Affects Versions: 2.6.2
Reporter: Konstantin Shvachko
Block reports from a single DataNode can be currently split into multiple RPCs
each reporting a single DataNode storage (disk). The reports are still large
since disks are getting bigger. Splitting blockReport RPCs into multiple
smaller calls would improve NameNode performance and overall HDFS stability.
This was discussed in multiple jiras. Here the approach is to let NameNode
divide blockID space into segments and then ask DataNodes to report replicas in
a particular range of IDs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
