Lei (Eddy) Xu created HDFS-10911:
------------------------------------
Summary: Change edit log OP_UPDATE_BLOCKS to store delta blocks
only.
Key: HDFS-10911
URL: https://issues.apache.org/jira/browse/HDFS-10911
Project: Hadoop HDFS
Issue Type: Improvement
Components: namenode
Affects Versions: 3.0.0-alpha1, 2.7.3
Reporter: Lei (Eddy) Xu
Assignee: Lei (Eddy) Xu
Every time a HDFS client {{close}} or {{hflush}} an open file, NameNode
enumerates all the blocks and stores then into edit log (OP_UPDATE_BLOCKS).
It would cause problem when the client is appending a large file frequently
(i.e., WAL).
Because HDFS is append only, we can only store the blocks that have been
changed (delta blocks) in edit log.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
