tomscut created HDFS-16331:
------------------------------
Summary: Make dfs.blockreport.intervalMsec reconfigurable
Key: HDFS-16331
URL: https://issues.apache.org/jira/browse/HDFS-16331
Project: Hadoop HDFS
Issue Type: New Feature
Reporter: tomscut
Assignee: tomscut
Attachments: image-2021-11-18-09-33-24-236.png,
image-2021-11-18-09-35-35-400.png
We have a cold data cluster, which stores as EC policy. There are 24 fast disks
on each node and each disk is 7 TB.
Recently, many nodes have more than 10 million blocks, and the interval of FBR
is 6h as default. Frequent FBR caused great pressure on NN.
!image-2021-11-18-09-35-35-400.png|width=491,height=337!
!image-2021-11-18-09-33-24-236.png|width=912,height=256!
We want to increase the interval of FBR, but have to rolling restart the DNs,
this operation is very heavy. In this scenario, it is necessary to make
_dfs.blockreport.intervalMsec_ reconfigurable.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]