Erik Krogen created HDFS-13122:
----------------------------------
Summary: FSImage should not update quota counts on ObserverNode
Key: HDFS-13122
URL: https://issues.apache.org/jira/browse/HDFS-13122
Project: Hadoop HDFS
Issue Type: Sub-task
Components: hdfs, namenode
Reporter: Erik Krogen
Assignee: Erik Krogen
Currently in {{FSImage#loadEdits()}}, after applying a set of edits, we call
{code}
updateCountForQuota(target.getBlockManager().getStoragePolicySuite(),
target.dir.rootDir);
{code}
to update the quota counts for the entire namespace, which can be very
expensive. This makes sense if we are about to become the ANN, since we need
valid quotas, but not on an ObserverNode which does not need to enforce quotas.
This is related to increasing the frequency with which the SbNN can tail edits
from the ANN to decrease the lag time for transactions to appear on the
Observer.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
