Daryn Sharp created HDFS-12140:
----------------------------------
Summary: Remove BPOfferService lock contention to get block pool id
Key: HDFS-12140
URL: https://issues.apache.org/jira/browse/HDFS-12140
Project: Hadoop HDFS
Issue Type: Bug
Components: datanode
Affects Versions: 2.8.0
Reporter: Daryn Sharp
Assignee: Daryn Sharp
Priority: Critical
The block pool id is protected by a lock in {{BPOfferService}}. This creates
excessive contention especially for xceivers threads attempting to queue IBRs
and heartbeat processing. When the latter is delayed due to excessive
FSDataset lock contention, it causes pipelines to collapse.
Accessing the block pool id should be lockless after registration.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
