Daryn Sharp created HDFS-12647:
----------------------------------

             Summary: DN commands processing should be async
                 Key: HDFS-12647
                 URL: https://issues.apache.org/jira/browse/HDFS-12647
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: datanode
    Affects Versions: 2.8.0
            Reporter: Daryn Sharp


Due to dataset lock contention, service actors may encounter significant 
latency while processing  DN commands.  Even the queuing of async deletions 
require multiple lock acquisitions.  A slow disk will cause a backlog of 
xceivers instantiating block sender/receivers which starves the actor and leads 
to the NN falsely declaring the node dead.

Async processing of all commands will free the actor to perform its primary 
purpose of heartbeating and block reporting.  Note that FBRs will be dependent 
on queued block invalidations not being included in the report.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Reply via email to