Chen Liang created HDFS-10932:
---------------------------------
Summary: Ozone : fix XceiverClient slow shutdown
Key: HDFS-10932
URL: https://issues.apache.org/jira/browse/HDFS-10932
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Chen Liang
Assignee: Chen Liang
Currently {{XceiverClient}} is the underlying entity of
{{DistributedStorageHandler.newKeyWriter()}} and
{{DistributedStorageHandler.newKeyReader()}} for making call to container for
read/write. When {{XceiverClient}} gets closed, {{group.shutdownGracefully()}}
gets called, which is an asynchronous call.
A problem is that this asynchronous call has default quiet period of 2 seconds
before it actually shutdown, so if we have a burst of read/write calls, we
would end up having threads created faster than they got terminated, reaching
system limit at some point.
Ideally, this needs to be fixed with cached clients instead of creating new
thread each time. This JIRA only tries to give a temporary fix for the time
being.
Thanks [~anu] for the offline discussion.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
