Xiaoqiao He created HDFS-15397:
----------------------------------

             Summary: Blocks recovery could overwhelm KDC when using Kerberos 
for authentication
                 Key: HDFS-15397
                 URL: https://issues.apache.org/jira/browse/HDFS-15397
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: datanode
            Reporter: Xiaoqiao He


It could overwhelm KDC if enable Kerberos for authentication when there are 
large number of blocks are triggered to recovery.
Consider killing one running application which opens large number files and 
writing, it will trigger block recovery, If `recoverblocks` commands are not 
under control, there will be huge number pairs between two DataNode need to 
auth when recovery, then it will overwhelm KDC if we enable Kerberos for 
authentication.
I would like to attach more information about the corner case.
Technically, we should control the concurrency when there are large number 
blocks need to recovery IMO.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Reply via email to