hfutatzhanghb opened a new pull request, #6758:
URL: https://github.com/apache/hadoop/pull/6758

   ### Description of PR
   Refer to HDFS-17484.
   
   Currently, we have `dfs.namenode.redundancy.considerLoad` equals true by 
default, and 
   
   dfs.namenode.redundancy.considerLoad.factor equals 2.0 by default.
   
   Think about below situation. when we are doing stress test, we may deploy 
hdfs client onto the datanode. So, this hdfs client will prefer to write to its 
local datanode and increase this machine's load.  Suppose we have 3 datanodes, 
the load of them are as below:  5.0, 0.2, 0.3.
   
   The load equals to 5.0 will be excluded when choose datanodes for a block. 
But actually, it is not slow node when load equals to 5.0 for a machine with 80 
cpu cores.
   
   So, we should better add a new configuration entry :  
`dfs.namenode.redundancy.considerLoad.minLoad` to indicate the mininum factor 
we will make considerLoad take effect.
   
   ### How was this patch tested?
   Add an unit test.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to