Re: HDFS Balancer - Recommended Threshold Value

2016-08-11 Thread Senthil Kumar
Thanks Lars for your quick response! Here is my Cluster Utilization.. DFS Used% : 74.39% DFS Remaining% : 25.60% Block Pool Used% : 74.39% DataNodes usages : Min % Median % Max % stdev % 1.25% 99.72% 99.99% 22.53% Hadoop Version : *2.4.1* Let's take an example : Cluster Live Nodes

答复: HDFS Balancer - Recommended Threshold Value

2016-08-10 Thread Yeqi
apache.org; senthilec...@apache.org 主题: HDFS Balancer - Recommended Threshold Value Hi Team , We are running big cluster ( 3000 nodes cluster ) , many time we are hitting Median Increasing to 99.99 % ( 80 % of the DN's ) . Balancer is running all time in cluster ..But still median is not

Re: HDFS Balancer - Recommended Threshold Value

2016-08-10 Thread Senthil Kumar
Hadoop Version : *Hadoop 2.4.1* --Senthil On Wed, Aug 10, 2016 at 6:58 PM, Zhe Zhang wrote: > Which version of Hadoop is your cluster / Balancer running? > > On Wed, Aug 10, 2016 at 6:27 AM, Senthil Kumar > wrote: > >> Hi Team , We are running big cluster ( 3000 nodes cluster ) , many time >>

Re: HDFS Balancer - Recommended Threshold Value

2016-08-10 Thread Zhe Zhang
Which version of Hadoop is your cluster / Balancer running? On Wed, Aug 10, 2016 at 6:27 AM, Senthil Kumar wrote: > Hi Team , We are running big cluster ( 3000 nodes cluster ) , many time we > are hitting Median Increasing to 99.99 % ( 80 % of the DN's ) . Balancer > is running all time in cl

HDFS Balancer - Recommended Threshold Value

2016-08-10 Thread Senthil Kumar
Hi Team , We are running big cluster ( 3000 nodes cluster ) , many time we are hitting Median Increasing to 99.99 % ( 80 % of the DN's ) . Balancer is running all time in cluster ..But still median is not coming down i.e < 90 % .. Here is how i start balancer ? /apache/hadoop/sbin/start-balanc