RE: [HDFS-9038] Non-Dfs used Calculation

2016-05-24 Thread Brahma Reddy Battula
onworks.com' Subject: RE: [HDFS-9038] Non-Dfs used Calculation Remainder mail... --Brahma Reddy Battula -Original Message- From: Brahma Reddy Battula Sent: 20 April 2016 18:58 To: hdfs-dev; Tsz Wo Sze Cc: 'cnaur...@hortonworks.com'; 'vinayakum...@apache.org'; '

RE: [HDFS-9038] Non-Dfs used Calculation

2016-04-26 Thread Brahma Reddy Battula
Remainder mail... --Brahma Reddy Battula -Original Message- From: Brahma Reddy Battula Sent: 20 April 2016 18:58 To: hdfs-dev; Tsz Wo Sze Cc: 'cnaur...@hortonworks.com'; 'vinayakum...@apache.org'; 'aagar...@hortonworks.com' Subject: RE: [HDFS-9038] Non-D

RE: [HDFS-9038] Non-Dfs used Calculation

2016-04-20 Thread Brahma Reddy Battula
icas.get(); --Brahma Reddy Battula -Original Message- From: Ravi Prakash [mailto:ravihad...@gmail.com] Sent: 16 April 2016 09:40 To: hdfs-dev; Tsz Wo Sze Subject: Re: [HDFS-9038] Non-Dfs used Calculation I meant HDFS-9530 instead of HDFS-9038. We are seeing an issue where none of the d

Re: [HDFS-9038] Non-Dfs used Calculation

2016-04-15 Thread Ravi Prakash
I meant HDFS-9530 instead of HDFS-9038. We are seeing an issue where none of the datanodes are available for writes, and my suspicion is that incorrect calculation of all these numbers is causing it. On Fri, Apr 15, 2016 at 6:38 PM, Ravi Prakash wrote: > Hi Nicholas! > > Could you please point o

Re: [HDFS-9038] Non-Dfs used Calculation

2016-04-15 Thread Ravi Prakash
Hi Nicholas! Could you please point out exactly which place you are seeing this {{available = usage.getAvailable() - reserved}} calculation? I'm sorry I'm a bit confused because there are several places you could be talking about ( in the patch / in the unpatched NN code / in the unpatched DN code

Re: [HDFS-9038] Non-Dfs used Calculation

2016-04-13 Thread Tsz Wo Sze
available = usage.getAvailable() - reserved It is incorrect to minus reserved from usage.getAvailable() above since the reserved space, which is the space reserved for non-hdfs used, may already be occupied by some non-hdfs files but not necessarily empty space. In pre HDFS-5215 calculation, the