Re: does it make sense to get remaining space by sum all the ones of the datanode

2018-01-29 Thread Vinayakumar B
in the latest code this is is not applicable. each storage is chosen and space of that storage is checked. On 29 Jan 2018 3:53 pm, "Xie Gang" wrote: > 2.4 and 2.6: > > public long getRemaining(StorageType t) { > long remaining = 0; > for(DatanodeStorageInfo s : getStorageInfos()) { > if

Re: does it make sense to get remaining space by sum all the ones of the datanode

2018-01-29 Thread Xie Gang
2.4 and 2.6: public long getRemaining(StorageType t) { long remaining = 0; for(DatanodeStorageInfo s : getStorageInfos()) { if (s.getStorageType() == t) { remaining += s.getRemaining(); } } return remaining; } On Mon, Jan 29, 2018 at 6:12 PM, Vinayakumar B wrote: > in whi

Re: does it make sense to get remaining space by sum all the ones of the datanode

2018-01-29 Thread Vinayakumar B
in which version of Hadoop you are seeing this? -Vinay On 29 Jan 2018 3:26 pm, "Xie Gang" wrote: Hello, We recently hit a issue that almost all the disk of the datanode got full even we configured the du .reserved. After tracking down the code, found that when we choose a target datanode and