what is different between CorruptBlocks and MissingBlocks in NN FSNamesystem metrics?

hi,all: CorruptBlocks is "Number of blocks with corrupt replicas" ,but the MissingBlocks is also from this.neededReplications.getCorruptBlockSize() ,any difference?

Re: what is different between CorruptBlocks and MissingBlocks in NN FSNamesystem metrics?

read > by users or replicated by the system to replace the corrupt replicas. > "Missing blocks" is a subset of "Corrupt blocks". > > Kihwal > > > > On Monday, November 18, 2013 3:07 AM, ch huang > wrote: > > hi,all: > > C

when datanode will delete these invalidate blocks?

hi,all: i read the replication monitor code ,in *invalidateWork *call it just add the invalidate block into the invalidateBlocks list of the DatanodeDescriptor class ,but i do not see any remove operation in replication monitor code ,my question is when these invalidate blocks will be r

is block pool on NN or DN?

hi,all: i have a question about block pool,i read the code ,it seems block pool is on DN,but NN also has a block pool manager to manage all block pool,so the block pool also in NN?

about hadoop memory usage

hi,all: if i allocate 2G memory to NN， and i get memory usage info from jmx interface ,i add the max value of heapmemoryusage and nonheapmemorusage ,the total number is not equal 2G ,the value is 1950.5M ,why? ,BTW ,what's the "committed" and "init" means? "HeapMemoryUsage" : { "co

issue about rpc activity metrics

hi,all: i get rpc metrics from NN 50070 port ,and i try search the code to see how these metrics is caculated, i try to use grep,but get nothing ,why? [root@CH124 hadoop-2.0.0-cdh4.3.0]# grep -R 'DeleteNumOps' * { "name" : "Hadoop:service=NameNode,name=RpcDetailedActivityForPort8020",

how to prevent JAVA HEAP OOM in shuffle process?

hi,maillist: i recent get a problem,when i run MR job, it happened OOM in shuffle process,the options about MR is default,not changed,which option should i tuning? thanks