Fwd: Can I move block data directly?

2013-07-07 Thread Azuryy Yu
Hi Dear all, There are some unbalanced data nodes in my cluster, some nodes reached more than 95% disk usage. so Can I move some block data from one node to another node directly? such as: from n1 to n2: 1) scp /data//blk_* n2:/data/subdir11/ 2) rm -rf data//blk_* 3) hadoop-dameon.sh

[jira] [Created] (HDFS-4961) BlockId and Generation Stamp code should be moved to the blockmanagement package

2013-07-07 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-4961: --- Summary: BlockId and Generation Stamp code should be moved to the blockmanagement package Key: HDFS-4961 URL: https://issues.apache.org/jira/browse/HDFS-4961 Project: H

Re: Mysterious 7 byte reads from .meta files

2013-07-07 Thread Varun Sharma
Created https://issues.apache.org/jira/browse/HDFS-4960 and attached a patch... Thanks ! On Sun, Jul 7, 2013 at 9:06 AM, Harsh J wrote: > The header of the meta file is read for block metadata version > validation. The checksum checks are performed after the header is read > (and skipped if the

[jira] [Created] (HDFS-4960) Unnecessary .meta seeks even when skip checksum is true

2013-07-07 Thread Varun Sharma (JIRA)
Varun Sharma created HDFS-4960: -- Summary: Unnecessary .meta seeks even when skip checksum is true Key: HDFS-4960 URL: https://issues.apache.org/jira/browse/HDFS-4960 Project: Hadoop HDFS Issue T

Re: Mysterious 7 byte reads from .meta files

2013-07-07 Thread Harsh J
The header of the meta file is read for block metadata version validation. The checksum checks are performed after the header is read (and skipped if the config's so). The code can be viewed in the BlockReaderLocal.java, which is used when local reads are turned on. I suppose we could skip reading

mvn eclipse:eclipse failure on windows

2013-07-07 Thread Uma Maheswara Rao G
Hi, I am seeing this failure on windows while executing mvn eclipse:eclipse command on trunk. See the following trace: [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-eclipse-plugin:2.8 :eclipse (defaul

Hadoop-Hdfs-trunk - Build # 1453 - Still Failing

2013-07-07 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1453/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10779 lines...] [INFO] --

Build failed in Jenkins: Hadoop-Hdfs-trunk #1453

2013-07-07 Thread Apache Jenkins Server
See -- [...truncated 10586 lines...] Running org.apache.hadoop.hdfs.web.TestFSMainOperationsWebHdfs Tests run: 50, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.185 sec Running org.apache.hadoop.h