[jira] [Created] (HDFS-5754) Split LayoutVerion into NamenodeLayoutVersion and DatanodeLayoutVersion

2014-01-09 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-5754: Summary: Split LayoutVerion into NamenodeLayoutVersion and DatanodeLayoutVersion Key: HDFS-5754 URL: https://issues.apache.org/jira/browse/HDFS-5754

[jira] [Created] (HDFS-5753) Add new NN startup options for downgrade and rollback using upgrade marker

2014-01-09 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-5753: Summary: Add new NN startup options for downgrade and rollback using upgrade marker Key: HDFS-5753 URL: https://issues.apache.org/jira/browse/HDFS-5753

[jira] [Created] (HDFS-5752) Add a new DFSAdminCommand for rolling upgrade

2014-01-09 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-5752: Summary: Add a new DFSAdminCommand for rolling upgrade Key: HDFS-5752 URL: https://issues.apache.org/jira/browse/HDFS-5752 Project: Hadoop HDFS

[jira] [Created] (HDFS-5751) Remove the FsDatasetSpi and FsVolumeImpl interfaces

2014-01-09 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-5751: --- Summary: Remove the FsDatasetSpi and FsVolumeImpl interfaces Key: HDFS-5751 URL: https://issues.apache.org/jira/browse/HDFS-5751 Project: Hadoop HDFS Issue Typ

Re: persistent under-replicated blocks

2014-01-09 Thread Cooper Bethea
+ hdfs-dev for posterity Thanks, Andrew. . I've been able to manually replicate one of the under-replicated blocks by scp-ing the block file and its .meta file to other datanodes and restarting them as you suggest. Once I get all the data fully replicated I'll try to retrieve the information you'v

Re: persistent under-replicated blocks

2014-01-09 Thread Andrew Wang
Hi Chris, BCC'ing hdfs-dev@ since you're using CDH, moving us to cdh-user@. You should be able to manually copy the under-replicated blocks and md5 files to a different datanode and restart it. I'm curious that you're having this issue though, I haven't encountered it before. Can you send your NN

[jira] [Created] (HDFS-5750) JHLogAnalyzer#parseLogFile() should close stm upon return

2014-01-09 Thread Ted Yu (JIRA)
Ted Yu created HDFS-5750: Summary: JHLogAnalyzer#parseLogFile() should close stm upon return Key: HDFS-5750 URL: https://issues.apache.org/jira/browse/HDFS-5750 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-5749) Access time of HDFS directories stays at 1969-12-31

2014-01-09 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-5749: --- Summary: Access time of HDFS directories stays at 1969-12-31 Key: HDFS-5749 URL: https://issues.apache.org/jira/browse/HDFS-5749 Project: Hadoop HDFS Issue Typ

Re: persistent under-replicated blocks

2014-01-09 Thread Cooper Bethea
I have only 9 under-replicated blocks on the cluster, and it is very important that I restore my cluster to a fully-replicated state. Is there a way I can manually copy these blocks to other datanodes, or perhaps new datanodes? On Thu, Jan 9, 2014 at 10:34 AM, Cooper Bethea wrote: > Chris, Steve

Re: persistent under-replicated blocks

2014-01-09 Thread Cooper Bethea
Chris, Steve, thanks for responding. Overnight I ran a script to bump replication, then lower it, as Chris suggested. There has been no effect--all underreplicated blocks still have only 1 replica. Steve, I am running the rebalancer. On Thu, Jan 9, 2014 at 1:33 AM, Steve Loughran wrote: > are

[jira] [Created] (HDFS-5748) Too much information shown in the dfs health page.

2014-01-09 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-5748: Summary: Too much information shown in the dfs health page. Key: HDFS-5748 URL: https://issues.apache.org/jira/browse/HDFS-5748 Project: Hadoop HDFS Issue Type: Sub-

[jira] [Created] (HDFS-5747) BlocksMap.getStoredBlock(..) and BlockInfoUnderConstruction.addReplicaIfNotPresent(..) may throw NullPointerException

2014-01-09 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-5747: Summary: BlocksMap.getStoredBlock(..) and BlockInfoUnderConstruction.addReplicaIfNotPresent(..) may throw NullPointerException Key: HDFS-5747 URL: https://issues.

Hadoop-Hdfs-trunk - Build # 1639 - Failure

2014-01-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1639/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 11793 lines...] [INFO] --- maven-antrun-plugin:1.7:run (c

Build failed in Jenkins: Hadoop-Hdfs-trunk #1639

2014-01-09 Thread Apache Jenkins Server
See Changes: [kasha] HADOOP-10214. Fix multithreaded correctness warnings in ActiveStandbyElector (Liang Xie via kasha) [cmccabe] HADOOP-10207. TestUserGroupInformation#testLogin is flaky (jxiang via cmccabe) [jing9] HADOOP-10208.

Hadoop-Hdfs-0.23-Build - Build # 846 - Still Failing

2014-01-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/846/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7894 lines...] [ERROR] location: class com.google.pro

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #846

2014-01-09 Thread Apache Jenkins Server
See -- [...truncated 7701 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]

[jira] [Created] (HDFS-5746) add ShortCircuitSharedMemorySegment

2014-01-09 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-5746: -- Summary: add ShortCircuitSharedMemorySegment Key: HDFS-5746 URL: https://issues.apache.org/jira/browse/HDFS-5746 Project: Hadoop HDFS Issue Type:

Re: persistent under-replicated blocks

2014-01-09 Thread Steve Loughran
are you running the rebalancer? On 9 January 2014 04:40, Chris Embree wrote: > It's too bad that this hasn't been corrected in HDFS 2.0 I have a > script that I run several times a day to ensure that blocks are replicated > correctly. Here a link to an article about it: > http://dataforp