[jira] [Created] (HDFS-5745) Unnecessary disk check triggered when socket operation has problem.

2014-01-08 Thread MaoYuan Xian (JIRA)
MaoYuan Xian created HDFS-5745: -- Summary: Unnecessary disk check triggered when socket operation has problem. Key: HDFS-5745 URL: https://issues.apache.org/jira/browse/HDFS-5745 Project: Hadoop HDFS

Re: persistent under-replicated blocks

2014-01-08 Thread Chris Embree
Hm, I had hoped this would have been fixed in hdfs 2. I have a script that I run several times per day that identifies under replicated blocks and increases the replication factor by 1. It then reduces the replication factor back to normal. I can dig up a link if you need it. On Jan 8, 2014 9:00

Re: persistent under-replicated blocks

2014-01-08 Thread Chris Embree
It's too bad that this hasn't been corrected in HDFS 2.0 I have a script that I run several times a day to ensure that blocks are replicated correctly. Here a link to an article about it: http://dataforprofit.com/?p=427 On Wed, Jan 8, 2014 at 9:00 PM, Cooper Bethea wrote: > Following on--

Re: persistent under-replicated blocks

2014-01-08 Thread Cooper Bethea
Following on--is there a way that I can forcibly replicate these blocks, perhaps by rsyncing the underlying files to other datanodes? As you might imagine under-replicated data makes me very uneasy. On Wed, Jan 8, 2014 at 12:00 PM, Cooper Bethea wrote: > Hi HDFS developers, > > I have a worrying

[jira] [Resolved] (HDFS-5717) Save FSImage header in protobuf

2014-01-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-5717. - Resolution: Fixed Fix Version/s: HDFS-5698 (FSImage in protobuf) Hadoop Flags: Reviewed I've c

[jira] [Created] (HDFS-5744) Serialize information for token managers in protobuf

2014-01-08 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5744: Summary: Serialize information for token managers in protobuf Key: HDFS-5744 URL: https://issues.apache.org/jira/browse/HDFS-5744 Project: Hadoop HDFS Issue Type: Su

[jira] [Resolved] (HDFS-5737) Replacing only the default ACL can fail to copy unspecified base entries from the access ACL.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5737. - Resolution: Fixed Fix Version/s: HDFS ACLs (HDFS-4685) I committed this to the HDFS-4685 fe

[jira] [Resolved] (HDFS-5739) ACL RPC must allow null name or unspecified permissions in ACL entries.

2014-01-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5739. - Resolution: Fixed Fix Version/s: HDFS ACLs (HDFS-4685) Hadoop Flags: Reviewed I commit

[jira] [Created] (HDFS-5743) Use protobuf to serialize snapshot information

2014-01-08 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5743: Summary: Use protobuf to serialize snapshot information Key: HDFS-5743 URL: https://issues.apache.org/jira/browse/HDFS-5743 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-5742) DatanodeCluster (mini cluster of DNs) fails to start

2014-01-08 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-5742: --- Summary: DatanodeCluster (mini cluster of DNs) fails to start Key: HDFS-5742 URL: https://issues.apache.org/jira/browse/HDFS-5742 Project: Hadoop HDFS Issue Ty

[jira] [Created] (HDFS-5741) BlockInfo#findDataNode can be deprecated

2014-01-08 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-5741: --- Summary: BlockInfo#findDataNode can be deprecated Key: HDFS-5741 URL: https://issues.apache.org/jira/browse/HDFS-5741 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-5740) getmerge file system shell command needs error message for user error

2014-01-08 Thread John Pfuntner (JIRA)
John Pfuntner created HDFS-5740: --- Summary: getmerge file system shell command needs error message for user error Key: HDFS-5740 URL: https://issues.apache.org/jira/browse/HDFS-5740 Project: Hadoop HDFS

[jira] [Created] (HDFS-5739) ACL RPC must allow null name or null permissions in ACL entries.

2014-01-08 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5739: --- Summary: ACL RPC must allow null name or null permissions in ACL entries. Key: HDFS-5739 URL: https://issues.apache.org/jira/browse/HDFS-5739 Project: Hadoop HDFS

persistent under-replicated blocks

2014-01-08 Thread Cooper Bethea
Hi HDFS developers, I have a worrying problem in a 2.0.0-cdh4.4.0 HDFS cluster I am running. 9 blocks in the cluster are persistently reported to be under-replicated per "hdfs fsck". I am able to fetch the files that contain these blocks, so I know that the data is there, but for some reason repl

[jira] [Created] (HDFS-5738) Serialize INode information in protobuf

2014-01-08 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5738: Summary: Serialize INode information in protobuf Key: HDFS-5738 URL: https://issues.apache.org/jira/browse/HDFS-5738 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-5737) Replacing only the default ACL can fail to copy unspecified base entries from the access ACL.

2014-01-08 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5737: --- Summary: Replacing only the default ACL can fail to copy unspecified base entries from the access ACL. Key: HDFS-5737 URL: https://issues.apache.org/jira/browse/HDFS-5737

[jira] [Created] (HDFS-5736) BM service as a separate process

2014-01-08 Thread Amir Langer (JIRA)
Amir Langer created HDFS-5736: - Summary: BM service as a separate process Key: HDFS-5736 URL: https://issues.apache.org/jira/browse/HDFS-5736 Project: Hadoop HDFS Issue Type: Sub-task C

[jira] [Created] (HDFS-5735) Testing support for BM as a service

2014-01-08 Thread Amir Langer (JIRA)
Amir Langer created HDFS-5735: - Summary: Testing support for BM as a service Key: HDFS-5735 URL: https://issues.apache.org/jira/browse/HDFS-5735 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-5734) A NN-internal RPC BM service

2014-01-08 Thread Amir Langer (JIRA)
Amir Langer created HDFS-5734: - Summary: A NN-internal RPC BM service Key: HDFS-5734 URL: https://issues.apache.org/jira/browse/HDFS-5734 Project: Hadoop HDFS Issue Type: Sub-task Compo

[jira] [Created] (HDFS-5733) Separate concurrency control between BM and NN

2014-01-08 Thread Amir Langer (JIRA)
Amir Langer created HDFS-5733: - Summary: Separate concurrency control between BM and NN Key: HDFS-5733 URL: https://issues.apache.org/jira/browse/HDFS-5733 Project: Hadoop HDFS Issue Type: Sub-ta

[jira] [Created] (HDFS-5732) Separate memory space between BM and NN

2014-01-08 Thread Amir Langer (JIRA)
Amir Langer created HDFS-5732: - Summary: Separate memory space between BM and NN Key: HDFS-5732 URL: https://issues.apache.org/jira/browse/HDFS-5732 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-5731) Refactoring to define interfaces between BM and NN and simplify the flow between them

2014-01-08 Thread Amir Langer (JIRA)
Amir Langer created HDFS-5731: - Summary: Refactoring to define interfaces between BM and NN and simplify the flow between them Key: HDFS-5731 URL: https://issues.apache.org/jira/browse/HDFS-5731 Project:

Jenkins build is back to normal : Hadoop-Hdfs-trunk #1638

2014-01-08 Thread Apache Jenkins Server
See

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #845

2014-01-08 Thread Apache Jenkins Server
See -- [...truncated 7701 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]

Hadoop-Hdfs-0.23-Build - Build # 845 - Still Failing

2014-01-08 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/845/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7894 lines...] [ERROR] location: class com.google.pro

[jira] [Created] (HDFS-5730) Inconsistent Audit logging for HDFS APIs

2014-01-08 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-5730: - Summary: Inconsistent Audit logging for HDFS APIs Key: HDFS-5730 URL: https://issues.apache.org/jira/browse/HDFS-5730 Project: Hadoop HDFS Issue Ty

[jira] [Created] (HDFS-5729) Lower chance to hit NPE in allocateNodeLocal

2014-01-08 Thread wenwupeng (JIRA)
wenwupeng created HDFS-5729: --- Summary: Lower chance to hit NPE in allocateNodeLocal Key: HDFS-5729 URL: https://issues.apache.org/jira/browse/HDFS-5729 Project: Hadoop HDFS Issue Type: Bug