[jira] [Created] (HDFS-2934) HA: Allow configs to be scoped to all NNs in the nameservice

2012-02-09 Thread Todd Lipcon (Created) (JIRA)
HA: Allow configs to be scoped to all NNs in the nameservice Key: HDFS-2934 URL: https://issues.apache.org/jira/browse/HDFS-2934 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-2935) Shared edits dir property should be suffixed with nameservice and namenodeID

2012-02-09 Thread Vinithra Varadharajan (Created) (JIRA)
Shared edits dir property should be suffixed with nameservice and namenodeID Key: HDFS-2935 URL: https://issues.apache.org/jira/browse/HDFS-2935 Project: Hadoop HDFS

[jira] [Created] (HDFS-2933) Datanode index page on debug port not useful

2012-02-09 Thread Philip Zeyliger (Created) (JIRA)
Datanode index page on debug port not useful Key: HDFS-2933 URL: https://issues.apache.org/jira/browse/HDFS-2933 Project: Hadoop HDFS Issue Type: Improvement Components: data-node Af

[jira] [Created] (HDFS-2932) Under replicated block after the pipeline recovery.

2012-02-09 Thread J.Andreina (Created) (JIRA)
Under replicated block after the pipeline recovery. --- Key: HDFS-2932 URL: https://issues.apache.org/jira/browse/HDFS-2932 Project: Hadoop HDFS Issue Type: Bug Components: data-node

[jira] [Created] (HDFS-2931) Switch the DataNode's BlockVolumeChoosingPolicy to be a private-audience interface

2012-02-09 Thread Harsh J (Created) (JIRA)
Switch the DataNode's BlockVolumeChoosingPolicy to be a private-audience interface -- Key: HDFS-2931 URL: https://issues.apache.org/jira/browse/HDFS-2931 Project: Hadoop

Re: Review request: trunk->HDFS-1623 merge

2012-02-09 Thread Todd Lipcon
Thanks Suresh. I committed the merge to the branch. -Todd On Thu, Feb 9, 2012 at 4:32 PM, Suresh Srinivas wrote: > I looked at the merge. It looks good. +1. > > On Wed, Feb 8, 2012 at 9:08 PM, Todd Lipcon wrote: > >> The branch developed some new conflicts due to recent changes in trunk >> affe

[jira] [Resolved] (HDFS-2917) HA: haadmin should not work if run by regular user

2012-02-09 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-2917. --- Resolution: Fixed Hadoop Flags: Reviewed Thanks Todd. I've committed this. > HA

Re: Review request: trunk->HDFS-1623 merge

2012-02-09 Thread Suresh Srinivas
I looked at the merge. It looks good. +1. On Wed, Feb 8, 2012 at 9:08 PM, Todd Lipcon wrote: > The branch developed some new conflicts due to recent changes in trunk > affecting the RPC between the DN and the NN (the "StorageReport" > stuff). I've done a new merge to address these conflicts here

[jira] [Resolved] (HDFS-2922) HA: close out operation categories

2012-02-09 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-2922. --- Resolution: Fixed Hadoop Flags: Reviewed Thanks for the reviews. I've committed this.

[jira] [Resolved] (HDFS-2912) HA: Namenode not shutting down when shared edits dir is inaccessible

2012-02-09 Thread Aaron T. Myers (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-2912. -- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed I've j

[jira] [Created] (HDFS-2929) HA: stress test and fixes for block synchronization

2012-02-09 Thread Todd Lipcon (Created) (JIRA)
HA: stress test and fixes for block synchronization --- Key: HDFS-2929 URL: https://issues.apache.org/jira/browse/HDFS-2929 Project: Hadoop HDFS Issue Type: Sub-task Components: ha, n

[jira] [Created] (HDFS-2930) bin/hdfs should print a message when an invalid command is specified

2012-02-09 Thread Eli Collins (Created) (JIRA)
bin/hdfs should print a message when an invalid command is specified Key: HDFS-2930 URL: https://issues.apache.org/jira/browse/HDFS-2930 Project: Hadoop HDFS Issue Type: Im

[jira] [Created] (HDFS-2928) HA: ConfiguredFailoverProxyProvider should not create a NameNode proxy with an underlying retry proxy

2012-02-09 Thread Aaron T. Myers (Created) (JIRA)
HA: ConfiguredFailoverProxyProvider should not create a NameNode proxy with an underlying retry proxy - Key: HDFS-2928 URL: https://issues.apache.org/jira/browse/H

[jira] [Resolved] (HDFS-2764) TestBackupNode is racy

2012-02-09 Thread Aaron T. Myers (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-2764. -- Resolution: Fixed Fix Version/s: 0.23.2 I've just moved this to branch-0.23.

Re: Review request: trunk->HDFS-1623 merge

2012-02-09 Thread Todd Lipcon
Updated the merge against current trunk and HA branch. Here's the github link: https://github.com/toddlipcon/hadoop-common/commits/ha-merge-20120209 And the relevant diff reproduced below. If this looks mostly good, please +1 - we can continue to make improvements on the branch, but redoin

Re: Review request: trunk->HDFS-1623 merge

2012-02-09 Thread Todd Lipcon
On Thu, Feb 9, 2012 at 12:54 PM, Konstantin Shvachko wrote: > Ok I misunderstood the current direction of the merge. > > On the review request: > >> we don't deal with the case where OP_ADD >> contains blocks on a new file -- this is a case that doesn't happen on >> real clusters, but currently ha

[jira] [Resolved] (HDFS-2915) HA: TestFailureOfSharedDir.testFailureOfSharedDir() has race condition

2012-02-09 Thread Jitendra Nath Pandey (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey resolved HDFS-2915. Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Revi

Re: Review request: trunk->HDFS-1623 merge

2012-02-09 Thread Konstantin Shvachko
Ok I misunderstood the current direction of the merge. On the review request: > we don't deal with the case where OP_ADD > contains blocks on a new file -- this is a case that doesn't happen on > real clusters, but currently happens with synthetic logs generated > from the CreateEditLogs tool. I

[jira] [Created] (HDFS-2927) HttpFS documentation it is not wired to the generated site

2012-02-09 Thread Alejandro Abdelnur (Created) (JIRA)
HttpFS documentation it is not wired to the generated site -- Key: HDFS-2927 URL: https://issues.apache.org/jira/browse/HDFS-2927 Project: Hadoop HDFS Issue Type: Bug Componen

[jira] [Reopened] (HDFS-2764) TestBackupNode is racy

2012-02-09 Thread Aaron T. Myers (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers reopened HDFS-2764: -- Re-opening issue to commit this to the 0.23 branch, since the test might fail spuriously there as w

[jira] [Created] (HDFS-2926) HA: enable hadoop security authorization for haadmin / protocols

2012-02-09 Thread Eli Collins (Created) (JIRA)
HA: enable hadoop security authorization for haadmin / protocols Key: HDFS-2926 URL: https://issues.apache.org/jira/browse/HDFS-2926 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-2865) Standby namenode gets a "cannot lock storage" exception during startup

2012-02-09 Thread Hari Mankude (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Mankude resolved HDFS-2865. Resolution: Invalid > Standby namenode gets a "cannot lock storage" exception during startup > -

[jira] [Resolved] (HDFS-2866) Standby does not start up due to a gap in transaction id

2012-02-09 Thread Hari Mankude (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Mankude resolved HDFS-2866. Resolution: Duplicate hdfs-2874 > Standby does not start up due to a gap in transac

Re: Review request: trunk->HDFS-1623 merge

2012-02-09 Thread Todd Lipcon
Hi Konstantin, To be clear, this review request is a merge from the trunk branch into the HA branch (NOT a merge INTO trunk) - we've been doing these pretty much daily since the project began, so that we track trunk closely. The idea is so that we don't have unexpected integration issues when we d

Re: Review request: trunk->HDFS-1623 merge

2012-02-09 Thread Konstantin Shvachko
I was wondering 1. What was the test plan that has been executed for testing this implementation of HA? Besides unit tests. 2. Have you done any benchmarks, comparing current cluster performance against the branch. Would be good to have numbers for both cases with HA off and HA on. I'll post these

[jira] [Resolved] (HDFS-2924) Standby checkpointing fails to authenticate in secure cluster

2012-02-09 Thread Todd Lipcon (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2924. --- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed Committed to

[jira] [Resolved] (HDFS-2510) Add HA-related metrics

2012-02-09 Thread Aaron T. Myers (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-2510. -- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed Thanks

Jenkins build is back to stable : Hadoop-Hdfs-0.23-Build #164

2012-02-09 Thread Apache Jenkins Server
See

[jira] [Created] (HDFS-2925) Revert ScriptBasedMapping semantics to the existing ones, add DNS mapping diagnostics in progress

2012-02-09 Thread Steve Loughran (Created) (JIRA)
Revert ScriptBasedMapping semantics to the existing ones, add DNS mapping diagnostics in progress - Key: HDFS-2925 URL: https://issues.apache.org/jira/browse/HDFS-2925