[jira] [Reopened] (HDFS-2979) HA: Balancer should use logical uri for creating failover proxy with HA enabled.

[ https://issues.apache.org/jira/browse/HDFS-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers reopened HDFS-2979: -- On second thought, I'm going to revert this change and fix the issue with NN conf mutation by modif

Re: Merging the HA branch to trunk - Wednesday, February 29th

I think it is better if you start a fresh voting thread. I almost missed this given originally it was a discussion thread, perhaps others too. Thanks +Vinod On Wed, Feb 29, 2012 at 5:42 PM, Suresh Srinivas wrote: > I am +1 on merging this to trunk. > > On Feb 29, 2012, at 4:03 PM, Todd Lipcon

[jira] [Created] (HDFS-3034) Remove the deprecated Syncable.sync() method

Remove the deprecated Syncable.sync() method Key: HDFS-3034 URL: https://issues.apache.org/jira/browse/HDFS-3034 Project: Hadoop HDFS Issue Type: Improvement Components: hdfs client

Re: Merging the HA branch to trunk - Wednesday, February 29th

I am +1 on merging this to trunk. On Feb 29, 2012, at 4:03 PM, Todd Lipcon wrote: > +1 as well. > > My latest tests after applying the performance fixes indicate that > there is no statistically significant performance regression between > trunk and HA, even in tests designed to stress test the

Re: Merging the HA branch to trunk - Wednesday, February 29th

Anyway, could we get a stable build before merging? Nicholas From: Todd Lipcon To: hdfs-dev@hadoop.apache.org; Tsz Wo Sze Sent: Wednesday, February 29, 2012 5:04 PM Subject: Re: Merging the HA branch to trunk - Wednesday, February 29th On Wed, Feb 29, 2012

[jira] [Resolved] (HDFS-3010) Get performance on HA branch to match trunk

[ https://issues.apache.org/jira/browse/HDFS-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3010. --- Resolution: Fixed With the recent patches committed to the HA branch, performance is now comparable.

Re: Merging the HA branch to trunk - Wednesday, February 29th

On Wed, Feb 29, 2012 at 5:01 PM, Tsz Wo Sze wrote: > Hi Todd, > > Then, why the trunk build did not suffer such problem? Bad luck? Looks like a network blip - failure to download something from archive.apache.org. Todd > > > >  From: Todd Lipcon > To: hdfs-dev@

Re: Merging the HA branch to trunk - Wednesday, February 29th

Hi Todd, Then, why the trunk build did not suffer such problem? Nicholas From: Todd Lipcon To: hdfs-dev@hadoop.apache.org; Tsz Wo Sze Sent: Wednesday, February 29, 2012 4:36 PM Subject: Re: Merging the HA branch to trunk - Wednesday, February 29th On We

[jira] [Resolved] (HDFS-2979) HA: Balancer should use logical uri for creating failover proxy with HA enabled.

[ https://issues.apache.org/jira/browse/HDFS-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-2979. -- Resolution: Fixed Thanks Todd. I've filed HDFS-3033 to address these failures.

[jira] [Created] (HDFS-3033) HA: MiniDFSCluster should configure conf with actual address of NN in case of non-federated, non-HA cluster

HA: MiniDFSCluster should configure conf with actual address of NN in case of non-federated, non-HA cluster --- Key: HDFS-3033 URL: https://issues.apache.org/j

[jira] [Resolved] (HDFS-3023) Optimize entries in edits log for persistBlocks calls

[ https://issues.apache.org/jira/browse/HDFS-3023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3023. --- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Target Version/s: HA branch (HD

Re: Merging the HA branch to trunk - Wednesday, February 29th

On Wed, Feb 29, 2012 at 4:32 PM, Tsz Wo Sze wrote: > > Latest HA Build (#92): > https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Hdfs-HAbranch-build/92/console > > [INFO] > [INFO] Apache Hadoop HDFS SUCCESS [8:34.652s] > [INFO] Apache Hadoop HttpFS ...

Re: Merging the HA branch to trunk - Wednesday, February 29th

Hi, The HA build has been unstable since Feb 13.  In particular, HttpFS failed in the latest build (#92).  On the other hand, the latest trunk HDFS build (#970) is stable.  Could we stabilize the HA build before merging? Nicholas --- Latest HA Build (#92): https://

[jira] [Reopened] (HDFS-2979) HA: Balancer should use logical uri for creating failover proxy with HA enabled.

[ https://issues.apache.org/jira/browse/HDFS-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened HDFS-2979: --- This patch seems to have made some tests fail (I noticed with TestFileAppend2). It seems to be trying to

Re: Merging the HA branch to trunk - Wednesday, February 29th

+1 as well. My latest tests after applying the performance fixes indicate that there is no statistically significant performance regression between trunk and HA, even in tests designed to stress test the worst case code paths. The fixes should be committed today or tomorrow, but don't need to hold

Re: Merging the HA branch to trunk - Wednesday, February 29th

Hello HDFS devs, The four JIRAs I mentioned below have all now been committed to the HA branch. We've been running through the test plans posted on HDFS-1623 for the last week. The only thing that's been discovered in the interim on the branch that should perhaps be considered a blocker for the m

[jira] [Resolved] (HDFS-2979) HA: Balancer should use logical uri for creating failover proxy with HA enabled.

[ https://issues.apache.org/jira/browse/HDFS-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-2979. -- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed Thanks

[jira] [Created] (HDFS-3032) Lease renewer tries forever even if renewal is not possible

Lease renewer tries forever even if renewal is not possible --- Key: HDFS-3032 URL: https://issues.apache.org/jira/browse/HDFS-3032 Project: Hadoop HDFS Issue Type: Bug Compon

[jira] [Resolved] (HDFS-2253) Create a benchmark to measure performance of "append" to HDFS files

[ https://issues.apache.org/jira/browse/HDFS-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-2253. -- Resolution: Duplicate Duplicate HDFS-663. > Create a benchmark

[jira] [Created] (HDFS-3031) Error (failed to close file) when uploading large file + kill active NN + manual failover

Error (failed to close file) when uploading large file + kill active NN + manual failover - Key: HDFS-3031 URL: https://issues.apache.org/jira/browse/HDFS-3031 Pr

[jira] [Resolved] (HDFS-3027) HA: Implement a simple NN health check

[ https://issues.apache.org/jira/browse/HDFS-3027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3027. -- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed Thanks

[jira] [Resolved] (HDFS-1103) Replica recovery doesn't distinguish between flushed-but-corrupted last chunk and unflushed last chunk

[ https://issues.apache.org/jira/browse/HDFS-1103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-1103. -- Resolution: Invalid As explained by Hairong, this is invalid. Please feel free

Hadoop-Hdfs-trunk-Commit - Build # 1882 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1882/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9390 lines...] [INFO] Executing tasks main: [INFO

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #183

See Changes: [harsh] svn merge -c 1295061. Merge HADOOP-7940 into branch-0.23. (Csaba Miklos via harsh). [vinodkv] MAPREDUCE-3931. Changed PB implementation of LocalResource to take locks so that race conditions don't fail task

Hadoop-Hdfs-0.23-PB-Build - Build # 6 - Unstable

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-PB-Build/6/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 15126 lines...] [INFO] Deleting /home/jenkins/jenki

Jenkins build became unstable: Hadoop-Hdfs-0.23-PB-Build #6

See

Jenkins build is back to stable : Hadoop-Hdfs-trunk #970

See

[Important] Checksum Error while appending to the file.

Hi All, In one of our hadoop cluster we faced CheckSum file Corruption, due to which appending to the file failed. If any one of you faced this problem earlier, please share your experiences. We are using hadoop 0.20.1 with append feature. Scenario: === 1. Created the file, wri