Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-17 Thread Alejandro Abdelnur
Thanks Arun. +1 * Downloaded source tarball. * Verified MD5 * Verified signature * run apache-rat:check ok after minor tweak (see NIT1 below) * checked CHANGES.txt headers (see NIT2 below) * built DIST from source * verified hadoop version of Hadoop JARs * configured pseudo cluster * tested HttpF

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #733

2013-09-17 Thread Apache Jenkins Server
See -- [...truncated 7677 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]

Hadoop-Hdfs-0.23-Build - Build # 733 - Still Failing

2013-09-17 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/733/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7870 lines...] [ERROR] location: class com.google.pro

Build failed in Jenkins: Hadoop-Hdfs-trunk #1525

2013-09-17 Thread Apache Jenkins Server
See Changes: [acmurthy] Added ASL2 header to releasenotes.html. [acmurthy] HADOOP-9350. Moving to appropriate section in CHANGES.txt [acmurthy] Preparing for hadoop-2.1.1-beta release. [acmurthy] HADOOP-9944. Fix RpcRequestHeaderPr

Hadoop-Hdfs-trunk - Build # 1525 - Still Failing

2013-09-17 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1525/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9606 lines...] [INFO] Executed tasks [INFO] [INFO] --- m

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-17 Thread Andrew Wang
Hey all, Sorry to hijack the vote thread, but it'd be good to get some input on my email from yesterday re: symlink support in branch-2.1. I think it really should be in GA one way or the other. http://mail-archives.apache.org/mod_mbox/hadoop-common-dev/201309.mbox/%3CCAGB5D2ZDjqt69oFfv_HOsWEH18T

Re: symlink support in Hadoop 2 GA

2013-09-17 Thread Colin McCabe
I think it makes sense to finish symlinks support in the Hadoop 2 GA release. Colin On Mon, Sep 16, 2013 at 6:49 PM, Andrew Wang wrote: > Hi all, > > I wanted to broadcast plans for putting the FileSystem symlinks work > (HADOOP-8040) into branch-2.1 for the pending Hadoop 2 GA release. I think

Re: symlink support in Hadoop 2 GA

2013-09-17 Thread Suresh Srinivas
I agree that this is an important change. However, 2.2.0 GA is getting ready to rollout in weeks. I am concerned that these changes will add not only incompatible changes late in the game, but also possibly instability. Java API incompatibility is some thing we have avoided for the most part and I

[jira] [Created] (HDFS-5216) NumDecomDeadDataNodes not returning correct number of dead decommissioned nodes

2013-09-17 Thread Trevor Lorimer (JIRA)
Trevor Lorimer created HDFS-5216: Summary: NumDecomDeadDataNodes not returning correct number of dead decommissioned nodes Key: HDFS-5216 URL: https://issues.apache.org/jira/browse/HDFS-5216 Project:

Re: symlink support in Hadoop 2 GA

2013-09-17 Thread Colin McCabe
The issue is not modifying existing APIs. The issue is that code has been written that makes assumptions that are incompatible with the existence of things that are not files or directories. For example, there is a lot of code out there that looks at FileStatus#isFile, and if it returns false, as

[jira] [Resolved] (HDFS-1194) Secondary namenode fails to fetch the image from the primary

2013-09-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-1194. -- Resolution: Duplicate > Secondary namenode fails to fetch the image from the primary > -

[jira] [Created] (HDFS-5217) Namenode log directory link is inaccessible in secure cluster

2013-09-17 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-5217: --- Summary: Namenode log directory link is inaccessible in secure cluster Key: HDFS-5217 URL: https://issues.apache.org/jira/browse/HDFS-5217 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-5218) Trunk Build Failure at HDFS Sub-project

2013-09-17 Thread Zhijie Shen (JIRA)
Zhijie Shen created HDFS-5218: - Summary: Trunk Build Failure at HDFS Sub-project Key: HDFS-5218 URL: https://issues.apache.org/jira/browse/HDFS-5218 Project: Hadoop HDFS Issue Type: Bug

Re: symlink support in Hadoop 2 GA

2013-09-17 Thread Andrew Wang
I encourage interested parties to read through HADOOP-9912 to get a feel for the issues. There really is no way to add symlink support without changing the behavior of existing APIs. Ultimately, anything that returns a FileStatus is going to be different. Even if we default to resolving symlinks, r

Re: symlink support in Hadoop 2 GA

2013-09-17 Thread Eli Collins
(Looping in Arun since this impacts 2.x releases) I updated the versions on HADOOP-8040 and sub-tasks to reflect where the changes have landed. All of these changes (modulo HADOOP-9417) were merged to branch-2.1 and are in the 2.1.0 release. While symlinks are in 2.1.0 I don't think we can really

[jira] [Resolved] (HDFS-5211) Race condition between DistributedFileSystem#close and FileSystem#close can cause return of a closed DistributedFileSystem instance from the FileSystem cache.

2013-09-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5211. - Resolution: Fixed Fix Version/s: 1.3.0 1-win Hadoop Flags: Reviewed

[jira] [Created] (HDFS-5219) Add configuration keys for WebHDFS

2013-09-17 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5219: Summary: Add configuration keys for WebHDFS Key: HDFS-5219 URL: https://issues.apache.org/jira/browse/HDFS-5219 Project: Hadoop HDFS Issue Type: Bug Compon

[jira] [Created] (HDFS-5220) Expose group resolution time as metric

2013-09-17 Thread Rob Weltman (JIRA)
Rob Weltman created HDFS-5220: - Summary: Expose group resolution time as metric Key: HDFS-5220 URL: https://issues.apache.org/jira/browse/HDFS-5220 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-5221) hftp: does not work with HA NN configuration

2013-09-17 Thread Joep Rottinghuis (JIRA)
Joep Rottinghuis created HDFS-5221: -- Summary: hftp: does not work with HA NN configuration Key: HDFS-5221 URL: https://issues.apache.org/jira/browse/HDFS-5221 Project: Hadoop HDFS Issue Type