Re: symlink support in Hadoop 2 GA

On 17 September 2013 23:05, Eli Collins wrote: > (Looping in Arun since this impacts 2.x releases) > > I updated the versions on HADOOP-8040 and sub-tasks to reflect where > the changes have landed. All of these changes (modulo HADOOP-9417) > were merged to branch-2.1 and are in the 2.1.0 release

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #734

See -- [...truncated 7677 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]

Hadoop-Hdfs-0.23-Build - Build # 734 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/734/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7870 lines...] [ERROR] location: class com.google.pro

Hadoop-Hdfs-trunk - Build # 1526 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1526/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10207 lines...] [WARNING] Failed to retrieve plugin descr

Build failed in Jenkins: Hadoop-Hdfs-trunk #1526

See Changes: [jing9] HDFS-5212. Refactor RpcMessage and NFS3Response to support different types of authentication information. Contributed by Jing Zhao. [brandonli] HADOOP-9669 Reduce the number of byte array creations and copies in

Re: symlink support in Hadoop 2 GA

On Wed, Sep 18, 2013 at 11:29 AM, Steve Loughran wrote: > I'm reluctant for this as while delaying the release, because we are going > to find problems all the way up the stack -which will require a > choreographed set of changes. Given the grief of the protbuf update, I > don't want to go near th

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

On Wed, Sep 18, 2013 at 12:03 AM, Karthik Kambatla wrote: > Not sure if this should be a blocker for 2.1.1, but filed HADOOP-9976 to > have a single version of avro. > > It depends if there is a known and non-workaroundable issue at runtime because of this. If not I wouldn't say it is a blocker.

Re: symlink support in Hadoop 2 GA

On 18 September 2013 12:53, Alejandro Abdelnur wrote: > On Wed, Sep 18, 2013 at 11:29 AM, Steve Loughran >wrote: > > > I'm reluctant for this as while delaying the release, because we are > going > > to find problems all the way up the stack -which will require a > > choreographed set of changes

[jira] [Resolved] (HDFS-4990) Block placement for storage types

[ https://issues.apache.org/jira/browse/HDFS-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4990. -- Resolution: Fixed Fix Version/s: Heterogeneous Storage (HDFS-2832) Ha

[jira] [Created] (HDFS-5222) Move block schedule information from DatanodeDescriptor to DatanodeStorageInfo

Tsz Wo (Nicholas), SZE created HDFS-5222: Summary: Move block schedule information from DatanodeDescriptor to DatanodeStorageInfo Key: HDFS-5222 URL: https://issues.apache.org/jira/browse/HDFS-5222

Re: symlink support in Hadoop 2 GA

On Wed, Sep 18, 2013 at 5:45 AM, Steve Loughran wrote: > On 18 September 2013 12:53, Alejandro Abdelnur wrote: > > > On Wed, Sep 18, 2013 at 11:29 AM, Steve Loughran > >wrote: > > > > > I'm reluctant for this as while delaying the release, because we are > > going > > > to find problems all the

Re: symlink support in Hadoop 2 GA

On Sep 16, 2013, at 6:49 PM, Andrew Wang wrote: > Hi all, > > I wanted to broadcast plans for putting the FileSystem symlinks work > (HADOOP-8040) into branch-2.1 for the pending Hadoop 2 GA release. I think > it's pretty important we get it in since it's not a compatible change; if > it misses

Re: symlink support in Hadoop 2 GA

the main change is whatever APIs are going to be provided (and implicitly: supported for a long time) to handle symlinks separately from directories On 18 September 2013 17:24, Eli Collins wrote: > On Wed, Sep 18, 2013 at 5:45 AM, Steve Loughran >wrote: > > > On 18 September 2013 12:53, Alejan

[jira] [Created] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

Aaron T. Myers created HDFS-5223: Summary: Allow edit log/fsimage format changes without changing layout version Key: HDFS-5223 URL: https://issues.apache.org/jira/browse/HDFS-5223 Project: Hadoop HDF

Re: symlink support in Hadoop 2 GA

It's an incompatible change. Existing APIs like listStatus and globStatus need to be symlink aware now, which can break assumptions of user code. We've had FileStatus#isSymlink() since the early days, but lots of user code hasn't been updated to use it. I think Eli's earlier email did a good job a

[jira] [Resolved] (HDFS-5181) Fail-over support for HA cluster in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-5181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-5181. - Resolution: Duplicate > Fail-over support for HA cluster in WebHDFS > ---

[jira] [Created] (HDFS-5224) Refactor PathBasedCache* methods to use a Path rather than a String

Andrew Wang created HDFS-5224: - Summary: Refactor PathBasedCache* methods to use a Path rather than a String Key: HDFS-5224 URL: https://issues.apache.org/jira/browse/HDFS-5224 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-5213) separate PathBasedCacheEntry and PathBasedCacheDirectiveWithId

[ https://issues.apache.org/jira/browse/HDFS-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-5213. --- Resolution: Fixed Fix Version/s: HDFS-4949 Committed, thanks again Colin. Follow-on JIRA for st

[jira] [Resolved] (HDFS-5221) hftp: does not work with HA NN configuration

[ https://issues.apache.org/jira/browse/HDFS-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-5221. --- Resolution: Duplicate Duping to HDFS-5123. Joep, it seems likely that one of your two approaches will

[jira] [Created] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over agin

Roman Shaposhnik created HDFS-5225: -- Summary: datanode keeps logging the same 'is no longer in the dataset' message over and over agin Key: HDFS-5225 URL: https://issues.apache.org/jira/browse/HDFS-5225

[jira] [Created] (HDFS-5226) Trash::moveToTrash doesn't work across multiple namespace

Joep Rottinghuis created HDFS-5226: -- Summary: Trash::moveToTrash doesn't work across multiple namespace Key: HDFS-5226 URL: https://issues.apache.org/jira/browse/HDFS-5226 Project: Hadoop HDFS

[jira] [Created] (HDFS-5227) Namenode.getAddress() should return namenode rpc-address

Chuan Liu created HDFS-5227: --- Summary: Namenode.getAddress() should return namenode rpc-address Key: HDFS-5227 URL: https://issues.apache.org/jira/browse/HDFS-5227 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-5155) Depricate API of getStorageID() and setStorageID() in DatanodeID as multiple storages

[ https://issues.apache.org/jira/browse/HDFS-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HDFS-5155. -- Resolution: Duplicate > Depricate API of getStorageID() and setStorageID() in DatanodeID as multiple

[jira] [Created] (HDFS-5228) The RemoteIterator returned by DistributedFileSystem.listFiles(..) may throw NPE

Tsz Wo (Nicholas), SZE created HDFS-5228: Summary: The RemoteIterator returned by DistributedFileSystem.listFiles(..) may throw NPE Key: HDFS-5228 URL: https://issues.apache.org/jira/browse/HDFS-5228