Re: [VOTE] Merge HDFS-5698 Use protobuf to serialize / deserialize FSImage to trunk

2014-02-07 Thread Haohui Mai
With 3 binding +1 and 2 non-binding +1 votes, the vote has passed. The code will be merged soon (pending Jenkins). We will address any remaining issues in trunk. Thanks to everyone who voted and provided their feedback. Regards, Haohui On Wed, Feb 5, 2014 at 12:47 PM, Chris Nauroth wrote: > +

[jira] [Created] (HDFS-5913) Nfs3Utils#getWccAttr() should check attr parameter against null

2014-02-07 Thread Ted Yu (JIRA)
Ted Yu created HDFS-5913: Summary: Nfs3Utils#getWccAttr() should check attr parameter against null Key: HDFS-5913 URL: https://issues.apache.org/jira/browse/HDFS-5913 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-5616) NameNode: implement default ACL handling.

2014-02-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5616. - Resolution: Fixed Fix Version/s: HDFS ACLs (HDFS-4685) Hadoop Flags: Reviewed Thanks f

[jira] [Resolved] (HDFS-5911) The id of a CacheDirective instance does not get serialized in the protobuf-fsimage

2014-02-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-5911. - Resolution: Fixed Fix Version/s: HDFS-5698 (FSImage in protobuf) Hadoop Flags: Reviewed +1. I'

[jira] [Resolved] (HDFS-5446) Consider supporting a mechanism to allow datanodes to drain outstanding work during rolling upgrade

2014-02-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-5446. -- Resolution: Won't Fix > Consider supporting a mechanism to allow datanodes to drain outstanding work >

[jira] [Created] (HDFS-5912) TestDistributedFileSystem#testGetFileBlockStorageLocationsBatching is flaky

2014-02-07 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-5912: - Summary: TestDistributedFileSystem#testGetFileBlockStorageLocationsBatching is flaky Key: HDFS-5912 URL: https://issues.apache.org/jira/browse/HDFS-5912 Project: Hadoop HDF

[jira] [Created] (HDFS-5911) The id of a CacheDirective instance does not get serialized in the protobuf-fsimage

2014-02-07 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5911: Summary: The id of a CacheDirective instance does not get serialized in the protobuf-fsimage Key: HDFS-5911 URL: https://issues.apache.org/jira/browse/HDFS-5911 Project: Hado

[jira] [Created] (HDFS-5910) Enhance DataTransferProtocol to support encrypted and plain-text communication

2014-02-07 Thread Benoy Antony (JIRA)
Benoy Antony created HDFS-5910: -- Summary: Enhance DataTransferProtocol to support encrypted and plain-text communication Key: HDFS-5910 URL: https://issues.apache.org/jira/browse/HDFS-5910 Project: Hadoo

Re: Re-swizzle 2.3

2014-02-07 Thread Vinod Kumar Vavilapalli
Heres what I've done: - Reverted YARN-1493,YARN-1490,YARN-1041, YARN-1166,YARN-1566,YARN-1689,YARN-1661 from branch-2.3. - Updated YARN's CHANGES.txt in trunk, branch-2 and branch-2.3. - Updated these JIRAs to have 2.4 as the fix-version. - Compiled branch-2.3. Let me know if you run into any

Re: confirm expected HA behavior

2014-02-07 Thread Todd Lipcon
Hi Arpit, The issue here is that our transaction log is not a proper "write-ahead log". In fact, it is a "write-behind" log of sorts -- our general operations look something like: - lock namespace - make a change to namespace - write to log - unlock namespace - sync log In the case of an active

Re: Re-swizzle 2.3

2014-02-07 Thread Vinod Kumar Vavilapalli
Haven't heard back from Jian. Reverting the set from branch-2.3 (only). Tx for the offline list. +Vinod On Fri, Feb 7, 2014 at 9:08 AM, Alejandro Abdelnur wrote: > Vinod, I have the patches to revert most of the JIRAs, the first batch, > I'll send them off line to you. > > Thanks. > > > On Thu,

[jira] [Created] (HDFS-5909) NameNode : Can some features be implemented in a pure YARN app, to synergize broader uniformity for HCFS distributed FS metadata operations?

2014-02-07 Thread jay vyas (JIRA)
jay vyas created HDFS-5909: -- Summary: NameNode : Can some features be implemented in a pure YARN app, to synergize broader uniformity for HCFS distributed FS metadata operations? Key: HDFS-5909 URL: https://issues.apac

[jira] [Created] (HDFS-5908) Change AclFeature to capture list of ACL entries in an ImmutableList.

2014-02-07 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5908: --- Summary: Change AclFeature to capture list of ACL entries in an ImmutableList. Key: HDFS-5908 URL: https://issues.apache.org/jira/browse/HDFS-5908 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-5906) Fixing findbugs and javadoc warnings in the HDFS-5698 branch

2014-02-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-5906. - Resolution: Fixed Fix Version/s: HDFS-5698 (FSImage in protobuf) Hadoop Flags: Reviewed +1. I'

[jira] [Created] (HDFS-5907) Handle block deletion requests during rolling upgrades

2014-02-07 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-5907: --- Summary: Handle block deletion requests during rolling upgrades Key: HDFS-5907 URL: https://issues.apache.org/jira/browse/HDFS-5907 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-5906) Fixing findbugs and javadoc warnings in the HDFS-5698 branch

2014-02-07 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5906: Summary: Fixing findbugs and javadoc warnings in the HDFS-5698 branch Key: HDFS-5906 URL: https://issues.apache.org/jira/browse/HDFS-5906 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-5874) Should not compare DataNode current layout version with that of NameNode in DataStrorage

2014-02-07 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li resolved HDFS-5874. -- Resolution: Fixed > Should not compare DataNode current layout version with that of NameNode in > DataS

Re: Re-swizzle 2.3

2014-02-07 Thread Alejandro Abdelnur
sire, as sandy said, lets keep it in branch 2 for now and if not resolved by 2.4 timeframe we'll revert them there. thx Alejandro (phone typing) > On Feb 7, 2014, at 10:14, Steve Loughran wrote: > >> On 6 February 2014 17:07, Alejandro Abdelnur wrote: >> >> Thanks Robert, >> >> All, >> >>

Re: Re-swizzle 2.3

2014-02-07 Thread Steve Loughran
On 6 February 2014 17:07, Alejandro Abdelnur wrote: > Thanks Robert, > > All, > > > > I'm inclined to revert them from branch-2 as well. > > -1 to that; if there are issues we should be able to find and fix them soon enough. Even if you aren't doing long-lived YARN services yet, even llama benefi

Re: Re-swizzle 2.3

2014-02-07 Thread Alejandro Abdelnur
Vinod, I have the patches to revert most of the JIRAs, the first batch, I'll send them off line to you. Thanks. On Thu, Feb 6, 2014 at 8:56 PM, Vinod Kumar Vavilapalli wrote: > > Thanks. please post your findings, Jian wrote this part of the code and > between him/me, we can take care of those

[jira] [Created] (HDFS-5905) Upgrade and rolling upgrade should not be allowed simultaneously

2014-02-07 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-5905: Summary: Upgrade and rolling upgrade should not be allowed simultaneously Key: HDFS-5905 URL: https://issues.apache.org/jira/browse/HDFS-5905 Project:

[jira] [Created] (HDFS-5904) TestFileStatus fails intermittently on trunk and branch2

2014-02-07 Thread Mit Desai (JIRA)
Mit Desai created HDFS-5904: --- Summary: TestFileStatus fails intermittently on trunk and branch2 Key: HDFS-5904 URL: https://issues.apache.org/jira/browse/HDFS-5904 Project: Hadoop HDFS Issue Type:

Jenkins build is back to normal : Hadoop-Hdfs-trunk #1666

2014-02-07 Thread Apache Jenkins Server
See

[jira] [Created] (HDFS-5903) FSVolumeList#initializeReplicaMaps(..) not doing anything, it can be removed

2014-02-07 Thread Vinay (JIRA)
Vinay created HDFS-5903: --- Summary: FSVolumeList#initializeReplicaMaps(..) not doing anything, it can be removed Key: HDFS-5903 URL: https://issues.apache.org/jira/browse/HDFS-5903 Project: Hadoop HDFS

[jira] [Created] (HDFS-5902) Atomic Directory Swapping Operation

2014-02-07 Thread Benoit Perroud (JIRA)
Benoit Perroud created HDFS-5902: Summary: Atomic Directory Swapping Operation Key: HDFS-5902 URL: https://issues.apache.org/jira/browse/HDFS-5902 Project: Hadoop HDFS Issue Type: New Feature