[VOTE] Release Apache Hadoop 2.4.1

Folks, I've created another release candidate (rc1) for hadoop-2.4.1 based on the feedback that I would like to push out. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.4.1-rc1 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.4.1-rc1

Re: [VOTE] Release Apache Hadoop 0.23.11

+1 (binding) Thanks for all your efforts driving 0.23.* Thomas & co! Arun On Jun 19, 2014, at 8:14 AM, Thomas Graves wrote: > Hey Everyone, > > There have been various bug fixes that have went into > branch-0.23 since the 0.23.10 release. We think its time to do a 0.23.11. > > This is also

[DISCUSS] Change by-laws on release votes: 5 days instead of 7

Folks, I'd like to propose we change our by-laws to reduce our voting periods on new releases from 7 days to 5. Currently, it just takes too long to turn around releases; particularly if we have critical security fixes etc. Thoughts? thanks, Arun -- CONFIDENTIALITY NOTICE NOTICE: This m

Re: Plans of moving towards JDK7 in trunk

On Jun 20, 2014, at 9:51 PM, Steve Loughran wrote: > On 20 June 2014 21:35, Steve Loughran wrote: > >> >> This actually argues in favour of >> >> -renaming branch-2 branch-3 after a release >> -making trunk hadoop-4 >> >> -getting hadoop 3 released off the new branch-3 out in 2014, effectiv

[jira] [Created] (HDFS-6585) INodesInPath.resolve is called multiple times in FSNamesystem.setPermission

Zhilei Xu created HDFS-6585: --- Summary: INodesInPath.resolve is called multiple times in FSNamesystem.setPermission Key: HDFS-6585 URL: https://issues.apache.org/jira/browse/HDFS-6585 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-6508) Add an XAttr to specify the cipher mode

[ https://issues.apache.org/jira/browse/HDFS-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-6508. Resolution: Not a Problem > Add an XAttr to specify the cipher mode > --

[jira] [Created] (HDFS-6584) Support archival storage

Tsz Wo Nicholas Sze created HDFS-6584: - Summary: Support archival storage Key: HDFS-6584 URL: https://issues.apache.org/jira/browse/HDFS-6584 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Created] (HDFS-6583) Remove clientNode in FileUnderConstructionFeature

Haohui Mai created HDFS-6583: Summary: Remove clientNode in FileUnderConstructionFeature Key: HDFS-6583 URL: https://issues.apache.org/jira/browse/HDFS-6583 Project: Hadoop HDFS Issue Type: Bug

[jira] [Reopened] (HDFS-6391) Get the Key/IV from the NameNode for encrypted files in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-6391: --- > Get the Key/IV from the NameNode for encrypted files in DFSClient >

[jira] [Created] (HDFS-6582) Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler)

Ted Yu created HDFS-6582: Summary: Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler) Key: HDFS-6582 URL: https://issues.apache.org/jira/browse/HDFS-6582 Project: Hadoop HDFS Issue Type

Re: [VOTE] Release Apache Hadoop 2.4.1

Committed HDFS-6527 On 6/20/14, 1:34 PM, "Vinod Kumar Vavilapalli" wrote: >I just committed MAPREDUCE-5830 to all the needed branches. > >+Vinod >Hortonworks Inc. >http://hortonworks.com/ > > >On Fri, Jun 20, 2014 at 11:25 AM, Arun C Murthy >wrote: > >> Thanks for the feedback Vinod, Akira & Ki

[jira] [Created] (HDFS-6581) Write to single replica in memory

Arpit Agarwal created HDFS-6581: --- Summary: Write to single replica in memory Key: HDFS-6581 URL: https://issues.apache.org/jira/browse/HDFS-6581 Project: Hadoop HDFS Issue Type: Sub-task

Re: [VOTE] Release Apache Hadoop 2.4.1

I just committed MAPREDUCE-5830 to all the needed branches. +Vinod Hortonworks Inc. http://hortonworks.com/ On Fri, Jun 20, 2014 at 11:25 AM, Arun C Murthy wrote: > Thanks for the feedback Vinod, Akira & Kihwal. > > I'll re-spin rc1 with MAPREDUCE-5830 & HDFS-6527. > > @Kihwal - Can you, pleas

[jira] [Created] (HDFS-6580) 2 internal APIs in FSNamesystem use raw dir.getFileInfo() to getAuditFileInfo()

Zhilei Xu created HDFS-6580: --- Summary: 2 internal APIs in FSNamesystem use raw dir.getFileInfo() to getAuditFileInfo() Key: HDFS-6580 URL: https://issues.apache.org/jira/browse/HDFS-6580 Project: Hadoop HDF

Re: [VOTE] Release Apache Hadoop 2.4.1

On Jun 20, 2014, at 11:23 AM, Vinod Kumar Vavilapalli wrote: > Unfortunately even though we documented wire compatiblity, cross-version > client/server support doesn't yet really work for YARN and MapReduce. We > can only do that once we have wire-compatibility and eventually rolling > upgrades.

Re: [VOTE] Release Apache Hadoop 2.4.1

+1 of having HDFS-6527 back ported if possible 2014-06-20 7:32 GMT-07:00 Kihwal Lee : > If we ever respin 2.4.1, I strongly suggest HDFS-6527 be included. > > > Kihwal > > On 6/19/14, 4:56 PM, "Akira AJISAKA" wrote: > > >I think we should include this issue in 2.4.1, so I uploaded a patch to >

Re: [VOTE] Release Apache Hadoop 2.4.1

Thanks for the feedback Vinod, Akira & Kihwal. I'll re-spin rc1 with MAPREDUCE-5830 & HDFS-6527. @Kihwal - Can you, please, merge HDFS-6527 to branch-2.4 and branch-2.4.1? thanks, Arun On Jun 20, 2014, at 7:32 AM, Kihwal Lee wrote: > If we ever respin 2.4.1, I strongly suggest HDFS-6527 be in

Re: [VOTE] Release Apache Hadoop 2.4.1

Unfortunately even though we documented wire compatiblity, cross-version client/server support doesn't yet really work for YARN and MapReduce. We can only do that once we have wire-compatibility and eventually rolling upgrades. No fix is in sight for MAPREDUCE-5831 - for now both clients and AMs ha

[jira] [Created] (HDFS-6579) TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC

Jinghui Wang created HDFS-6579: -- Summary: TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC Key: HDFS-6579 URL: https://issues.apache.org/jira/browse/HDFS-6579 Project: Hadoop HDFS

[jira] [Created] (HDFS-6578) add toString method to DatanodeStorage etc for easier debugging

Yongjun Zhang created HDFS-6578: --- Summary: add toString method to DatanodeStorage etc for easier debugging Key: HDFS-6578 URL: https://issues.apache.org/jira/browse/HDFS-6578 Project: Hadoop HDFS

Re: MiniDFSCluster on Windows unfortunatelly requires native toolchain for automated tests

Hello Bernd, This is my first time looking at Commons VFS. It looks like a very useful project, and I'm sorry to hear that we've caused some grief for your tests. I can provide some background on these changes. Traditionally, 1.2 and earlier versions didn't officially support Windows beyond a b

[jira] [Resolved] (HDFS-6577) Failure to create FinalizeCommand

[ https://issues.apache.org/jira/browse/HDFS-6577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6577. - Resolution: Not a Problem Resolving, feel free to respond if you disagree. > Failure to create Fi

Re: [VOTE] Release Apache Hadoop 0.23.11

Checked out the source, built and started a single node cluster. Ran a couple of sample jobs. +1 (binding) Kihwal On 6/19/14, 10:14 AM, "Thomas Graves" wrote: >Hey Everyone, > >There have been various bug fixes that have went into >branch-0.23 since the 0.23.10 release. We think its time to d

Re: [VOTE] Release Apache Hadoop 2.4.1

If we ever respin 2.4.1, I strongly suggest HDFS-6527 be included. Kihwal On 6/19/14, 4:56 PM, "Akira AJISAKA" wrote: >I think we should include this issue in 2.4.1, so I uploaded a patch to >fix it. I'll appreciate your review. > >Thanks, >Akira > >(2014/06/18 12:13), Vinod Kumar Vavilapalli

[jira] [Created] (HDFS-6577) Failure to create FinalizeCommand

Yongjun Zhang created HDFS-6577: --- Summary: Failure to create FinalizeCommand Key: HDFS-6577 URL: https://issues.apache.org/jira/browse/HDFS-6577 Project: Hadoop HDFS Issue Type: Bug C

Build failed in Jenkins: Hadoop-Hdfs-trunk #1780

See Changes: [arp] HADOOP-10279. Create multiplexer, a requirement for the fair queue. (Contributed by Chris Li) [atm] HDFS-6403. Add metrics for log warnings reported by JVM pauses. Contributed by Yongjun Zhang. [tucu] HDFS-6312.

Hadoop-Hdfs-trunk - Build # 1780 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1780/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 15321 lines...] [INFO] [INFO] --- maven-source-plugin:2.

[jira] [Created] (HDFS-6576) Datanode log is generating at root directory in security mode

surendra singh lilhore created HDFS-6576: Summary: Datanode log is generating at root directory in security mode Key: HDFS-6576 URL: https://issues.apache.org/jira/browse/HDFS-6576 Project: Ha

[jira] [Created] (HDFS-6575) HDFS quota is not updated when changing File replication

George Wong created HDFS-6575: - Summary: HDFS quota is not updated when changing File replication Key: HDFS-6575 URL: https://issues.apache.org/jira/browse/HDFS-6575 Project: Hadoop HDFS Issue Ty

[jira] [Resolved] (HDFS-5184) BlockPlacementPolicyWithNodeGroup does not work correct when avoidStaleNodes is true

[ https://issues.apache.org/jira/browse/HDFS-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Vujic resolved HDFS-5184. Resolution: Done This is fixed in HDP 2 with the new implementation of the block placement policy w

[jira] [Created] (HDFS-6574) make sure addToDeadNodes() only be called when there's a connection issue occur

Liang Xie created HDFS-6574: --- Summary: make sure addToDeadNodes() only be called when there's a connection issue occur Key: HDFS-6574 URL: https://issues.apache.org/jira/browse/HDFS-6574 Project: Hadoop HDF