Re: [VOTE] Release Apache Hadoop 2.0.6-alpha (RC1)

+1 (binding) Verified bits and ran examples on a 10-node cluster. Looks good. Arun On Aug 15, 2013, at 10:29 PM, Konstantin Boudnik wrote: > All, > > I have created a release candidate (rc1) for hadoop-2.0.6-alpha that I would > like to release. > > This is a stabilization release that inclu

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

Thanks for the heads up Aaron, I've changed fix-version of HDFS-4763 to 2.1.1-beta for now. Committers - please be careful setting fix-versions, this is a good anti-pattern to avoid… though, I'm willing to bet a lot of dough that this isn't the first Hadoop release with this issue… *smile* Aru

Re: hadoop-2.1.1-beta & hadoop-2.2.0 (GA)

FYI - here is the end-point I'm using to track blockers on 2.1.1-beta: http://s.apache.org/hadoop-2.1.1-beta-blockers Essentially, these are *Blocker* bugs with *Target Version* set to 2.1.1-beta. thanks, Arun On Aug 16, 2013, at 7:39 PM, Arun C Murthy wrote: > Gang, > > I spent time looking

[jira] [Created] (HDFS-5118) Extend LoadGenerator for testing NameNode retry cache

Jing Zhao created HDFS-5118: --- Summary: Extend LoadGenerator for testing NameNode retry cache Key: HDFS-5118 URL: https://issues.apache.org/jira/browse/HDFS-5118 Project: Hadoop HDFS Issue Type: New

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

I was evaluating the release bits when I noticed that the change done in HDFS-4763 to add support for starting the HDFS NFSv3 gateway, which is marked with a "fix version" of 2.1.0-beta and included in the release notes of RC2, is not in fact included in the RC2 release bits. It looks to me like th

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

On Thu, Aug 15, 2013 at 2:15 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would > like to get released - this fixes the bugs we saw since the last go-around > (rc1). > > The RC is available at: > http://people.apache.org/~acmurthy/hadoo

Re: Secure deletion of blocks

Thanks for the heads up, but I think I've managed to implement it crudely by overwriting sequentially with 1s, 0s and random bytes and tested it successfully on an ext4 partition.  I tested it by dd-ing the entire partition to a file, confirming a particular string was not pre

Re: [VOTE] Release Apache Hadoop 2.0.6-alpha (RC1)

+1 Did the same as with rc0. Works for me. Thanks, --Konst On Thu, Aug 15, 2013 at 10:29 PM, Konstantin Boudnik wrote: > All, > > I have created a release candidate (rc1) for hadoop-2.0.6-alpha that I > would > like to release. > > This is a stabilization release that includes fixed for a cou

[jira] [Created] (HDFS-5117) Allow the owner of an HDFS path to be a group

Ryan Hennig created HDFS-5117: - Summary: Allow the owner of an HDFS path to be a group Key: HDFS-5117 URL: https://issues.apache.org/jira/browse/HDFS-5117 Project: Hadoop HDFS Issue Type: New Fea

Re: Secure deletion of blocks

Just to clarify, ext4 has the option to turn off journalling. ext3 does not. Not sure about reiser. Colin On Tue, Aug 20, 2013 at 12:42 PM, Colin McCabe wrote: > > If I've got the right idea about this at all? > > From the man page for wipe(1); > > "Journaling filesystems (such as Ext3 or Rei

Re: Secure deletion of blocks

> If I've got the right idea about this at all? >From the man page for wipe(1); "Journaling filesystems (such as Ext3 or ReiserFS) are now being used by default by most Linux distributions. No secure deletion program that does filesystem-level calls can sanitize files on such filesystems, because

[jira] [Created] (HDFS-5116) TestHDFSCLI fails on OS X

Arpit Agarwal created HDFS-5116: --- Summary: TestHDFSCLI fails on OS X Key: HDFS-5116 URL: https://issues.apache.org/jira/browse/HDFS-5116 Project: Hadoop HDFS Issue Type: Bug Environmen

[jira] [Created] (HDFS-5115) Make StorageID a UUID

Arpit Agarwal created HDFS-5115: --- Summary: Make StorageID a UUID Key: HDFS-5115 URL: https://issues.apache.org/jira/browse/HDFS-5115 Project: Hadoop HDFS Issue Type: Sub-task Componen

[jira] [Created] (HDFS-5114) getMaxNodesPerRack() in BlockPlacementPolicyDefault does not take decommissioning nodes into account.

Kihwal Lee created HDFS-5114: Summary: getMaxNodesPerRack() in BlockPlacementPolicyDefault does not take decommissioning nodes into account. Key: HDFS-5114 URL: https://issues.apache.org/jira/browse/HDFS-5114

[jira] [Resolved] (HDFS-5113) Implement POST method to upload the checkpoint

[ https://issues.apache.org/jira/browse/HDFS-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HDFS-5113. - Resolution: Duplicate > Implement POST method to upload the checkpoint > -

[jira] [Created] (HDFS-5113) Implement POST method to upload the checkpoint

Vinay created HDFS-5113: --- Summary: Implement POST method to upload the checkpoint Key: HDFS-5113 URL: https://issues.apache.org/jira/browse/HDFS-5113 Project: Hadoop HDFS Issue Type: Improvement

Re: Which SVN location should i checkout for creating patch to branch-1 (HDFS-2933) ?

Vivek, The current branch where features/bug fixes go to for release 1.x is https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1 1.x releases are created from the above branch. A new branch is created and the release is made from that branch. For example, you can see branch correspon

[jira] [Created] (HDFS-5112) NetWorkTopology#countNumOfAvailableNodes() is returning wrong value if excluded nodes passed are not part of the cluster tree

Vinay created HDFS-5112: --- Summary: NetWorkTopology#countNumOfAvailableNodes() is returning wrong value if excluded nodes passed are not part of the cluster tree Key: HDFS-5112 URL: https://issues.apache.org/jira/browse/HDFS

Which SVN location should i checkout for creating patch to branch-1 (HDFS-2933) ?

Hi, I am a new contributor to Hadoop. In HDFS-2933 (/Datanode index page on debug port not useful/), which I am currently working

Jenkins build is back to normal : Hadoop-Hdfs-trunk #1497

See

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #705

See -- [...truncated 7673 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]

Hadoop-Hdfs-0.23-Build - Build # 705 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/705/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7866 lines...] [ERROR] location: class com.google.pro

Implement directory/table level access control in HDFS

Hi folks, HDFS has a POSIX-like permission model, using R,W,X and owner, group, other for access control. It is good most of the time, except for: 1. Data need to be shared among users group can be used for access control, and the users has to be in the same GROUP as the data. the GROUP here st