Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-25 Thread Arun C Murthy
With 9 +1s including mine (6 binding) and no -1s, the vote passes. Thanks to all who voted. Arun On Aug 15, 2013, at 2:15 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would > like to get released - this fixes the bugs we saw since

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-22 Thread Steve Loughran
+1, binding Review process # symlink /usr/local/bin/protoc to the homebrew installed 2.5.0 version # delete all 2.1.0-beta artifacts in the mvn repo: find ~/.m2 -name 2.1.0-beta -print | xargs rm -rf # checkout hbase apache/branch-0.95 (commit # b58d596 ) # switch to ASF repo (arun's privat

RE: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-22 Thread Bikas Saha
] Release Apache Hadoop 2.1.0-beta +1 (binding) Verified checksums, built from source and ran basic MR jobs on a single-node cluster. -- Hitesh On Aug 15, 2013, at 2:15 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc2) for hadoop-2.1.0-beta that I wou

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-22 Thread Rob Parker
+1 non-binding Verified signatures and checksums one binary and source tar files Built the source Ran some tests on psuedo-distributed cluster. Rob On 08/15/2013 09:15 PM, Arun C Murthy wrote: Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get releas

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-22 Thread Colin McCabe
On Wed, Aug 21, 2013 at 3:49 PM, Stack wrote: > On Wed, Aug 21, 2013 at 1:25 PM, Colin McCabe wrote: > >> St.Ack wrote: >> >> > + Once I figured where the logs were, found that JAVA_HOME was not being >> > exported (don't need this in hadoop-2.0.5 for instance). Adding an >> > exported JAVA_HOME

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-21 Thread Hitesh Shah
+1 (binding) Verified checksums, built from source and ran basic MR jobs on a single-node cluster. -- Hitesh On Aug 15, 2013, at 2:15 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would > like to get released - this fixes the bugs

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-21 Thread Jason Lowe
+1 (binding) - verified signatures and checksums - built from source - ran some simple jobs on a single-node cluster On 08/15/2013 04:15 PM, Arun C Murthy wrote: Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get released - this fixes the bugs we saw

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-21 Thread Stack
On Wed, Aug 21, 2013 at 1:25 PM, Colin McCabe wrote: > St.Ack wrote: > > > + Once I figured where the logs were, found that JAVA_HOME was not being > > exported (don't need this in hadoop-2.0.5 for instance). Adding an > > exported JAVA_HOME to my running shell which don't seem right but it took

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-21 Thread Colin McCabe
St.Ack wrote: > + Once I figured where the logs were, found that JAVA_HOME was not being > exported (don't need this in hadoop-2.0.5 for instance). Adding an > exported JAVA_HOME to my running shell which don't seem right but it took > care of it (I gave up pretty quick on messing w/ > yarn.nodem

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-21 Thread Siddharth Seth
+1 (binding). Verified signature and checksums. Built from source and upgraded a 2.0.4 cluster. Ran a couple of simple MR and Tez jobs. - Sid On Thu, Aug 15, 2013 at 2:15 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would > like to

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-21 Thread Sandy Ryza
+1 (non-binding) Built from source, ran jobs on a pseudo-distributed cluster with the Fair Scheduler. -Sandy On Tue, Aug 20, 2013 at 7:27 PM, Arun C Murthy wrote: > Thanks for the heads up Aaron, I've changed fix-version of HDFS-4763 to > 2.1.1-beta for now. > > Committers - please be careful

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-20 Thread Arun C Murthy
Thanks for the heads up Aaron, I've changed fix-version of HDFS-4763 to 2.1.1-beta for now. Committers - please be careful setting fix-versions, this is a good anti-pattern to avoid… though, I'm willing to bet a lot of dough that this isn't the first Hadoop release with this issue… *smile* Aru

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-20 Thread Aaron T. Myers
I was evaluating the release bits when I noticed that the change done in HDFS-4763 to add support for starting the HDFS NFSv3 gateway, which is marked with a "fix version" of 2.1.0-beta and included in the release notes of RC2, is not in fact included in the RC2 release bits. It looks to me like th

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-20 Thread Stack
On Thu, Aug 15, 2013 at 2:15 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would > like to get released - this fixes the bugs we saw since the last go-around > (rc1). > > The RC is available at: > http://people.apache.org/~acmurthy/hadoo

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-19 Thread Roman Shaposhnik
On Mon, Aug 19, 2013 at 2:49 PM, Vinod Kumar Vavilapalli wrote: > > Thanks for the clarification Daryn. That is what I was asking before when I > said "From my limited understanding, this doesn't seem like a API or a > compatibility issue. Can we not fix it in subsequent bug-fix releases? " > > No

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-19 Thread Sandy Ryza
gt; > I've changed the target version of HADOOP-9880 to 2.1.1. Please change it > back, if you feel that it needs to be in 2.1.0-beta. > > > > Kihwal > > > > ____ > > From: Kihwal Lee > > To: Arun Murthy ; "common-dev@hadoop

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-19 Thread Vinod Kumar Vavilapalli
n. >>>> >>>> On Fri, Aug 16, 2013 at 3:04 PM, Kihwal Lee wrote: >>>>> I've changed the target version of HADOOP-9880 to 2.1.1. Please change >>>>> it back, if you feel that it needs to be in 2.1.0-beta. >>>>> >>>&g

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-19 Thread Daryn Sharp
t; back, if you feel that it needs to be in 2.1.0-beta. >>>> >>>> >>>> Kihwal >>>> >>>> >>>> ____________ >>>> From: Kihwal Lee >>>> To: Arun Murthy ; "common-dev@hadoop.apache.org"

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Arun C Murthy
t;> >>> >>> >>> From: Kihwal Lee >>> To: Arun Murthy ; "common-dev@hadoop.apache.org" >>> >>> Cc: "mapreduce-...@hadoop.apache.org" ; >>> "hdfs-...@hadoop.apache.org" ; >>>

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Vinod Kumar Vavilapalli
gt;> Cc: "mapreduce-...@hadoop.apache.org" ; >> "hdfs-...@hadoop.apache.org" ; >> "yarn-...@hadoop.apache.org" >> Sent: Friday, August 16, 2013 4:55 PM >> Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta >> >> >> It'

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Roman Shaposhnik
che.org" ; > "yarn-...@hadoop.apache.org" > Sent: Friday, August 16, 2013 4:55 PM > Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta > > > It's your call, Arun. I.e. as long you believe rc2 meets the expectations > and objectives of 2.1.0-beta. >

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
apache.org" ; "hdfs-...@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Friday, August 16, 2013 4:55 PM Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta It's your call, Arun.  I.e. as long you believe rc2 meets the expectations and objectives of 2.1.0-bet

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
..@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Friday, August 16, 2013 3:44 PM Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta That makes sense too. On Aug 16, 2013, at 10:39 AM, Vinod Kumar Vavilapalli wrote: > > We need to make a call on what block

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Arun Murthy
That makes sense too. On Aug 16, 2013, at 10:39 AM, Vinod Kumar Vavilapalli wrote: > > We need to make a call on what blockers will be. From my limited > understanding, this doesn't seem like a API or a compatibility issue. Can we > not fix it in subsequent bug-fix releases? > > I do see a lo

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Vinod Kumar Vavilapalli
We need to make a call on what blockers will be. From my limited understanding, this doesn't seem like a API or a compatibility issue. Can we not fix it in subsequent bug-fix releases? I do see a lot of follow up releases to 2.1.0. Getting this release out will help downstream projects start t

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Arun C Murthy
Ok, I'll spin RC3. Can you please help get this in asap? Thanks, much appreciated! Arun On Aug 16, 2013, at 10:13 AM, Kihwal Lee wrote: > We have found HADOOP-9880, which prevents Namenode HA from running with > security. > > > > Kihwal > > > > From: Arun

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
We have found HADOOP-9880, which prevents Namenode HA from running with security. Kihwal From: Arun C Murthy To: "common-dev@hadoop.apache.org" ; "hdfs-...@hadoop.apache.org" ; "mapreduce-...@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Thurs

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
We have found HADOOP-9880, which prevents Namenode HA from running with security. Kihwal From: Arun C Murthy To: "common-dev@hadoop.apache.org" ; "hdfs-...@hadoop.apache.org" ; "mapreduce-...@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Thursda

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-13 Thread Karthik Kambatla
> Kihwal > > > > From: Arun C Murthy > To: Daryn Sharp > Cc: "" ; " > mapreduce-...@hadoop.apache.org" ; " > yarn-...@hadoop.apache.org" ; " > common-dev@hadoop.apache.org" > Sent: Thursday, August 1, 2013 1

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-08 Thread Kihwal Lee
sday, August 1, 2013 1:30 PM Subject: Re: [VOTE] Release Apache Hadoop 2.1.0-beta Ok, thanks for heads up Daryn. I'll spin an RC2 once HADOOP-9816 gets in - I'd appreciate if you could help push the fix in ASAP. Thanks again! Arun On Aug 1, 2013, at 9:38 AM, Daryn Sharp wrote: &

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-06 Thread Arpit Agarwal
Hi Arun, Would it make sense to generate Windows binaries since this is the first 2.0 release with Windows support? I am happy to help out with that. FWIW I generated a Windows tarball from the source, brought up a pseudo-distributed cluster, ran some smoke tests and it is looking good! Thanks,

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-05 Thread Tsuyoshi OZAWA
+1 (non-binding) * verified md5 of the source code. * build the package from source code. * run basic hdfs commands. * run MapReduce example jobs(random text writer, wordcount, and pi) over YARN in single node. - Tsuyoshi On Tue, Jul 30, 2013 at 10:29 PM, Arun C Murthy wrote: > Folks, > > I've

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-02 Thread Steve Loughran
On 30 July 2013 14:29, Arun C Murthy wrote: > Folks, > > I've created another release candidate (rc1) for hadoop-2.1.0-beta that I > would like to get released. This RC fixes a number of issues reported on > the previous candidate. > > This release represents a *huge* amount of work done by the c

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-01 Thread Arun C Murthy
Ok, thanks for heads up Daryn. I'll spin an RC2 once HADOOP-9816 gets in - I'd appreciate if you could help push the fix in ASAP. Thanks again! Arun On Aug 1, 2013, at 9:38 AM, Daryn Sharp wrote: > I broke RPC QOP for integrity and privacy options. :( See blocker > HADOOP-9816. I think I u

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-01 Thread Roman Shaposhnik
On Wed, Jun 26, 2013 at 1:17 AM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.1.0-beta that I would > like to get released. > > This release represents a *huge* amount of work done by the community (639 > fixes) which > includes several major advances inc

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-01 Thread Daryn Sharp
I broke RPC QOP for integrity and privacy options. :( See blocker HADOOP-9816. I think I understand the problem and it shouldn't be hard to fix. The bug went unnoticed because sadly there are no unit tests for the QOP options, even though it just involves a conf setting. Daryn On Jul 29, 20

RE: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-31 Thread Bikas Saha
+1. Using it locally for Tez. Bikas -Original Message- From: Arun C Murthy [mailto:a...@hortonworks.com] Sent: Tuesday, July 30, 2013 6:30 AM To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: [VOTE] Release

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-30 Thread Roman Shaposhnik
On Mon, Jul 29, 2013 at 3:00 PM, Arun C Murthy wrote: > Ok, I think we are close to rc1 now - the last of blockers should be > committed later today… I'll try and spin RC1 tonight. Great news! I'm back from my vacation (man, those were good 3 weeks! ;-)) and I'll try to pull the RC into Bigtop a

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-30 Thread Alejandro Abdelnur
Thanks Arun, +1 * verified MD5 & signature of source tarball. * built from source tarball * run apache-rat:check on source * installed pseudo cluster (unsecure) * test httpfs * run pi example * run unmanaged AM application Minor NITs (in case we do a new RC): * remove 2.1.1.-beta section from a

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-29 Thread Arun C Murthy
Ok, I think we are close to rc1 now - the last of blockers should be committed later today… I'll try and spin RC1 tonight. thanks, Arun On Jul 21, 2013, at 12:43 AM, Devaraj Das wrote: > I have just raised https://issues.apache.org/jira/browse/HDFS-5016 .. This > bug can easily be reproduced b

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-21 Thread Devaraj Das
I have just raised https://issues.apache.org/jira/browse/HDFS-5016 .. This bug can easily be reproduced by some HBase tests. I'd like this to be considered before we make a beta release. Have spoken about this with some hdfs folks offline and I am told that it is being worked on. Thanks Devaraj

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-17 Thread Vinod Kumar Vavilapalli
On Jul 17, 2013, at 1:04 PM, Alejandro Abdelnur wrote: > * YARN-701 > > It should be addressed before a GA release. > > Still, as it is this breaks unmanaged AMs and to me > that would be a blocker for the beta. > > YARN-701 and the unmanaged AMs fix should be committed > in tandem. > > * YAR

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-17 Thread Alejandro Abdelnur
Vinod, Thanks for reviving this thread. The current blockers are: https://issues.apache.org/jira/issues/?jql=project%20in%20(hadoop%2C%20mapreduce%2C%20hdfs%2C%20yarn)%20and%20status%20in%20(open%2C%20'patch%20available')%20and%20priority%20%3D%20blocker%20and%20%22Target%20Version%2Fs%22%20%3D%

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-17 Thread Vinod Kumar Vavilapalli
Looks like this RC has gone stale and lots of bug fixes went into 2.1 and 2.1.0 branches and there are 4-5 outstanding blockers. And from what I see in CHANGES.txt files there seems to be a confusion about which branch to get in what. I'm blowing off the current 2.1.0 release branch so that we

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-03 Thread Jason Lowe
I committed MAPREDUCE-5358 to branch-2 but did not commit it to branch-2.1-beta since it wasn't a blocker and Arun was in the middle of cutting the release. Arun, if you feel it's appropriate to put this in branch-2.1-beta feel free to pull it in or let me know. Thanks! Jason On 07/03/2013

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-03 Thread Vinod Kumar Vavilapalli
We should get these in, looking at them now. Thanks, +Vinod On Jun 28, 2013, at 12:03 PM, Hitesh Shah wrote: > Hi Arun, > > From a YARN perspective, YARN-791 and YARN-727 are 2 jiras that may > potentially change the apis. They can implemented in a backward compat > fashion if committed aft

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-03 Thread Tsuyoshi OZAWA
Hi Arun, Some bug fixes about MapReduce should be included in next release. MAPREDUCE-5221 should be merged because it's a lost feature of MRv2 compared to MRv1. MAPREDUCE-5358 and MAPREDUCE-5335 are very trivial fixes, so it can be merged immediately. # I sent the previous email only to hdfs-dev

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-02 Thread Ramya Sunil
-1. Some of the cli and distcp system tests which use hftp:// and webhdfs:// are failing on secure cluster (HDFS-4841 and HDFS-4952/HDFS-4896). This is a regression and we need to make sure they work before we call a release. On Wed, Jun 26, 2013 at 1:17 AM, Arun C Murthy wrote: > Folks, > > I'

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-01 Thread Roman Shaposhnik
Hi Arun! On Fri, Jun 28, 2013 at 2:05 PM, Arun C Murthy wrote: > Thanks Hitesh & Roman, I'll roll RC1 once these are fixed. Here's the latest update. I've incorporated Collin's patch for HADOOP-9676 and re-ran the tests. A few subtests of TestCLI still fail, but quite a few pass and on top of th

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-28 Thread Arun C Murthy
Thanks Hitesh & Roman, I'll roll RC1 once these are fixed. Arun On Jun 28, 2013, at 12:25 PM, Roman Shaposhnik wrote: > I think it would very useful if somebody more familiar with HDFS > (Suresh?) could take a look at: > https://issues.apache.org/jira/browse/HDFS-4940 > > Suresh was very h

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-28 Thread Roman Shaposhnik
I think it would very useful if somebody more familiar with HDFS (Suresh?) could take a look at: https://issues.apache.org/jira/browse/HDFS-4940 Suresh was very helpful in unblocking the client side of things, but even after I followed his recommendations on the heap size, etc. The NN still O

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-28 Thread Sandy Ryza
For YARN-791, if we can come to consensus on the correct approach, I can try to have a patch ASAP. -Sandy On Fri, Jun 28, 2013 at 12:03 PM, Hitesh Shah wrote: > Hi Arun, > > From a YARN perspective, YARN-791 and YARN-727 are 2 jiras that may > potentially change the apis. They can implemented

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-28 Thread Hitesh Shah
Hi Arun, From a YARN perspective, YARN-791 and YARN-727 are 2 jiras that may potentially change the apis. They can implemented in a backward compat fashion if committed after 2.1.0. However, this will require adding of differently-named apis ( different urls in case of the webservices ) and ma

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-26 Thread Steve Loughran
On 26 June 2013 09:17, Arun C Murthy wrote: > Folks, > > > The RC tag in svn is here: > http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.1.0-beta-rc0 > > The maven artifacts are available via repository.apache.org. > > did all the poms go up? [INFO] --