Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-11 Thread Arun Murthy
+1 (binding) Arun On Fri, Apr 10, 2015 at 4:44 PM -0700, "Vinod Kumar Vavilapalli" mailto:vino...@apache.org>> wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: r

Re: Hadoop 3.x: what about shipping trunk as a 2.x release in 2015?

2015-03-09 Thread Arun Murthy
Colin, Do you have a list of incompatible changes other than the shell-script rewrite? If we do have others we'd have to fix them anyway for the current plan on hadoop-3.x right? So, I don't see the difference? Arun From: Colin P. McCabe Sent: Monday,

Re: Hadoop 3.x: what about shipping trunk as a 2.x release in 2015?

2015-03-09 Thread Arun Murthy
Steve, From: Steve Loughran Sent: Monday, March 09, 2015 2:15 PM To: mapreduce-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; common-dev@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: Hadoop 3.x: what about shipping trunk as a 2.x release in 2

Hadoop - Major releases

2015-03-09 Thread Arun Murthy
Over the last few days, we have had lots of discussions that have intertwined several major themes: # When/why do we make major Hadoop releases? # When/how do we move to major JDK versions? # To a lesser extent, we have debated another theme: what do we do about trunk? For now, let's park

Re: Looking to a Hadoop 3 release

2015-03-03 Thread Arun Murthy
Awesome, looks like we can just do this in a compatible manner - nothing else on the list seems like it warrants a (premature) major release. Thanks Vinod. Arun From: Vinod Kumar Vavilapalli Sent: Tuesday, March 03, 2015 2:30 PM To: common-dev@hadoop.ap

Re: Looking to a Hadoop 3 release

2015-03-02 Thread Arun Murthy
Andrew, Thanks for bringing up this discussion. I'm a little puzzled for I feel like we are rehashing the same discussion from last year - where we agreed on a different course of action w.r.t switch to JDK7. IAC, breaking compatibility for hadoop-3 is a pretty big cost - particularly for

Re: 2.7 status

2015-03-01 Thread Arun Murthy
Sounds good, thanks for the help Vinod! Arun From: Vinod Kumar Vavilapalli Sent: Sunday, March 01, 2015 11:43 AM To: Hadoop Common; Jason Lowe; Arun Murthy Subject: Re: 2.7 status Agreed. How about we roll an RC end of this week? As a Java 7+ release

Re: 2.7 status

2015-02-13 Thread Arun Murthy
My bad, been sorted distracted. I agree, we should just roll fwd a 2.7 ASAP with all the goodies. What sort of timing makes sense? 2 week hence? thanks, Arun From: Jason Lowe Sent: Friday, February 13, 2015 8:11 AM To: common-dev@hadoop.apache.org Subje

Thinking ahead to hadoop-2.7

2014-12-01 Thread Arun Murthy
Folks, With hadoop-2.6 out it's time to think ahead. As we've discussed in the past, 2.6 was the last release which supports JDK6. I'm thinking it's best to try get 2.7 out in a few weeks (maybe by the holidays) with just the switch to JDK7 (HADOOP-10530) and possibly support for JDK-1.8 (as a r

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-10 Thread Arun Murthy
Duh! $ chmod a+r * Please try now. Thanks! Arun On Mon, Nov 10, 2014 at 7:06 PM, Tsuyoshi OZAWA wrote: > Hi Arun, > > Could you confirm the link and permission to the files is correct? I > got a following error: > > > Forbidden > You don't have permission to access > /~acmurthy/hadoop-2.6.0-

Re: Thinking ahead to hadoop-2.6

2014-09-26 Thread Arun Murthy
as already indicated >> on >>>>> the dev mailing list. Hopefully HDFS-6581 gets ready sooner. Both of >>> these >>>>> features are being in development for sometime. >>>>> >>>>> On Tue, Sep 23, 2014 at 3:27 PM, Andrew Wang < >

Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Arun Murthy
Looks like most of the content is in and hadoop-2.6 is shaping up nicely. I'll create branch-2.6 by end of the week and we can go from there to stabilize it - hopefully in the next few weeks. Thoughts? thanks, Arun On Tue, Aug 12, 2014 at 1:34 PM, Arun C Murthy wrote: > Folks, > > With hadoo

Re: In hindsight... Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Arun Murthy
Sorry, coming to discussion late. We all agreed that 2.6 would the *last* release supporting JDK6 and hadoop-2.7 would drop support for JDK6. We could easily do 2.7 right after 2.6 (maybe with few critical bug-fixes) with the defining feature of 2.7 being *JDK7 only*. I've checked with HBase, Pig

Re: Apache Hadoop 2.5.0 published tarballs are missing some txt files

2014-08-20 Thread Arun Murthy
t 11:13 PM, Alejandro Abdelnur > wrote: > > > agree with Steve, lets do a 2.5.1 just with those txt files. > > > > > > On Tue, Aug 19, 2014 at 2:29 PM, Steve Loughran > > wrote: > > > > > On 19 August 2014 18:35, Arun Murthy wrote: > > >

Re: Apache Hadoop 2.5.0 published tarballs are missing some txt files

2014-08-19 Thread Arun Murthy
I suggest we do a 2.5.1 (with potentially other bug fixes) rather than fix existing tarballs. thanks, Arun On Mon, Aug 18, 2014 at 12:42 PM, Karthik Kambatla wrote: > Hi devs > > Tsuyoshi just brought it to my notice that the published tarballs don't > have LICENSE, NOTICE and README at the to

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-12 Thread Arun Murthy
We don't involve press@ typically... Arun > On Aug 12, 2014, at 4:22 PM, Karthik Kambatla wrote: > > Thanks Steve for pointing me to press@. I hadn't realized we need to > include them. Just sent an email. > > > On Tue, Aug 12, 2014 at 9:39 AM, Steve Loughran > wrote: > >> thanks for doing this

Re: Moving to JDK7, JDK8 and new major releases

2014-06-24 Thread Arun Murthy
Alejandro, On Tue, Jun 24, 2014 at 4:44 PM, Alejandro Abdelnur wrote: > After reading this thread and thinking a bit about it, I think it should be > OK such move up to JDK7 in Hadoop 2 for the following reasons: > > * Existing Hadoop 2 releases and related projects are running > on JDK7 in p

Re: [DISCUSS] Change by-laws on release votes: 5 days instead of 7

2014-06-23 Thread Arun Murthy
Thanks everyone. I'll start a vote tmrw if there are no objections. Arun On Mon, Jun 23, 2014 at 12:06 PM, Jitendra Pandey wrote: > +1, sounds good! > > > On Mon, Jun 23, 2014 at 12:02 PM, Andrew Wang > wrote: > > > +1 here as well, let's do a vote thread (for 7 days, maybe for the last > > t

Re: hadoop-2.4.1

2014-05-20 Thread Arun Murthy
Akira, Waiting for one more issue, stay tuned. thanks, Arun On Mon, May 19, 2014 at 11:40 PM, Akira AJISAKA wrote: > Hi Arun, > > I'd like to know when to release Hadoop 2.4.1. > It looks like all of the blockers have been resolved. > > Thanks, > Akira > > > (2014/04/24 5:59), Arun C Murthy w

Re-swizzle 2.3

2014-01-23 Thread Arun Murthy
Based on the discussion at common-dev@, we've decided to target 2.3 off the tip of branch-2 based on the 2 major HDFS features which are Heterogenous Storage (HDFS-2832) and HDFS Cache (HDFS-4949). I'll create a new branch-2.3 on (1/24) at 6pm PST. thanks, Arun -- CONFIDENTIALITY NOTICE NOTICE:

Re: Logistics for releasing 2.4

2014-01-22 Thread Arun Murthy
Sounds good, thanks. I'll ping you off-thread. Arun On Wed, Jan 22, 2014 at 6:01 PM, Andrew Wang wrote: > Hi Arun, thanks for the reply. I hope that I've come across as an earnest > and motivated contributor who wants to help make high-quality releases. > Volunteering myself as RM and pushing f

Re: Logistics for releasing 2.4

2014-01-22 Thread Arun Murthy
Thanks Vinod. I'll start the work to re-spin 2.3 by changing jira numbers, CHANGES.txt etc. now. Arun On Wed, Jan 22, 2014 at 5:59 PM, Vinod Kumar Vavilapalli wrote: > > On Jan 22, 2014, at 5:36 PM, Arun C Murthy wrote: > > Agree 2.3 is now very stale. > > So, as I understand, your motivatio

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Arun Murthy
That makes sense too. On Aug 16, 2013, at 10:39 AM, Vinod Kumar Vavilapalli wrote: > > We need to make a call on what blockers will be. From my limited > understanding, this doesn't seem like a API or a compatibility issue. Can we > not fix it in subsequent bug-fix releases? > > I do see a lo

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-10 Thread Arun Murthy
Ok, I'll spin rc1 after. Thanks. Sent from my iPhone On Apr 10, 2013, at 11:44 AM, Siddharth Seth wrote: > Arun, MAPREDUCE-5094 would be a useful jira to include in the 2.0.4-alpha > release. It's not an absolute blocker since the values can be controlled > explicitly by changing tests which us

Re: Branch for Hadoop on Windows

2012-06-21 Thread Arun Murthy
Sounds great, I'll create the branch for you. Thanks for the your efforts on this so far! On Thu, Jun 21, 2012 at 4:58 PM, Bikas Saha wrote: > Hi, > > branch-1-win was created to stage the work needed to make Hadoop run > natively on Windows. There has been great progress on it that all of us ca

Re: hadoop 23.0 contents

2012-01-11 Thread Arun Murthy
Eli, I'd check against the svn tag which corresponds to the release... I'm traveling right now, let get back in a bit. thanks, Arun Sent from my iPhone On Jan 10, 2012, at 9:55 PM, Eli Collins wrote: > Hey Arun, > > Was looking at the 23.0 release bits and noticed that the contents of > bran

Re: how to check which scheduler is currently running on hadoop

2011-12-01 Thread Arun Murthy
Depending on the version of Hadoop you are using, you can goto http://:50030/scheduler to check. This will work from hadoop-0.20.203 onwards. Arun Sent from my iPhone On Nov 30, 2011, at 5:38 PM, shivam tiwari wrote: > Hi, > > please tell me how I can check which scheduler is currently runnin

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Arun Murthy
On Nov 23, 2011, at 5:32 PM, Roman Shaposhnik wrote: > Hi Matt, > > quick question: any reason we are ignoring multifilewc from hadoop examples? > Roman - It isn't marked as a blocker nor is there a patch. Can you provide one? Arun > https://issues.apache.org/jira/browse/MAPREDUCE-3319 > > wo

Re: Hadoop + MPI

2011-11-23 Thread Arun Murthy
Awesome, thanks to both you guys! It's very exciting to see this progress! Arun Sent from my iPhone On Nov 23, 2011, at 5:14 PM, Ralph Castain wrote: > FWIW: I can commit the OMPI part of your patch for you. The CCLA is intended > to ensure that people realize the need to protect OMPI from "i

Re: 0.21 stable schedule?

2011-11-14 Thread Arun Murthy
Tim, It's highly unlikely you'll see a stable 0.21 at this point. You can ask for a backport to 0.20.2xx (pls open a jira, better yet, a patch :) ) or consider trying hadoop-0.23 which we just released. Fair warning: 0.23 is very much 'alpha' quality currently. thanks, Arun Sent from my iPhone

Re: how to pass a hdfs file to a c++ process

2011-08-23 Thread Arun Murthy
That is a normal use case. I'd encourage you to use Java MR (even pig/hive). If you really want to use your legacy app use streaming with a map cmd such as 'hadoop fs -cat | mylegacyexe' Arun Sent from my iPhone On Aug 23, 2011, at 8:00 AM, Zhixuan Zhu wrote: > I'll actually invoke one exec