Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-20 Thread Vinod Kumar Vavilapalli
t; >>>> On Apr 17, 2015, at 2:27 AM, Colin P. McCabe wrote: >>>> >>>>> I would like to fix HDFS-8070, which just came to light. The impact >>>>> is that if this isn't fixed, 2.6 clients will be unable to do >>>>> short-circuit

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-20 Thread Vinod Kumar Vavilapalli
This is more than about bugs. In the past, incompatibilities are what bit us more than bugs. If we find such bad incompatibilities in 2.7.0 release, calling it "not-stable yet" (or "alpha" or whatever) leaves us with the ability to fix any incompatibilities in a final "public-ready" release. Th

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-20 Thread Karthik Kambatla
gt; I would like to fix HDFS-8070, which just came to light. The impact > >>>> is that if this isn't fixed, 2.6 clients will be unable to do > >>>> short-circuit reads against 2.7 datanodes. > >>>> > >>>> best, > >>>> Colin >

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-20 Thread Vinod Kumar Vavilapalli
;>> best, >>>> Colin >>>> >>>> On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula >>>> wrote: >>>>> Need Jcardar changes to support java 7 Byte code..I will work along with >>>>> Todd to get jcardar.. >>

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-20 Thread Vinod Kumar Vavilapalli
7 AM, Colin P. McCabe wrote: >>>> >>>>> I would like to fix HDFS-8070, which just came to light. The impact >>>>> is that if this isn't fixed, 2.6 clients will be unable to do >>>>> short-circuit reads against 2.7 datanodes. >>>>> >&g

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-20 Thread Vinod Kumar Vavilapalli
>> +Vinod >>>> >>>> On Apr 17, 2015, at 2:27 AM, Colin P. McCabe wrote: >>>> >>>>> I would like to fix HDFS-8070, which just came to light. The impact >>>>> is that if this isn't fixed, 2.6 clients will b

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-20 Thread Vinod Kumar Vavilapalli
this isn't fixed, 2.6 clients will be unable to do >>>> short-circuit reads against 2.7 datanodes. >>>> >>>> best, >>>> Colin >>>> >>>> On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula >>>> wrote: >

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-20 Thread Phil Su
>> On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula >>>> wrote: >>>>> Need Jcardar changes to support java 7 Byte code..I will work along with >>>>> Todd to get jcardar.. >>>>> >>>>> Thanks & Regards >>&

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-19 Thread Steve Loughran
7;t fixed, 2.6 clients will be unable to do >>>> short-circuit reads against 2.7 datanodes. >>>> >>>> best, >>>> Colin >>>> >>>> On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula >>>> wrote: >>>>> Need Jcardar c

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-17 Thread Colin P. McCabe
ed Jcardar changes to support java 7 Byte code..I will work along with >>>> Todd to get jcardar.. >>>> >>>> Thanks & Regards >>>> Brahma Reddy Battula >>>> >>>> From: Vinod Kumar Va

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-17 Thread Arpit Agarwal
la >>> ____________ >>> From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] >>> Sent: Wednesday, April 15, 2015 6:29 PM >>> To: common-dev@hadoop.apache.org >>> Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 >>>

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-17 Thread Tsuyoshi Ozawa
32 ].. >>>>> >>>>> Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first >>>>> release that compiled Java 7 class files. Jcarder needs to updated to >>>>> support Java 7 byte code.. >>>>> >

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-17 Thread Tsuyoshi Ozawa
>> Brahma Reddy Battula >>> ____________ >>> From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] >>> Sent: Wednesday, April 15, 2015 6:29 PM >>> To: common-dev@hadoop.apache.org >>> Subject: Re: [VOTE] Release Apa

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-17 Thread Vinod Kumar Vavilapalli
rdar.. >> >> Thanks & Regards >> Brahma Reddy Battula >> >> From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] >> Sent: Wednesday, April 15, 2015 6:29 PM >> To: common-dev@hadoop.apache.org >> Subj

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-16 Thread Colin P. McCabe
> From: Allen Wittenauer [a...@altiscale.com] >> Sent: Wednesday, April 15, 2015 12:45 AM >> To: common-dev@hadoop.apache.org >> Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; >> mapreduce-...@hadoop.apache.org >> Subject: Re: [VOTE] Release Apache Hadoo

RE: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Brahma Reddy Battula
-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula wrote: > H

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Karthik Kambatla
Thanks for putting this together, Vinod. Stood up a pseudo-dist cluster using the binary bits and ran a pi job. - The MR-AM got allocated, but never launched because the NM-RM didn't talk to each other. Filed YARN-3492. Was able to run jobs after restart. I believe we should at least investigate

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Kihwal Lee
+1 (binding)Built the source from the tag and ran basic test on pseudo distributed cluster. Kihwal From: Vinod Kumar Vavilapalli To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Sent: Frida

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Akira AJISAKA
Done. Thank you, Tsuyoshi. On 4/15/15 14:55, Tsuyoshi Ozawa wrote: Hey Akira, could you target the issues to 2.7.1? Thanks, - Tsuyoshi On Wed, Apr 15, 2015 at 2:51 PM, Akira AJISAKA wrote: +0 (non-binding) - Downloaded source - Built from source - Ran a pseudo-distributed cluster - Read doc

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Tsuyoshi Ozawa
Hey Akira, could you target the issues to 2.7.1? Thanks, - Tsuyoshi On Wed, Apr 15, 2015 at 2:51 PM, Akira AJISAKA wrote: > +0 (non-binding) > > - Downloaded source > - Built from source > - Ran a pseudo-distributed cluster > - Read documents downloaded from binary tarball > - Looked Web UIs > >

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Akira AJISAKA
+0 (non-binding) - Downloaded source - Built from source - Ran a pseudo-distributed cluster - Read documents downloaded from binary tarball - Looked Web UIs I found several issues to be fixed. - HDFS-8149: The footer of Web UI "Hadoop, 2014" is old I'm thinking this is a regression from Hadoop

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Chris Nauroth
+1 (binding) - Downloaded source tarball and verified signature and checksum. - Built from source, including native code on Linux and Windows. - Ran a 3-node unsecured cluster. - Tested various HDFS and YARN commands, including sample MapReduce jobs. - Confirmed that SecondaryNameNode can take a c

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Mit Desai
+1 (non-binding) - Downloaded and built the source. - Deployed to a local cluster and ran sample jobls like sleepJob and Wordcount. - Verified Signatures - Verified the RM UI for correctness. Thanks Vinod for taking the time and effort to drive this release. -Mit Desai

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Vinod Kumar Vavilapalli
Tx Pat. This is really interesting news! +Vinod On Apr 14, 2015, at 11:18 PM, Pat White wrote: > +1 non-binding > Ran a performance comparison of 2.6.0 Latest with 2.7.0 RC, looks good, no > regressions observed, most metrics are well within 5% tolerance (dfsio, > sort, amrestart, gmv3) and

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Vinod Kumar Vavilapalli
op.apache.org; > mapreduce-...@hadoop.apache.org > Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 > > Someone should look into HDFS-8132, which appears to have been filed against > RC0. > > On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli > wrote: > >>

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-15 Thread Eric Payne
+1 (non-binding) Thanks,Vinod, for the time and effort you put into creating this release. I downloaded and built the source for 2.7.0, RC0. I started a local cluster and ran wordcount, sleep, and streaming jobs. In addition, I did the following:     o I ran a distributed shell job which tested

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-14 Thread Xuan Gong
#x27; information correctly > >Thanks, >Zhijie > >From: Wangda Tan >Sent: Friday, April 10, 2015 5:25 PM >To: yarn-...@hadoop.apache.org >Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; >mapreduce-...@hadoop.apache.org; Vinod Kumar Vavilapalli >Subject: Re:

RE: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-14 Thread Brahma Reddy Battula
.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli wrote: > Hi all, > > I've created a release candidate RC0 for Apache Hadoop 2.7.0. >

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-14 Thread Jason Lowe
+1 (binding) - Verified signatures and digests- Built from source with native support- Deployed to a single-node cluster and ran sample jobs Jason From: Vinod Kumar Vavilapalli To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-14 Thread Pat White
+1 non-binding Ran a performance comparison of 2.6.0 Latest with 2.7.0 RC, looks good, no regressions observed, most metrics are well within 5%  tolerance (dfsio, sort, amrestart, gmv3) and some tests (scan, amscale, compression, shuffle) appear to have improvements. Disclaimer, please note a

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-14 Thread Allen Wittenauer
Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli wrote: > Hi all, > > I've created a release candidate RC0 for Apache Hadoop 2.7.0. > > The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-14 Thread Jing Zhao
+1 (binding) downloaded the source tar ball, built it, and ran some examples and distcp job. Thanks, -Jing On Tue, Apr 14, 2015 at 11:06 AM, Robert Kanter wrote: > +1 (non-binding) > > + verified checksum > + Deployed binary tarball, ran some examples, clicked around in the Web UIs > > thanks

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-14 Thread Robert Kanter
+1 (non-binding) + verified checksum + Deployed binary tarball, ran some examples, clicked around in the Web UIs thanks - Robert On Tue, Apr 14, 2015 at 10:22 AM, Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: > +1 (non-binding) > > + verified signature and mds of source and binary tarb

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-14 Thread Masatake Iwasaki
+1 (non-binding) + verified signature and mds of source and binary tarball + built from source tarball + deployed binary tarball to 3 nodes cluster and run some hadoop-mapreduce-examples jobs Thanks, Masatake Iwasaki On 4/11/15 08:44, Vinod Kumar Vavilapalli wrote: Hi all, I've created a re

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-13 Thread Tsuyoshi Ozawa
+1 (non-binding) - Verified checksums on source and binary tar ball. - Built from source and launched single cluster. - Checked to launch some jobs successfully. - Killing application via RM UI. Thanks, - Tsuyoshi On Mon, Apr 13, 2015 at 7:43 AM, Junping Du wrote: > +1. (Non-binding) > - Downlo

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-13 Thread Chen He
+1 non-binding build from source, deploy to a single node cluster, run wordcount, Terasort, etc. Also run Teragen using DockerContainerExecutor, works fine. Regards! Chen He On Mon, Apr 13, 2015 at 5:43 AM, Junping Du wrote: > +1. (Non-binding) > - Download and verify the checksum on src and

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-13 Thread Xiaoyu Yao
+1. (Non-binding) - Download hadoop-2.7.0-RC0-src.tar.gz and build locally. - Deploy a single node cluster and run some quota related hdfs/hadoop shell commands. - Run sample MR jobs. All basic tests result looks good to me. Thanks, Xiaoyu On 4/13/15, 5:43 AM, "Junping Du" wrote: >+1. (No

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-13 Thread Junping Du
+1. (Non-binding) - Download and verify the checksum on src and binary locally. - Deploy a single node cluster and play with simple MR jobs, i.e. PI, Terasort, etc. All looks fine for now. Thanks, Junping From: Vinod Kumar Vavilapalli Sent: Saturday, Apr

RE: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-13 Thread Rohith Sharma K S
+1(non-binding) Build from source, Deployed in 3 Node cluster Verified RM HA, RM Work preserving restart and NM restart features submitting simple MR Jobs And basic sanity testing is done. Thanks & Regards Rohith Sharma K S -Original Message- From: Vinod Kumar Vavilapalli [mailto:vino

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-11 Thread Arun Murthy
+1 (binding) Arun On Fri, Apr 10, 2015 at 4:44 PM -0700, "Vinod Kumar Vavilapalli" mailto:vino...@apache.org>> wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: r

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-11 Thread Zhijie Shen
ks, Zhijie From: Wangda Tan Sent: Friday, April 10, 2015 5:25 PM To: yarn-...@hadoop.apache.org Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; Vinod Kumar Vavilapalli Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 +1 (Non-bindi

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-10 Thread Wangda Tan
+1 (Non-binding) Built from src, deployed a single node cluster, and tried to run some MR jobs. On Fri, Apr 10, 2015 at 4:44 PM, Vinod Kumar Vavilapalli wrote: > Hi all, > > I've created a release candidate RC0 for Apache Hadoop 2.7.0. > > The RC is available at: > http://people.apache.org/~vi