Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-22 Thread varunsax...@apache.org
; > Sent: Monday, March 20, 2017 10:31 AM > > To: Junping Du > > Cc: common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org; > > yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org > > Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3) > > > > Ye

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-22 Thread Naganarasimha Garla
, John Zhuge > > >> wrote: > > >>> > > >>>> Yes, it only affects ADL. There is a workaround of adding these 2 > > >>>> properties to core-site.xml: > > >>>> > > >>>> > > >>>> fs.

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-22 Thread Rakesh Radhakrishnan
>> please keep on verification work and report any issues if founded - I > >> will > >>> check if another round of RC is needed based on your findings. Thanks! > >>> > >>> > >>> Thanks, > >>> > >>> > >>> Ju

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-22 Thread larry mccay
rectoryOfExistingFile:254 > > > » AccessControl > > > > > > TestAdlFileSystemContractLive.runTest:60->FileSystemContractBaseTest. > > > testMkdirsFailsForSubdirectoryOfExistingFile:190 > > > » AccessControl > > > > > > > > >

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-22 Thread Ravi Prakash
n your findings. Thanks! > > > Thanks, > > > Junping > > > > From: Kuhu Shukla > Sent: Tuesday, March 21, 2017 3:17 PM > Cc: Junping Du; common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org; > yarn-...@hadoop.apache.org; mapreduce-...@hado

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Junping Du
org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3) +1 (non-binding) - Verified signatures. - Downloaded and built from source tar.gz. - Deployed a pseudo-distributed cluster on Mac Sierra. - Ran example Sleep job successfully. - Deployed latest

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Kuhu Shukla
, I think we can leave the fix to 2.8.1 to fix given this is > not a > > regression and just a new feature get broken.​ > > > > > > Thanks, > > > > > > Junping > > -- > > *From:* John Zhuge > > *Sent:* Monday, March 20, 20

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Eric Badger
ken.​ > > > > > > Thanks, > > > > > > Junping > > -- > > *From:* John Zhuge > > *Sent:* Monday, March 20, 2017 9:07 AM > > *To:* Junping Du > > *Cc:* common-...@hadoop.apache.org; hdfs-dev@hadoop.apache

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Allen Wittenauer
> On Mar 21, 2017, at 10:12 AM, Andrew Wang wrote: > > I poked around a bit. The 3.0.0-alpha2 binary tarball is only 246M and has > more changes than 2.8.0. Not to disclaim any other potential issues, but it's worth noting 3.x de-dupes jar files as part of the packaging process. So it's not

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Zhihai Xu
in releasing 2.8.1. :) > >> > >> > >> Thanks, > >> > >> > >> Junping > >> > >> > >> From: John Zhuge > >> Sent: Monday, March 20, 2017 10:31 AM &

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread John Zhuge
ression and just a new feature get broken.​ > > > > > > Thanks, > > > > > > Junping > > -- > > *From:* John Zhuge > > *Sent:* Monday, March 20, 2017 9:07 AM > > *To:* Junping Du > > *Cc:* common-...@hadoop

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Steve Loughran
s in releasing 2.8.1. :) >> >> >> Thanks, >> >> >> Junping >> >> >> From: John Zhuge >> Sent: Monday, March 20, 2017 10:31 AM >> To: Junping Du >> Cc: common-...@hadoop.apache.org; hd

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Andrew Wang
I poked around a bit. The 3.0.0-alpha2 binary tarball is only 246M and has more changes than 2.8.0. It looks like the 2.8.0 bin tarball has an extra 1.5GB of docs when extracted compared to 3.0.0-alpha2. I think it's from the extra src-html content: -> % find share/doc -name src-html | xargs du -

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Wei-Chiu Chuang
Thanks Junping for taking on this huge effort! I found one tiny nit: the md5 files are not in conventional format That is to say, $ cat hadoop-2.8.0.tar.gz.md5 $ /usr/bin/md5sum /build/source/target/artifacts/hadoop-2.8.0.tar.gz c728a090b68d009070085367695ed507 /build/source/target/artifacts/

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Akira Ajisaka
Thanks Junping! +1 (binding) * Verified signatures and checksums * Built Hive 2.1.0 and Tez 0.8.5 with Hadoop 2.8.0 pom * Deployed a single node cluster and ran some Hive on Tez queries successfully * The document looks good. I found a trivial issue in the doc. It does not block the release.

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Masatake Iwasaki
Thanks for putting this up, Junping. +1(non-binding) * verified signature and mds. * built from source on centos 7 and openjdk 8 with native profile. * built docs and skimmed the contents. * deployed 3 nodes ha cluster and run some sample jobs with caller context enabled. Masatake Iwasaki On

RE: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread surendra lilhore
Hi, I have used release package and verified basic operations for HDFS. I raised one blocker issue for this release. HADOOP-14207 : "dfsadmin -refreshCallQueue" command is failing with DecayRpcScheduler Thanks, Surendra -Original Message- From: Ju

RE: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread Brahma Reddy Battula
Hi Junping, Thank you for working on this. +1 (Non-Binding) verified the following: 1. Deployed HA cluster with three Nodes. 2. Verified the basic shell operations 3. Ran wordount and pi jobs Regards Brahma Reddy Battula -Original Message- From: Junping Du [mailto:j...@hortonworks.com]

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-20 Thread Junping Du
: Monday, March 20, 2017 10:31 AM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3) Yes, it only affects ADL. There is a workaround of adding these 2

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-20 Thread Wangda Tan
> Thanks, > > > Junping > > > From: John Zhuge > Sent: Monday, March 20, 2017 9:07 AM > To: Junping Du > Cc: common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org; > yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org > Subject: Re: [V

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-20 Thread John Zhuge
ing > -- > *From:* John Zhuge > *Sent:* Monday, March 20, 2017 9:07 AM > *To:* Junping Du > *Cc:* common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org; > yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org > *Subject:* Re: [VOTE] Release

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-20 Thread Junping Du
From: John Zhuge Sent: Monday, March 20, 2017 9:07 AM To: Junping Du Cc: common-...@hadoop.apache.org; hdfs-dev@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3) Discovered https

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-20 Thread John Zhuge
Discovered https://issues.apache.org/jira/browse/HADOOP-14205 "No FileSystem for scheme: adl". The issue were caused by backporting HADOOP-13037 to branch-2 and earlier. HADOOP-12666 should not be backported, but some changes are needed: property fs.adl.impl in core-default.xml and hadoop-tools-di

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-20 Thread Marton Elek
+1 (non-binding) Tested from the released binary package * 5 node cluster running from dockerized containers (every namenode/datanode/nodemanager, etc. are running in separated containers) * Bitcoin bockchain data (~100Gb) parsed and imported to HBase (1.2.4) * Spark (2.1.0 with included hadoop)

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-19 Thread Steve Loughran
On 19 Mar 2017, at 15:23, Steve Loughran mailto:ste...@hortonworks.com>> wrote: Thanks, testing in progress here's the windows native binaries to go with it, all signed https://github.com/steveloughran/winutils/releases/tag/hadoop-2.8.0-RC3 The gnu shell commands which came with git worked w

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-19 Thread Steve Loughran
Thanks, testing in progress here's the windows native binaries to go with it, all signed https://github.com/steveloughran/winutils/releases/tag/hadoop-2.8.0-RC3 The gnu shell commands which came with git worked well here, and the build went through fast, nice to see Test results to follow O

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-17 Thread Jason Lowe
+1 (binding) - Verfied signatures and digests- Performed a native build from the release tag- Deployed to a single node cluster- Ran some sample jobs Jason On Friday, March 17, 2017 4:18 AM, Junping Du wrote: Hi all,     With fix of HDFS-11431 get in, I've created a new release candida

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-17 Thread Mingliang Liu
Thanks Junping for doing this. +1 (non-binding) 0. Download the src tar.gz file; checked the MD5 checksum 1. Build Hadoop from source successfully 2. Deploy a single node cluster and start the cluster successfully 3. Operate the HDFS from command line: ls, put, distcp, dfsadmin etc 4. Run hadoop

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-17 Thread Daniel Templeton
Thanks for the new RC, Junping. I built from source and tried it out on a 2-node cluster with HA enabled. I ran a pi job and some streaming jobs. I tested that localization and failover work correctly, and I played a little with the YARN and HDFS web UIs. I did encounter an old friend of mi

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-17 Thread Eric Payne
+1 Thanks, Junping, for your efforts to get this release out. I downloaded and built the source, and i did the following manual testing on a 2-node pseudo cluster: - Streaming job - Inter-queue (cross-queue) preemption--verified that only the expected amount of preemptions occured. - Inter-queue