Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

2017-08-02 Thread Akira Ajisaka
Thanks Konstantin for the work! I have a question: Where are the maven artifacts deployed? -Akira On 2017/07/30 8:29, Konstantin Shvachko wrote: Hi everybody, Here is the next release of Apache Hadoop 2.7 line. The previous stable release 2.7.3 was available since 25 August, 2016. Release 2.7.

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

2017-08-02 Thread Mingliang Liu
Thanks Konstantin! +1 (non-binding) I have tried several steps including: - Download source package and check the checksums - Build from source using Java 8 - Deploy a test cluster using docker containers w/ 5 DNs and 1 NN - Run basic HDFS client/admin operations (e.g. read/write files, dfsadmin)

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

2017-08-02 Thread Allen Wittenauer
For more details, see https://builds.apache.org/job/hadoop-trunk-win/146/ [Aug 2, 2017 4:25:19 PM] (yufei) YARN-6895. [FairScheduler] Preemption reservation may cause regular -1 overall The following subsystems voted -1: unit The following subsystems are considered long running: (runti

[jira] [Created] (HADOOP-14727) Socket not closed properly when reading Configurations with BlockReaderRemote

2017-08-02 Thread Xiao Chen (JIRA)
Xiao Chen created HADOOP-14727: -- Summary: Socket not closed properly when reading Configurations with BlockReaderRemote Key: HADOOP-14727 URL: https://issues.apache.org/jira/browse/HADOOP-14727 Project:

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

2017-08-02 Thread Eric Payne
+1 (binding) Tested the following: - Application History Server -- Apps can be observed from UI -- App and container metadata can be retrieved via REST APIs - RM UI -- Can kill an app from the RM UI - Apps run in different frameworks. Frameworks tested: MR and yarn shell -- In yarn shel

[jira] [Created] (HADOOP-14726) Remove FileStatus#isDir

2017-08-02 Thread Chris Douglas (JIRA)
Chris Douglas created HADOOP-14726: -- Summary: Remove FileStatus#isDir Key: HADOOP-14726 URL: https://issues.apache.org/jira/browse/HADOOP-14726 Project: Hadoop Common Issue Type: Task

[jira] [Resolved] (HADOOP-14725) hadoop-aws parallel tests do not work under Windows

2017-08-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14725. --- Resolution: Duplicate > hadoop-aws parallel tests do not work under Windows > --

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

2017-08-02 Thread Jason Lowe
Thanks for driving the 2.7.4 release! +1 (binding) - Verified signatures and digests- Successfully built from source including native- Deployed to a single-node cluster and ran sample MapReduce jobs Jason On Saturday, July 29, 2017 6:29 PM, Konstantin Shvachko wrote: Hi everybody, Her

[jira] [Created] (HADOOP-14725) hadoop-aws parallel tests do not work under Windows

2017-08-02 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-14725: - Summary: hadoop-aws parallel tests do not work under Windows Key: HADOOP-14725 URL: https://issues.apache.org/jira/browse/HADOOP-14725 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

2017-08-02 Thread Eric Badger
- Verified all checksums signatures - Built from src on macOS 10.12.6 with Java 1.8.0u65 - Deployed single node pseudo cluster - Successfully ran sleep and pi jobs - Navigated the various UIs +1 (non-binding) Thanks, Eric On Wednesday, August 2, 2017 12:31 PM, Chris Douglas wrote: On Wed

[jira] [Created] (HADOOP-14724) Get a daily QBT run for Windows

2017-08-02 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-14724: - Summary: Get a daily QBT run for Windows Key: HADOOP-14724 URL: https://issues.apache.org/jira/browse/HADOOP-14724 Project: Hadoop Common Issue Typ

Re: [DISCUSS]: re-enable listing of secrets in S3x URIs

2017-08-02 Thread Ravi Prakash
Thanks for starting the discussion Steve. This is a prickly issue and unfortunately we are hostages of past decisions. Thanks a lot for attacking the problem in the first place and sticking with it. In my experience we have found a lot of places that AWS secrets were logged for everyone to see. I

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

2017-08-02 Thread Chris Douglas
On Wed, Aug 2, 2017 at 12:02 AM, Zhe Zhang wrote: > Quick question for Chris: was your +1 for the RC, or to support > Konstantin's statement regarding packaging? For Konstantin's statement. I haven't had a chance to look through the RC yet, but it's on my list. -C > On Mon, Jul 31, 2017 at 3:56

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-08-02 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/ [Aug 1, 2017 4:56:33 PM] (jianhe) YARN-6872. Ensure apps could run given NodeLabels are disabled post RM [Aug 1, 2017 8:31:44 PM] (arp) HDFS-14676. Wrong default value for fs.df.interval. Contributed by [A

[DISCUSS]: re-enable listing of secrets in S3x URIs

2017-08-02 Thread Steve Loughran
HADOOP-3733 stripped out the user:password secret from the s3., s3a, s3n URLs for security grounds: everything logged Path entries without ever considering that they contained secret credentials. but that turns out to break things, as noted i

[jira] [Created] (HADOOP-14723) reinstate URI parameter in AWSCredentialProvider constructors

2017-08-02 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14723: --- Summary: reinstate URI parameter in AWSCredentialProvider constructors Key: HADOOP-14723 URL: https://issues.apache.org/jira/browse/HADOOP-14723 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

2017-08-02 Thread Zhe Zhang
Quick question for Chris: was your +1 for the RC, or to support Konstantin's statement regarding packaging? Thanks, On Mon, Jul 31, 2017 at 3:56 PM Chris Douglas wrote: > On Mon, Jul 31, 2017 at 3:02 PM, Konstantin Shvachko > wrote: > > For the packaging, here is the exact phrasing from the si

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

2017-08-02 Thread Zhe Zhang
+1 (binding) 1. Downloaded src tar ball, verified m5dsum 2. Built from source on Linux RHEL6, Java 1_8_0_40 3. Tried some HDFS CLI methods with the above build, against two clusters, one running 2.6.1 and another running 2.7.4 (server bin/conf built by an internal Jenkins job, as Ye Zhou mentioned