Re: [VOTE] Merge yarn-native-services branch into trunk

2017-11-06 Thread Rohith Sharma K S
+1 (binding) thanks Jian for all the great work! Built from branch and deployed, able to bring up services along with atsv2 enabled and new YARN UI integration. Tried flexing, start, stop operations using REST api's. - Rohith Sharma K S On 31 October 2017 at 01:36, Jian He wrote: > Hi All, > >

[jira] [Created] (HDFS-12782) After Unset the EC policy for a directory, Still inside the directory files having the EC Policy

2017-11-06 Thread Harshakiran Reddy (JIRA)
Harshakiran Reddy created HDFS-12782: Summary: After Unset the EC policy for a directory, Still inside the directory files having the EC Policy Key: HDFS-12782 URL: https://issues.apache.org/jira/browse/HDFS-1

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-06 Thread Arun Suresh
Here is my +1 to start. - Setup a small 4 node cluster - Verified some basic HDFS commands - Ran Pi / sleep jobs (with some mix of Opportunistic containers - both distributed and centralized scheduling) Cheers -Arun On Fri, Nov 3, 2017 at 4:38 PM, Arun Suresh wrote: > Hey Vinod, > > I've clea

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-11-06 Thread Gour Saha
+1 (non-binding) -Gour On 10/30/17, 1:49 PM, "Jian He" wrote: >Few more things: > >This is the document for trying a non-docker service on YARN. >https://github.com/apache/hadoop/blob/yarn-native-services/hadoop-yarn-pro >ject/hadoop-yarn/hadoop-yarn-site/src/site/markdown/yarn-service/QuickSt

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-11-06 Thread Billie Rinaldi
+1 (binding) On Mon, Oct 30, 2017 at 1:06 PM, Jian He wrote: > Hi All, > > I would like to restart the vote for merging yarn-native-services to trunk. > Since last vote, we have been working on several issues in documentation, > DNS, CLI modifications etc. We believe now the feature is in a much

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-06 Thread Carlo Aldo Curino
+1 from me. I have: 1) setup a small cluster 2) enabled the reservation system 3) submitted reservation through REST 4) ran a job within reservation 5) did few negative tests (what happens if res system is disabled and you try to reserve, what happens if a job is submitted with invalid res id, etc

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2017-11-06 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/32/ [Nov 6, 2017 7:40:41 AM] (naganarasimha_gr) MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph. [Error replacing 'FILE' - Workspace is not accessible] --

[jira] [Created] (HDFS-12783) [branch-2] "dfsrouter" should use hdfsScript

2017-11-06 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-12783: --- Summary: [branch-2] "dfsrouter" should use hdfsScript Key: HDFS-12783 URL: https://issues.apache.org/jira/browse/HDFS-12783 Project: Hadoop HDFS

[jira] [Created] (HDFS-12784) Webhdfs retry policy for unresolved hosts

2017-11-06 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-12784: - Summary: Webhdfs retry policy for unresolved hosts Key: HDFS-12784 URL: https://issues.apache.org/jira/browse/HDFS-12784 Project: Hadoop HDFS Issue Type: B

Re: [DISCUSS] A final minor release off branch-2?

2017-11-06 Thread Andrew Wang
What are the known gaps that need bridging between 2.x and 3.x? >From an HDFS perspective, we've tested wire compat, rolling upgrade, and rollback. >From a YARN perspective, we've tested wire compat and rolling upgrade. Arun just mentioned an NM rollback issue that I'm not familiar with. Anythin

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-11-06 Thread Vinod Kumar Vavilapalli
Congratulations to all the contributors involved, this is a great step forward! +Vinod > On Nov 6, 2017, at 2:40 PM, Jian He wrote: > > Okay, I just merged the branch to trunk (108 commits in total !) > Again, thanks for all who contributed to this feature! > > Jian > > On Nov 6, 2017, at 1:2

[jira] [Created] (HDFS-12785) Ozone: Add timeunit for ozone.scm.heartbeat.interval.seconds in ozone-default.xml

2017-11-06 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12785: - Summary: Ozone: Add timeunit for ozone.scm.heartbeat.interval.seconds in ozone-default.xml Key: HDFS-12785 URL: https://issues.apache.org/jira/browse/HDFS-12785 Project: Ha

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-11-06 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/582/ [Nov 6, 2017 7:28:38 AM] (naganarasimha_gr) MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph. -1 overall The following subsystems voted -1: asflicense unit The following subsy

Re: [DISCUSS] A final minor release off branch-2?

2017-11-06 Thread Vinod Kumar Vavilapalli
The main goal of the bridging release is to ease transition on stuff that is guaranteed to be broken. Of the top of my head, one of the biggest areas is application compatibility. When folks move from 2.x to 3.x, are their apps binary compatible? Source compatible? Or need changes? In 1.x -> 2

RE: [DISCUSS] A final minor release off branch-2?

2017-11-06 Thread Zheng, Kai
Thanks Vinod. >> Of the top of my head, one of the biggest areas is application >> compatibility. When folks move from 2.x to 3.x, are their apps binary >> compatible? Source compatible? Or need changes? I thought these are good concerns from overall perspective. On the other hand, I've discuss

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-06 Thread Rohith Sharma K S
Thanks Subru/Arun for the great work! Downloaded source and built from it. Deployed RM HA non-secured cluster along with new YARN UI and ATSv2. I am facing basic RM HA switch issue after first time successful start. *Can anyone else is facing this issue?* When RM is switched from ACTIVE to STAND