[jira] [Created] (HDFS-12581) ViewFileSystem#getAllStoragePolicies aggregates storage policies across NN using policyid

2017-10-02 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12581: Summary: ViewFileSystem#getAllStoragePolicies aggregates storage policies across NN using policyid Key: HDFS-12581 URL: https://issues.apache.org/jira/browse/HDFS-12581

[jira] [Created] (HDFS-12580) Rebasing HDFS-10467 after HDFS-12447

2017-10-02 Thread JIRA
Íñigo Goiri created HDFS-12580: -- Summary: Rebasing HDFS-10467 after HDFS-12447 Key: HDFS-12580 URL: https://issues.apache.org/jira/browse/HDFS-12580 Project: Hadoop HDFS Issue Type: Sub-task

Re: [VOTE] Merge Router-Based Federation (HDFS-10467) branch into trunk/branch-3

2017-10-02 Thread Chris Douglas
+1 (binding) Inigo has done an excellent job driving this work, both hardening it in production and merging it into Apache. The implementation, documentation, and tooling are mature enough to ship with the 3.0.0 GA release. -C On Mon, Oct 2, 2017 at 3:39 PM, Subru Krishnan wrote: > Thanks Inig

[jira] [Created] (HDFS-12579) JournalNodeSyncer should use fromUrl field of EditLogManifestResponse to construct servlet Url

2017-10-02 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDFS-12579: - Summary: JournalNodeSyncer should use fromUrl field of EditLogManifestResponse to construct servlet Url Key: HDFS-12579 URL: https://issues.apache.org/jira/browse/HDFS-12579

Re: [VOTE] Merge Router-Based Federation (HDFS-10467) branch into trunk/branch-3

2017-10-02 Thread Subru Krishnan
Thanks Inigo for driving this. +1 (binding). I have been involved during the design and have reviewed a couple of patches. I feel this is a good addition and is well aligned with YARN Federation (YARN-2915). We deployed the HDFS Router in our test cluster and mapped it against 2 clusters - one r

[jira] [Created] (HDFS-12578) TestDeadDatanode#testNonDFSUsedONDeadNodeReReg failing in branch-2.7

2017-10-02 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-12578: Summary: TestDeadDatanode#testNonDFSUsedONDeadNodeReReg failing in branch-2.7 Key: HDFS-12578 URL: https://issues.apache.org/jira/browse/HDFS-12578 Project: Hadoop HDFS

Re: [VOTE] Merge feature branch YARN-5734 (API based scheduler configuration) to trunk, branch-3.0, branch-2

2017-10-02 Thread Wangda Tan
+1 (Binding), huge thanks to all the other folks spent time to design, development, test and review this feature. In addition to what Jonathan mentioned, all exposed APIs / CLIs are marked as unstable so there should not have backward-compatibility issues. Participated initial design and review a

[jira] [Created] (HDFS-12577) Rename Router tooling

2017-10-02 Thread JIRA
Íñigo Goiri created HDFS-12577: -- Summary: Rename Router tooling Key: HDFS-12577 URL: https://issues.apache.org/jira/browse/HDFS-12577 Project: Hadoop HDFS Issue Type: Sub-task Report

[jira] [Created] (HDFS-12576) JournalNodes are getting started, even hough dfs.namenode.shared.edits.dir is not configured

2017-10-02 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-12576: - Summary: JournalNodes are getting started, even hough dfs.namenode.shared.edits.dir is not configured Key: HDFS-12576 URL: https://issues.apache.org/jira/browse/HDFS-125

[jira] [Created] (HDFS-12575) Improve test coverage for EC related edit logs ops

2017-10-02 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-12575: Summary: Improve test coverage for EC related edit logs ops Key: HDFS-12575 URL: https://issues.apache.org/jira/browse/HDFS-12575 Project: Hadoop HDFS Issue

Re: [VOTE] Merge feature branch YARN-5734 (API based scheduler configuration) to trunk, branch-3.0, branch-2

2017-10-02 Thread Zhe Zhang
+1 (binding) LinkedIn has been running an internal version of OrgQueue for almost 2 years. It is an essential feature for running YARN scheduler on clusters shared by multiple internal organizations. I have participated in the YARN-5734 design and have regularly synced with Jonathan on developmen

[VOTE] Merge feature branch YARN-5734 (API based scheduler configuration) to trunk, branch-3.0, branch-2

2017-10-02 Thread Jonathan Hung
Hi all, >From discussion at [1], I'd like to start a vote to merge feature branch YARN-5734 to trunk, branch-3.0, and branch-2. Vote will be 7 days, ending Monday Oct 9 at 11:00AM PDT. This branch adds a framework to the scheduler to allow scheduler configuration mutation on the fly, including a

[jira] [Created] (HDFS-12574) Add CryptoStream to WebHdfsFileSystem

2017-10-02 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-12574: - Summary: Add CryptoStream to WebHdfsFileSystem Key: HDFS-12574 URL: https://issues.apache.org/jira/browse/HDFS-12574 Project: Hadoop HDFS Issue Type: Sub-t

Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0

2017-10-02 Thread Eric Payne
+1 (binding) Thanks Andrew for all of your very diligent efforts. Build from source, installed on a 6-node pseudo cluster, and successfully tested the following manual use cases: o MapReduce sleep job o MapReduce streaming jobœ o Cross-queue (inter-queue) preemption o In-queue (intra-queue) preem

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-10-02 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/545/ No changes -1 overall The following subsystems voted -1: unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shell