[jira] [Created] (HDFS-14567) If kms-acls is failed to load, and it will never be reload

2019-06-13 Thread hemanthboyina (JIRA)
hemanthboyina created HDFS-14567: Summary: If kms-acls is failed to load, and it will never be reload Key: HDFS-14567 URL: https://issues.apache.org/jira/browse/HDFS-14567 Project: Hadoop HDFS

[jira] [Created] (HDFS-14566) Quota improvment in HDFS

2019-06-13 Thread Jinglun (JIRA)
Jinglun created HDFS-14566: -- Summary: Quota improvment in HDFS Key: HDFS-14566 URL: https://issues.apache.org/jira/browse/HDFS-14566 Project: Hadoop HDFS Issue Type: Improvement Affects Versions

[jira] [Reopened] (HDFS-14535) The default 8KB buffer in requestFileDescriptors#BufferedOutputStream is causing lots of heap allocation in HBase when using short-circut read

2019-06-13 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu reopened HDFS-14535: - Reopen this JIRA, because I think need to cherry-pick to branch-2.8, so that the further 2.8.6 will include

[jira] [Created] (HDDS-1686) Remove check to get from openKeyTable in acl implementation for Keys

2019-06-13 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDDS-1686: Summary: Remove check to get from openKeyTable in acl implementation for Keys Key: HDDS-1686 URL: https://issues.apache.org/jira/browse/HDDS-1686 Project: Had

Re: HDFS Scalability Limit?

2019-06-13 Thread Kihwal Lee
Hi Wei-Chiu, We have experience with 5,000 - 6,000 node clusters. Although it ran/runs fine, any heavy hitter activities such as decommissioning needed to be carefully planned. In terms of files and blocks, we have multiple clusters running stable with over 500M files and blocks. Some at over

[jira] [Created] (HDDS-1685) Add "start" support to containers and containers/{id} API in Recon

2019-06-13 Thread Vivek Ratnavel Subramanian (JIRA)
Vivek Ratnavel Subramanian created HDDS-1685: Summary: Add "start" support to containers and containers/{id} API in Recon Key: HDDS-1685 URL: https://issues.apache.org/jira/browse/HDDS-1685

[jira] [Created] (HDDS-1684) OM should create Ratis related dirs only if ratis is enabled

2019-06-13 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-1684: Summary: OM should create Ratis related dirs only if ratis is enabled Key: HDDS-1684 URL: https://issues.apache.org/jira/browse/HDDS-1684 Project: Hadoop Distributed

[jira] [Created] (HDDS-1683) Update Ratis to 0.4.0-300d9c5-SNAPSHOT

2019-06-13 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-1683: Summary: Update Ratis to 0.4.0-300d9c5-SNAPSHOT Key: HDDS-1683 URL: https://issues.apache.org/jira/browse/HDDS-1683 Project: Hadoop Distributed Data Store Is

HDFS Scalability Limit?

2019-06-13 Thread Wei-Chiu Chuang
Hi community, I am currently drafting a HDFS scalability guideline doc, and I'd like to understand any data points regarding HDFS scalability limit. I'd like to share it publicly eventually. As an example, through my workplace, and through community chatters, I am aware that HDFS is capable of op

Re: [DISCUSS] HDFS roadmap/wish list

2019-06-13 Thread Wei-Chiu Chuang
Thank you. I really appreciate your feedback as I don't always know the detailed use case for a feature. (For me, it's mostly "hey, this thing is broken, fix it") What are the rest of the community thinks? This is a great opportunity to share what you think. My answers inline: On Wed, Jun 12, 20

[jira] [Created] (HDDS-1682) TestEventWatcher.testMetrics is flaky

2019-06-13 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1682: -- Summary: TestEventWatcher.testMetrics is flaky Key: HDDS-1682 URL: https://issues.apache.org/jira/browse/HDDS-1682 Project: Hadoop Distributed Data Store Issue T

[jira] [Created] (HDDS-1681) TestNodeReportHandler failing because of NPE

2019-06-13 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDDS-1681: --- Summary: TestNodeReportHandler failing because of NPE Key: HDDS-1681 URL: https://issues.apache.org/jira/browse/HDDS-1681 Project: Hadoop Distributed Data Store

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-06-13 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/351/ No changes -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc check

[jira] [Created] (HDDS-1680) Create missing parent directories during the creation of HddsVolume dirs

2019-06-13 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1680: -- Summary: Create missing parent directories during the creation of HddsVolume dirs Key: HDDS-1680 URL: https://issues.apache.org/jira/browse/HDDS-1680 Project: Hadoop Dist

[jira] [Created] (HDDS-1679) TestBCSID failing because of dangling db references

2019-06-13 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDDS-1679: --- Summary: TestBCSID failing because of dangling db references Key: HDDS-1679 URL: https://issues.apache.org/jira/browse/HDDS-1679 Project: Hadoop Distributed Data

[jira] [Created] (HDDS-1678) Default image name for kubernetes examples should be ozone and not hadoop

2019-06-13 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1678: -- Summary: Default image name for kubernetes examples should be ozone and not hadoop Key: HDDS-1678 URL: https://issues.apache.org/jira/browse/HDDS-1678 Project: Hadoop Dis

[jira] [Created] (HDDS-1677) Auditparser robot test shold use a world writable working directory

2019-06-13 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1677: -- Summary: Auditparser robot test shold use a world writable working directory Key: HDDS-1677 URL: https://issues.apache.org/jira/browse/HDDS-1677 Project: Hadoop Distribut