[jira] [Created] (HDFS-14274) EC: "hdfs dfs -ls -e" throws NPE When EC Policy of Directory set as "-replicate"

2019-02-12 Thread Souryakanta Dwivedy (JIRA)
Souryakanta Dwivedy created HDFS-14274: -- Summary: EC: "hdfs dfs -ls -e" throws NPE When EC Policy of Directory set as "-replicate" Key: HDFS-14274 URL: https://issues.apache.org/jira/browse/HDFS-14274

[jira] [Created] (HDFS-14273) Fix checkstyle issues in BlockLocation's method javadoc

2019-02-12 Thread Shweta (JIRA)
Shweta created HDFS-14273: - Summary: Fix checkstyle issues in BlockLocation's method javadoc Key: HDFS-14273 URL: https://issues.apache.org/jira/browse/HDFS-14273 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-14269) [SBN read] Observer node switches back to Standby after restart

2019-02-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14269. Resolution: Won't Fix > [SBN read] Observer node switches back to Standby after restart > -

[jira] [Created] (HDFS-14272) [SBN read] HDFS command line tools does not guarantee consistency

2019-02-12 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-14272: -- Summary: [SBN read] HDFS command line tools does not guarantee consistency Key: HDFS-14272 URL: https://issues.apache.org/jira/browse/HDFS-14272 Project: Hadoop H

[jira] [Created] (HDFS-14271) [SBN read] StandbyException is logged if Observer is the first NameNode

2019-02-12 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-14271: -- Summary: [SBN read] StandbyException is logged if Observer is the first NameNode Key: HDFS-14271 URL: https://issues.apache.org/jira/browse/HDFS-14271 Project: Ha

[jira] [Created] (HDFS-14270) StateId and TrasactionId not present in Trace level logging

2019-02-12 Thread Shweta (JIRA)
Shweta created HDFS-14270: - Summary: StateId and TrasactionId not present in Trace level logging Key: HDFS-14270 URL: https://issues.apache.org/jira/browse/HDFS-14270 Project: Hadoop HDFS Issue Type

Re: DFSClient/DistriburedFileSystem fault injection?

2019-02-12 Thread Stephen Loughran
Sergey -you trying to simulate failures client side, or do you have an NN Which actually injects failures all the way up the IPC stack? as if its just client, couldn't registering a fault-injecting client as fs.hdfs.impl could do that FWIW, in the s3a connector we have the "inconsistent" s3 clien

[jira] [Created] (HDFS-14269) [SBN read] Observer node switches back to Standby after restart

2019-02-12 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-14269: -- Summary: [SBN read] Observer node switches back to Standby after restart Key: HDFS-14269 URL: https://issues.apache.org/jira/browse/HDFS-14269 Project: Hadoop HDF

[jira] [Resolved] (HDDS-1063) Implement OM init in secure cluster

2019-02-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-1063. -- Resolution: Duplicate > Implement OM init in secure cluster > --- > >

[jira] [Resolved] (HDDS-581) Bootstrap DN with private/public key pair

2019-02-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-581. - Resolution: Duplicate > Bootstrap DN with private/public key pair > ---

Re: DFSClient/DistriburedFileSystem fault injection?

2019-02-12 Thread Wei-Chiu Chuang
For what is worth, At Cloudera we have an internal fault injection tool that is based on Chaos Monkey. We use it to kill disks or kill nodes, for example. So it doesn't instrument HDFS directly. On Mon, Feb 11, 2019 at 3:42 PM Sergey Shelukhin wrote: > Hi. > I've been looking for a client-side s

RE: DFSClient/DistriburedFileSystem fault injection?

2019-02-12 Thread Sergey Shelukhin
Adding the user list :) -Original Message- From: Sergey Shelukhin Sent: Monday, February 11, 2019 3:42 PM To: hdfs-dev@hadoop.apache.org Subject: DFSClient/DistriburedFileSystem fault injection? Hi. I've been looking for a client-side solution for fault injection in HDFS. We had a natura

[jira] [Created] (HDFS-14268) RBF: Fix the location of the DNs in getDatanodeReport()

2019-02-12 Thread JIRA
Íñigo Goiri created HDFS-14268: -- Summary: RBF: Fix the location of the DNs in getDatanodeReport() Key: HDFS-14268 URL: https://issues.apache.org/jira/browse/HDFS-14268 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-14267) Add test_libhdfs_ops to libhdfs tests, mark libhdfs_read/write.c as examples

2019-02-12 Thread Sahil Takiar (JIRA)
Sahil Takiar created HDFS-14267: --- Summary: Add test_libhdfs_ops to libhdfs tests, mark libhdfs_read/write.c as examples Key: HDFS-14267 URL: https://issues.apache.org/jira/browse/HDFS-14267 Project: Had

[jira] [Created] (HDDS-1094) Performance testing infrastructure : Special handling for zero-filled chunks on the Datanode

2019-02-12 Thread Supratim Deka (JIRA)
Supratim Deka created HDDS-1094: --- Summary: Performance testing infrastructure : Special handling for zero-filled chunks on the Datanode Key: HDDS-1094 URL: https://issues.apache.org/jira/browse/HDDS-1094

[jira] [Resolved] (HDDS-1003) Intermittent IO exceptions encountered during pre-commit tests

2019-02-12 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh resolved HDDS-1003. - Resolution: Duplicate > Intermittent IO exceptions encountered during pre-commit tests > -

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-02-12 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1045/ [Feb 11, 2019 3:17:08 AM] (bharat) HDDS-1078. TestRatisPipelineProvider failing because of node count [Feb 11, 2019 3:34:53 AM] (bharat) HDDS-1077. TestSecureOzoneCluster does not config OM HTTP keytab. [

[jira] [Created] (HDDS-1093) Configuration tab in OM ui is not displaying the correct values

2019-02-12 Thread Sandeep Nemuri (JIRA)
Sandeep Nemuri created HDDS-1093: Summary: Configuration tab in OM ui is not displaying the correct values Key: HDDS-1093 URL: https://issues.apache.org/jira/browse/HDDS-1093 Project: Hadoop Distribut

[jira] [Created] (HDDS-1092) Use Java 11 JRE to run Ozone in containers

2019-02-12 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1092: -- Summary: Use Java 11 JRE to run Ozone in containers Key: HDDS-1092 URL: https://issues.apache.org/jira/browse/HDDS-1092 Project: Hadoop Distributed Data Store Is

[jira] [Created] (HDDS-1091) Provide centos based apache/hadoop-runner base image for ozone.

2019-02-12 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1091: -- Summary: Provide centos based apache/hadoop-runner base image for ozone. Key: HDDS-1091 URL: https://issues.apache.org/jira/browse/HDDS-1091 Project: Hadoop Distributed D

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-02-12 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/230/ No changes -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc check

[jira] [Created] (HDDS-1090) Add a recipe to the ozone docs about using Spark, OzoneFS, and K8s

2019-02-12 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1090: -- Summary: Add a recipe to the ozone docs about using Spark, OzoneFS, and K8s Key: HDDS-1090 URL: https://issues.apache.org/jira/browse/HDDS-1090 Project: Hadoop Distribute

[jira] [Created] (HDDS-1089) Disable OzoneFSStorageStatistics for hadoop versions older than 2.8

2019-02-12 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1089: -- Summary: Disable OzoneFSStorageStatistics for hadoop versions older than 2.8 Key: HDDS-1089 URL: https://issues.apache.org/jira/browse/HDDS-1089 Project: Hadoop Distribut