HDFS Performance Improvement JIRAs: reviewers wanted

2019-06-21 Thread Wei-Chiu Chuang
I spent the past week going through most of the jiras with a patch attached in the past, and turned up some really good stuff to helps improve HDFS performance. The list of jiras are listed in the following spreadsheet. If you are interested in reviewing those jiras, please update the following sp

Re: [VOTE] Release Apache Hadoop Submarine 0.2.0 - RC0

2019-06-21 Thread Zhankun Tang
Hi folks, Thanks for helping to vote this submarine 0.2.0 release! With 4 binding votes, 9 non-binding votes and no veto, this voting process passed. I'm going to work on the next step. Thanks! Thanks, Zhankun On Fri, 21 Jun 2019 at 16:58, Rohith Sharma K S wrote: > +1(binding) > Verified ba

[jira] [Created] (HDDS-1723) Create new OzoneManagerLock class

2019-06-21 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDDS-1723: Summary: Create new OzoneManagerLock class Key: HDDS-1723 URL: https://issues.apache.org/jira/browse/HDDS-1723 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-1722) Add --init option in Ozone Recon to setup sqlite DB for creating its aggregate tables.

2019-06-21 Thread Aravindan Vijayan (JIRA)
Aravindan Vijayan created HDDS-1722: --- Summary: Add --init option in Ozone Recon to setup sqlite DB for creating its aggregate tables. Key: HDDS-1722 URL: https://issues.apache.org/jira/browse/HDDS-1722

[jira] [Created] (HDDS-1721) Client Metrics are not being pushed to the sink while running a hadoop command to write to Ozone.

2019-06-21 Thread Aravindan Vijayan (JIRA)
Aravindan Vijayan created HDDS-1721: --- Summary: Client Metrics are not being pushed to the sink while running a hadoop command to write to Ozone. Key: HDDS-1721 URL: https://issues.apache.org/jira/browse/HDDS-172

[jira] [Created] (HDDS-1720) Add ability to collect RocksDB logs for OM and SCM.

2019-06-21 Thread Aravindan Vijayan (JIRA)
Aravindan Vijayan created HDDS-1720: --- Summary: Add ability to collect RocksDB logs for OM and SCM. Key: HDDS-1720 URL: https://issues.apache.org/jira/browse/HDDS-1720 Project: Hadoop Distributed Dat

[jira] [Created] (HDDS-1719) Increase ratis log segment size to 1MB.

2019-06-21 Thread Aravindan Vijayan (JIRA)
Aravindan Vijayan created HDDS-1719: --- Summary: Increase ratis log segment size to 1MB. Key: HDDS-1719 URL: https://issues.apache.org/jira/browse/HDDS-1719 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-1718) Increase Ratis Leader election timeout default to 10 seconds.

2019-06-21 Thread Aravindan Vijayan (JIRA)
Aravindan Vijayan created HDDS-1718: --- Summary: Increase Ratis Leader election timeout default to 10 seconds. Key: HDDS-1718 URL: https://issues.apache.org/jira/browse/HDDS-1718 Project: Hadoop Distr

[jira] [Created] (HDFS-14597) warning: non-array allocated with C++ array allocation operator

2019-06-21 Thread Yuri (JIRA)
Yuri created HDFS-14597: --- Summary: warning: non-array allocated with C++ array allocation operator Key: HDFS-14597 URL: https://issues.apache.org/jira/browse/HDFS-14597 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-14596) error: invalid suffix on literal; C++11 requires a space between literal and identifier

2019-06-21 Thread Yuri (JIRA)
Yuri created HDFS-14596: --- Summary: error: invalid suffix on literal; C++11 requires a space between literal and identifier Key: HDFS-14596 URL: https://issues.apache.org/jira/browse/HDFS-14596 Project: Hadoop H

[jira] [Resolved] (HDDS-1690) ContainerController should provide a way to retrieve containers per volume

2019-06-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-1690. -- Resolution: Fixed Fix Version/s: 0.4.1 > ContainerController should provide a way

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-06-21 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1174/ [Jun 20, 2019 8:42:27 AM] (stevel) HADOOP-16379: S3AInputStream.unbuffer should merge input stream stats [Jun 20, 2019 8:56:40 AM] (stevel) HADOOP-15183. S3Guard store becomes inconsistent after partial f

[jira] [Created] (HDFS-14595) HDFS-11848 breaks API compatibility

2019-06-21 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-14595: -- Summary: HDFS-11848 breaks API compatibility Key: HDFS-14595 URL: https://issues.apache.org/jira/browse/HDFS-14595 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-14594) Replace all Http(s)URLConnection

2019-06-21 Thread Sebastien Barnoud (JIRA)
Sebastien Barnoud created HDFS-14594: Summary: Replace all Http(s)URLConnection Key: HDFS-14594 URL: https://issues.apache.org/jira/browse/HDFS-14594 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDDS-1717) MR Job fails with exception

2019-06-21 Thread Soumitra Sulav (JIRA)
Soumitra Sulav created HDDS-1717: Summary: MR Job fails with exception Key: HDDS-1717 URL: https://issues.apache.org/jira/browse/HDDS-1717 Project: Hadoop Distributed Data Store Issue Type: B

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-06-21 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/359/ No changes -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc check

[jira] [Created] (HDDS-1716) Smoketest results are generated with an internal user

2019-06-21 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1716: -- Summary: Smoketest results are generated with an internal user Key: HDDS-1716 URL: https://issues.apache.org/jira/browse/HDDS-1716 Project: Hadoop Distributed Data Store

[jira] [Resolved] (HDFS-14591) NameNode should move the replicas to the correct storages after the storage policy is changed.

2019-06-21 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun resolved HDFS-14591. Resolution: Fixed redundant with HDFS-10285, HDFS-7343 > NameNode should move the replicas to the correct

[jira] [Created] (HDDS-1715) Update the Intellij runner definitition of SCM to use the new class name

2019-06-21 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-1715: -- Summary: Update the Intellij runner definitition of SCM to use the new class name Key: HDDS-1715 URL: https://issues.apache.org/jira/browse/HDDS-1715 Project: Hadoop Dis

[jira] [Created] (HDFS-14593) RouterAdmin should be able to remove expired routers from Routers Information

2019-06-21 Thread Takanobu Asanuma (JIRA)
Takanobu Asanuma created HDFS-14593: --- Summary: RouterAdmin should be able to remove expired routers from Routers Information Key: HDFS-14593 URL: https://issues.apache.org/jira/browse/HDFS-14593 Pro

Re: [VOTE] Release Apache Hadoop Submarine 0.2.0 - RC0

2019-06-21 Thread Rohith Sharma K S
+1(binding) Verified basics installing a cluster. -rohith Sharma k S On Thu, 6 Jun 2019 at 18:53, Zhankun Tang wrote: > Hi folks, > > Thanks to all of you who have contributed in this submarine 0.2.0 release. > We now have a release candidate (RC0) for Apache Hadoop Submarine 0.2.0. > > > The A

[jira] [Created] (HDDS-1714) When restart om with Kerberos, NPException happened at addPersistedDelegationToken

2019-06-21 Thread luhuachao (JIRA)
luhuachao created HDDS-1714: --- Summary: When restart om with Kerberos, NPException happened at addPersistedDelegationToken Key: HDDS-1714 URL: https://issues.apache.org/jira/browse/HDDS-1714 Project: Hadoop

Re: [VOTE] Release Apache Hadoop Submarine 0.2.0 - RC0

2019-06-21 Thread Weiwei Yang
+1 (binding) Thanks Weiwei On Jun 21, 2019, 5:33 AM +0800, Wangda Tan , wrote: +1 Binding. Tested in local cluster and reviewed docs. Thanks! On Wed, Jun 19, 2019 at 3:20 AM Sunil Govindan wrote: +1 binding - tested in local cluster. - tried tony run time as well - doc seems fine now. - Suni