[GitHub] [hadoop-ozone] swagle commented on issue #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call.

2019-10-17 Thread GitBox
swagle commented on issue #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call. URL: https://github.com/apache/hadoop-ozone/pull/50#issuecomment-543535624 > And also this is missing S3 end change to use the replication type and replication factor and

[GitHub] [hadoop-ozone] swagle commented on a change in pull request #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call.

2019-10-17 Thread GitBox
swagle commented on a change in pull request #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call. URL: https://github.com/apache/hadoop-ozone/pull/50#discussion_r336331809 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hado

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #27: HDDS-2278. Run S3 test suite on OM HA cluster.

2019-10-17 Thread GitBox
bharatviswa504 commented on issue #27: HDDS-2278. Run S3 test suite on OM HA cluster. URL: https://github.com/apache/hadoop-ozone/pull/27#issuecomment-543526537 @elek can we commit this or still some issues you are seeing? Th

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call.

2019-10-17 Thread GitBox
bharatviswa504 commented on a change in pull request #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call. URL: https://github.com/apache/hadoop-ozone/pull/50#discussion_r336328755 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apa

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #51: HDDS-2311. Fix logic of RetryPolicy in OzoneClientSideTranslatorPB.

2019-10-17 Thread GitBox
bharatviswa504 commented on a change in pull request #51: HDDS-2311. Fix logic of RetryPolicy in OzoneClientSideTranslatorPB. URL: https://github.com/apache/hadoop-ozone/pull/51#discussion_r336324386 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protoco

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #51: HDDS-2311. Fix logic of RetryPolicy in OzoneClientSideTranslatorPB.

2019-10-17 Thread GitBox
bharatviswa504 commented on a change in pull request #51: HDDS-2311. Fix logic of RetryPolicy in OzoneClientSideTranslatorPB. URL: https://github.com/apache/hadoop-ozone/pull/51#discussion_r336324051 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protoco

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #51: HDDS-2311. Fix logic of RetryPolicy in OzoneClientSideTranslatorPB.

2019-10-17 Thread GitBox
bharatviswa504 commented on a change in pull request #51: HDDS-2311. Fix logic of RetryPolicy in OzoneClientSideTranslatorPB. URL: https://github.com/apache/hadoop-ozone/pull/51#discussion_r336323687 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protoco

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #51: HDDS-2311. Fix logic of RetryPolicy in OzoneClientSideTranslatorPB.

2019-10-17 Thread GitBox
bharatviswa504 commented on a change in pull request #51: HDDS-2311. Fix logic of RetryPolicy in OzoneClientSideTranslatorPB. URL: https://github.com/apache/hadoop-ozone/pull/51#discussion_r336323125 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/OzoneConfig

[GitHub] [hadoop-ozone] swagle commented on issue #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call.

2019-10-17 Thread GitBox
swagle commented on issue #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call. URL: https://github.com/apache/hadoop-ozone/pull/50#issuecomment-543497347 /retest This is an automated me

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-10-17 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/478/ [Oct 17, 2019 5:04:36 AM] (dazhou) HADOOP-16640. WASB: Override getCanonicalServiceName() to return URI - To unsubscribe, e-mail: hdfs-

[GitHub] [hadoop-ozone] hanishakoneru opened a new pull request #51: HDDS-2311. Fix logic of RetryPolicy in OzoneClientSideTranslatorPB.

2019-10-17 Thread GitBox
hanishakoneru opened a new pull request #51: HDDS-2311. Fix logic of RetryPolicy in OzoneClientSideTranslatorPB. URL: https://github.com/apache/hadoop-ozone/pull/51 OzoneManagerProtocolClientSideTranslatorPB.java L251: if (cause instanceof NotLeaderException) { NotLeaderExcept

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #46: HDDS-2286. Add a log info in ozone client and scm to print the exclus…

2019-10-17 Thread GitBox
mukul1987 commented on a change in pull request #46: HDDS-2286. Add a log info in ozone client and scm to print the exclus… URL: https://github.com/apache/hadoop-ozone/pull/46#discussion_r336306738 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/server

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #46: HDDS-2286. Add a log info in ozone client and scm to print the exclus…

2019-10-17 Thread GitBox
mukul1987 commented on a change in pull request #46: HDDS-2286. Add a log info in ozone client and scm to print the exclus… URL: https://github.com/apache/hadoop-ozone/pull/46#discussion_r336306857 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/io/Bl

[GitHub] [hadoop-ozone] mukul1987 commented on issue #23: HDDS-1868. Ozone pipelines should be marked as ready only after the leader election is complete.

2019-10-17 Thread GitBox
mukul1987 commented on issue #23: HDDS-1868. Ozone pipelines should be marked as ready only after the leader election is complete. URL: https://github.com/apache/hadoop-ozone/pull/23#issuecomment-543471606 Thanks for updating the patch @swagle. There are some checkstyle issues in the lates

[jira] [Created] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-17 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HDDS-2323: -- Summary: Mem allocation: Optimise AuditMessage::build() Key: HDDS-2323 URL: https://issues.apache.org/jira/browse/HDDS-2323 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-2322) DoubleBuffer flush termination and OM is shutdown

2019-10-17 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-2322: Summary: DoubleBuffer flush termination and OM is shutdown Key: HDDS-2322 URL: https://issues.apache.org/jira/browse/HDDS-2322 Project: Hadoop Distributed Data

[GitHub] [hadoop-ozone] hanishakoneru commented on a change in pull request #9: HDDS-2240. Command line tool for OM Admin

2019-10-17 Thread GitBox
hanishakoneru commented on a change in pull request #9: HDDS-2240. Command line tool for OM Admin URL: https://github.com/apache/hadoop-ozone/pull/9#discussion_r336278859 ## File path: hadoop-ozone/common/src/main/proto/OzoneManagerProtocol.proto ## @@ -139,7 +140,8 @@ mes

[GitHub] [hadoop-ozone] hanishakoneru commented on a change in pull request #9: HDDS-2240. Command line tool for OM Admin

2019-10-17 Thread GitBox
hanishakoneru commented on a change in pull request #9: HDDS-2240. Command line tool for OM Admin URL: https://github.com/apache/hadoop-ozone/pull/9#discussion_r336278859 ## File path: hadoop-ozone/common/src/main/proto/OzoneManagerProtocol.proto ## @@ -139,7 +140,8 @@ mes

[GitHub] [hadoop-ozone] swagle opened a new pull request #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call.

2019-10-17 Thread GitBox
swagle opened a new pull request #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call. URL: https://github.com/apache/hadoop-ozone/pull/50 ## What changes were proposed in this pull request? Optimize listMultiPartUpload to not read from openKeyTable

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #47: HDDS-2208. Propagate System Exceptions from OM transaction apply phase. Contributed by Supratim Deka

2019-10-17 Thread GitBox
bharatviswa504 commented on a change in pull request #47: HDDS-2208. Propagate System Exceptions from OM transaction apply phase. Contributed by Supratim Deka URL: https://github.com/apache/hadoop-ozone/pull/47#discussion_r336256847 ## File path: hadoop-ozone/ozone-manager/src/main

[jira] [Resolved] (HDDS-2254) Fix flaky unit testTestContainerStateMachine#testRatisSnapshotRetention

2019-10-17 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDDS-2254. Fix Version/s: 0.5.0 Resolution: Fixed Committed to the master branch. > Fix flaky unit test

[GitHub] [hadoop-ozone] anuengineer commented on issue #31: HDDS-2254. Fix flaky unit test TestContainerStateMachine#testRatisSn…

2019-10-17 Thread GitBox
anuengineer commented on issue #31: HDDS-2254. Fix flaky unit test TestContainerStateMachine#testRatisSn… URL: https://github.com/apache/hadoop-ozone/pull/31#issuecomment-543383248 Thank you for the contribution. @elek @adoroszlai Thanks for the reviews. I have committed this patch to the

[GitHub] [hadoop-ozone] anuengineer closed pull request #31: HDDS-2254. Fix flaky unit test TestContainerStateMachine#testRatisSn…

2019-10-17 Thread GitBox
anuengineer closed pull request #31: HDDS-2254. Fix flaky unit test TestContainerStateMachine#testRatisSn… URL: https://github.com/apache/hadoop-ozone/pull/31 This is an automated message from the Apache Git Service. To resp

[jira] [Created] (HDFS-14912) Default dfs.image.string-tables.expanded to false in branch-2.7

2019-10-17 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-14912: - Summary: Default dfs.image.string-tables.expanded to false in branch-2.7 Key: HDFS-14912 URL: https://issues.apache.org/jira/browse/HDFS-14912 Project: Hadoop HDFS

[GitHub] [hadoop-ozone] vivekratnavel commented on issue #49: HDDS-2310. Add support to add ozone ranger plugin to Ozone Manager cl…

2019-10-17 Thread GitBox
vivekratnavel commented on issue #49: HDDS-2310. Add support to add ozone ranger plugin to Ozone Manager cl… URL: https://github.com/apache/hadoop-ozone/pull/49#issuecomment-543351236 @elek @avijayanhwx @bharatviswa504 Please review.

[GitHub] [hadoop-ozone] vivekratnavel opened a new pull request #49: HDDS-2310. Add support to add ozone ranger plugin to Ozone Manager cl…

2019-10-17 Thread GitBox
vivekratnavel opened a new pull request #49: HDDS-2310. Add support to add ozone ranger plugin to Ozone Manager cl… URL: https://github.com/apache/hadoop-ozone/pull/49 …asspath. ## What changes were proposed in this pull request? This PR adds a new hadoop shell profile for ozo

[jira] [Created] (HDDS-2321) Ozone Block Token verify should not apply to all datanode cmd

2019-10-17 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2321: Summary: Ozone Block Token verify should not apply to all datanode cmd Key: HDDS-2321 URL: https://issues.apache.org/jira/browse/HDDS-2321 Project: Hadoop Distributed Data St

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #43: HDDS-2181. Ozone Manager should send correct ACL type in ACL requests…

2019-10-17 Thread GitBox
xiaoyuyao merged pull request #43: HDDS-2181. Ozone Manager should send correct ACL type in ACL requests… URL: https://github.com/apache/hadoop-ozone/pull/43 This is an automated message from the Apache Git Service. To respo

[GitHub] [hadoop-ozone] xiaoyuyao commented on issue #43: HDDS-2181. Ozone Manager should send correct ACL type in ACL requests…

2019-10-17 Thread GitBox
xiaoyuyao commented on issue #43: HDDS-2181. Ozone Manager should send correct ACL type in ACL requests… URL: https://github.com/apache/hadoop-ozone/pull/43#issuecomment-543315586 +1, test failures are not repro locally. The only one repro TestDeleteWithSlowFollower does not relate to this

[jira] [Created] (HDDS-2320) Negative value seen for OM NumKeys Metric in JMX.

2019-10-17 Thread Aravindan Vijayan (Jira)
Aravindan Vijayan created HDDS-2320: --- Summary: Negative value seen for OM NumKeys Metric in JMX. Key: HDDS-2320 URL: https://issues.apache.org/jira/browse/HDDS-2320 Project: Hadoop Distributed Data S

[jira] [Created] (HDFS-14911) hdfs oiv "Delimited" processer failing with java.lang.UnsatisfiedLinkError

2019-10-17 Thread bb (Jira)
bb created HDFS-14911: - Summary: hdfs oiv "Delimited" processer failing with java.lang.UnsatisfiedLinkError Key: HDFS-14911 URL: https://issues.apache.org/jira/browse/HDFS-14911 Project: Hadoop HDFS Iss

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #48: HDDS-2318. Avoid proto::tostring in preconditions to save CPU cycles.

2019-10-17 Thread GitBox
bharatviswa504 opened a new pull request #48: HDDS-2318. Avoid proto::tostring in preconditions to save CPU cycles. URL: https://github.com/apache/hadoop-ozone/pull/48 ## What changes were proposed in this pull request? Avoiding proto::toString in OzoneManagerServerSideTranslatorPB.j

[GitHub] [hadoop-ozone] vivekratnavel commented on issue #43: HDDS-2181. Ozone Manager should send correct ACL type in ACL requests…

2019-10-17 Thread GitBox
vivekratnavel commented on issue #43: HDDS-2181. Ozone Manager should send correct ACL type in ACL requests… URL: https://github.com/apache/hadoop-ozone/pull/43#issuecomment-543277012 The integration test failures are not related to the changes made in this PR.

[GitHub] [hadoop-ozone] anuengineer commented on a change in pull request #9: HDDS-2240. Command line tool for OM Admin

2019-10-17 Thread GitBox
anuengineer commented on a change in pull request #9: HDDS-2240. Command line tool for OM Admin URL: https://github.com/apache/hadoop-ozone/pull/9#discussion_r336122003 ## File path: hadoop-ozone/common/src/main/proto/OzoneManagerProtocol.proto ## @@ -139,7 +140,8 @@ messa

[jira] [Created] (HDDS-2319) CLI command to perform on-demand data scan of a specific container

2019-10-17 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2319: -- Summary: CLI command to perform on-demand data scan of a specific container Key: HDDS-2319 URL: https://issues.apache.org/jira/browse/HDDS-2319 Project: Hadoop Di

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #9: HDDS-2240. Command line tool for OM Admin

2019-10-17 Thread GitBox
hanishakoneru commented on issue #9: HDDS-2240. Command line tool for OM Admin URL: https://github.com/apache/hadoop-ozone/pull/9#issuecomment-543265207 @anuengineer, @elek , can you please take a look at the new patch. This i

[GitHub] [hadoop-ozone] hanishakoneru commented on a change in pull request #9: HDDS-2240. Command line tool for OM Admin

2019-10-17 Thread GitBox
hanishakoneru commented on a change in pull request #9: HDDS-2240. Command line tool for OM Admin URL: https://github.com/apache/hadoop-ozone/pull/9#discussion_r336114811 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerRatisServer

[jira] [Created] (HDFS-14910) TestRenameWithSnapshots#testRename2PreDescendant failing consistently

2019-10-17 Thread Jira
Íñigo Goiri created HDFS-14910: -- Summary: TestRenameWithSnapshots#testRename2PreDescendant failing consistently Key: HDFS-14910 URL: https://issues.apache.org/jira/browse/HDFS-14910 Project: Hadoop HDFS

[jira] [Resolved] (HDDS-2221) Monitor datanodes in ozoneperf compose cluster

2019-10-17 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-2221. --- Fix Version/s: 0.5.0 Resolution: Fixed > Monitor datanodes in ozoneperf compose cluster > -

[GitHub] [hadoop-ozone] elek commented on issue #1: HDDS-2221. Monitor datanodes in ozoneperf compose cluster

2019-10-17 Thread GitBox
elek commented on issue #1: HDDS-2221. Monitor datanodes in ozoneperf compose cluster URL: https://github.com/apache/hadoop-ozone/pull/1#issuecomment-543188811 thanks the review @arp7 , I merged it to the master This is an au

[GitHub] [hadoop-ozone] elek closed pull request #1: HDDS-2221. Monitor datanodes in ozoneperf compose cluster

2019-10-17 Thread GitBox
elek closed pull request #1: HDDS-2221. Monitor datanodes in ozoneperf compose cluster URL: https://github.com/apache/hadoop-ozone/pull/1 This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [hadoop-ozone] elek closed pull request #33: HDDS-1985. Fix listVolumes API

2019-10-17 Thread GitBox
elek closed pull request #33: HDDS-1985. Fix listVolumes API URL: https://github.com/apache/hadoop-ozone/pull/33 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop-ozone] elek commented on issue #33: HDDS-1985. Fix listVolumes API

2019-10-17 Thread GitBox
elek commented on issue #33: HDDS-1985. Fix listVolumes API URL: https://github.com/apache/hadoop-ozone/pull/33#issuecomment-543187105 Thanks @bharatviswa504 the patch and @arp7 the review. I merged it to the ~trunk~ master T

[GitHub] [hadoop-ozone] elek commented on issue #8: HDDS-2267. Container metadata scanner interval mismatch

2019-10-17 Thread GitBox
elek commented on issue #8: HDDS-2267. Container metadata scanner interval mismatch URL: https://github.com/apache/hadoop-ozone/pull/8#issuecomment-543181142 > But here I wanted to minimize the change. Fair enough, and it seems to be a good newbie jira, I will create one... ---

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-10-17 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/477/ [Oct 16, 2019 10:39:39 PM] (dazhou) HADOOP-16652. Backport of HADOOP-16587: Make ABFS AAD endpoints -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml

[jira] [Created] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-17 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HDDS-2318: -- Summary: Avoid proto::tostring in preconditions to save CPU cycles Key: HDDS-2318 URL: https://issues.apache.org/jira/browse/HDDS-2318 Project: Hadoop Distributed

[GitHub] [hadoop-ozone] supratimdeka commented on issue #12: HDDS-2206. Separate handling for OMException and IOException in the Ozone Manager. Contributed by Supratim Deka

2019-10-17 Thread GitBox
supratimdeka commented on issue #12: HDDS-2206. Separate handling for OMException and IOException in the Ozone Manager. Contributed by Supratim Deka URL: https://github.com/apache/hadoop-ozone/pull/12#issuecomment-543113365 2 modifications in latest commit: 1. Removed the configurati

[GitHub] [hadoop-ozone] timmylicheng commented on issue #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-17 Thread GitBox
timmylicheng commented on issue #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#issuecomment-543093329 /retest This is an automated message from the Ap

[GitHub] [hadoop-ozone] szetszwo merged pull request #45: HDDS-2275. In BatchOperation.SingleOperation, do not clone byte[].

2019-10-17 Thread GitBox
szetszwo merged pull request #45: HDDS-2275. In BatchOperation.SingleOperation, do not clone byte[]. URL: https://github.com/apache/hadoop-ozone/pull/45 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-17 Thread GitBox
timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335890352 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-17 Thread GitBox
timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335883836 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/MiniO

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-17 Thread GitBox
timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335847078 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/hdds/scm/pi

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-17 Thread GitBox
timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335846893 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-17 Thread GitBox
timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r335844551 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/hdds/scm/pi