[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337868451 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337867801 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337867554 ## File path: hadoop-hdds/common/src/main/resources/ozone-default.xml ## @@ -8

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
timmylicheng commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337866903 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/stat

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337865795 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/MiniOzon

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-22 Thread GitBox
bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#discussion_r337861523 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/o

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-22 Thread GitBox
bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#discussion_r337861558 ## File path: hadoop-ozone/common/src/test/java/org/apache/hadoop/ozone/o

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-22 Thread GitBox
bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#discussion_r337861523 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/o

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337853755 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/containe

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337853535 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/r

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337853227 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/r

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337853065 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/MiniOzon

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337852587 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/hdds/scm/safem

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337849370 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/hdds/scm/pipel

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337848761 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/hdds/scm/pipel

[GitHub] [hadoop-ozone] vivekratnavel commented on issue #23: HDDS-1868. Ozone pipelines should be marked as ready only after the leader election is complete.

2019-10-22 Thread GitBox
vivekratnavel commented on issue #23: HDDS-1868. Ozone pipelines should be marked as ready only after the leader election is complete. URL: https://github.com/apache/hadoop-ozone/pull/23#issuecomment-545263168 /retest This is

[GitHub] [hadoop-ozone] dineshchitlangia commented on a change in pull request #70: HDDS-1643. Send hostName also part of OMRequest.

2019-10-22 Thread GitBox
dineshchitlangia commented on a change in pull request #70: HDDS-1643. Send hostName also part of OMRequest. URL: https://github.com/apache/hadoop-ozone/pull/70#discussion_r337843721 ## File path: hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/TestOMCli

[GitHub] [hadoop-ozone] dineshchitlangia commented on a change in pull request #70: HDDS-1643. Send hostName also part of OMRequest.

2019-10-22 Thread GitBox
dineshchitlangia commented on a change in pull request #70: HDDS-1643. Send hostName also part of OMRequest. URL: https://github.com/apache/hadoop-ozone/pull/70#discussion_r337843721 ## File path: hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/TestOMCli

[GitHub] [hadoop-ozone] dineshchitlangia commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-22 Thread GitBox
dineshchitlangia commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#discussion_r337841711 ## File path: hadoop-ozone/common/src/test/java/org/apache/hadoop/ozone

[GitHub] [hadoop-ozone] dineshchitlangia commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-22 Thread GitBox
dineshchitlangia commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#discussion_r337841329 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone

[GitHub] [hadoop-ozone] dineshchitlangia commented on a change in pull request #72: HDDS-2341. Validate tar entry path during extraction

2019-10-22 Thread GitBox
dineshchitlangia commented on a change in pull request #72: HDDS-2341. Validate tar entry path during extraction URL: https://github.com/apache/hadoop-ozone/pull/72#discussion_r337838377 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/key

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337837808 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/SCM

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337837128 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/SCM

[GitHub] [hadoop-ozone] dineshchitlangia commented on issue #74: HDDS-2348.Remove log4j properties for package org.apache.hadoop.ozone

2019-10-22 Thread GitBox
dineshchitlangia commented on issue #74: HDDS-2348.Remove log4j properties for package org.apache.hadoop.ozone URL: https://github.com/apache/hadoop-ozone/pull/74#issuecomment-545250164 @chimney-lee Thank you for filing the jira & opening this PR. I see this is your first contribution to O

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337836777 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/SCM

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337836283 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/SCM

[GitHub] [hadoop-ozone] chimney-lee opened a new pull request #74: HDDS-2348.Remove log4j properties for package org.apache.hadoop.ozone

2019-10-22 Thread GitBox
chimney-lee opened a new pull request #74: HDDS-2348.Remove log4j properties for package org.apache.hadoop.ozone URL: https://github.com/apache/hadoop-ozone/pull/74 ## What changes were proposed in this pull request? Remove log4j config for package org.apache.hadoop.ozone, as it caus

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-10-22 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/483/ [Oct 22, 2019 6:46:25 PM] (jhung) HDFS-14667. Backport [HDFS-14403] "Cost-based FairCallQueue" to [Oct 22, 2019 11:43:25 PM] (weichiu) HDFS-13901. INode access time is ignored because of race between ope

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

2019-10-22 Thread Jonathan Hung
Hi Eric, we've run some basic HDFS commands with a 3.2.1 namenode and 2.10.0 clients and datanodes. Everything worked as expected. Jonathan Hung On Tue, Oct 22, 2019 at 3:04 PM Eric Badger wrote: > Hi Jonathan, > > Thanks for putting this RC together. You stated that there are > improvements r

[GitHub] [hadoop-ozone] dineshchitlangia commented on issue #27: HDDS-2278. Run S3 test suite on OM HA cluster.

2019-10-22 Thread GitBox
dineshchitlangia commented on issue #27: HDDS-2278. Run S3 test suite on OM HA cluster. URL: https://github.com/apache/hadoop-ozone/pull/27#issuecomment-545211362 Thanks @elek and @adoroszlai for reviews. Thanks @bharatviswa504 for this contribution. Committed this change. ---

[GitHub] [hadoop-ozone] dineshchitlangia merged pull request #27: HDDS-2278. Run S3 test suite on OM HA cluster.

2019-10-22 Thread GitBox
dineshchitlangia merged pull request #27: HDDS-2278. Run S3 test suite on OM HA cluster. URL: https://github.com/apache/hadoop-ozone/pull/27 This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #27: HDDS-2278. Run S3 test suite on OM HA cluster.

2019-10-22 Thread GitBox
bharatviswa504 commented on issue #27: HDDS-2278. Run S3 test suite on OM HA cluster. URL: https://github.com/apache/hadoop-ozone/pull/27#issuecomment-545204726 Newly added tests are passing, test failures are not related to this patch. -

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337788038 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/Pip

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337785909 ## File path: hadoop-hdds/common/src/main/resources/ozone-default.xml ## @@ -846,

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r337784877 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/states/

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

2019-10-22 Thread Eric Badger
Hi Jonathan, Thanks for putting this RC together. You stated that there are improvements related to rolling upgrades from 2.x to 3.x and I know I have seen multiple JIRAs getting committed to that effect. Could you describe any tests that you have done to verify rolling upgrade compatibility for 3

[VOTE] Release Apache Hadoop 2.10.0 (RC1)

2019-10-22 Thread Jonathan Hung
Hi folks, This is the second release candidate for the first release of Apache Hadoop 2.10 line. It contains 362 fixes/improvements since 2.9 [1]. It includes features such as: - User-defined resource types - Native GPU support as a schedulable resource type - Consistent reads from standby node -

[jira] [Resolved] (HDDS-2131) Optimize replication type and creation time calculation in S3 MPU list call

2019-10-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-2131. -- Fix Version/s: 0.5.0 Resolution: Fixed > Optimize replication type and creation t

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call.

2019-10-22 Thread GitBox
bharatviswa504 commented on issue #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call. URL: https://github.com/apache/hadoop-ozone/pull/50#issuecomment-545105335 Thank You @swagle for the verification and for the contribution and @anuengineer for the

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call.

2019-10-22 Thread GitBox
bharatviswa504 merged pull request #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call. URL: https://github.com/apache/hadoop-ozone/pull/50 This is an automated message from the Apache

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

2019-10-22 Thread Jonathan Hung
Thanks Konstantin and Zhankun. Unfortunately a feature slipped our radar (HDFS-14667). Since this is the first of a minor release, we would like to get it into 2.10.0. HDFS-14667 has been committed to branch-2.10.0, I will be rolling an RC1 shortly. Jonathan Hung On Tue, Oct 22, 2019 at 1:39 AM

[GitHub] [hadoop-ozone] swagle commented on issue #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call.

2019-10-22 Thread GitBox
swagle commented on issue #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call. URL: https://github.com/apache/hadoop-ozone/pull/50#issuecomment-545094626 Hi @bharatviswa504 the tests are failing since we do not have RATIS-707 fix, it is unrelated. Do

[GitHub] [hadoop-ozone] swagle commented on a change in pull request #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call.

2019-10-22 Thread GitBox
swagle commented on a change in pull request #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call. URL: https://github.com/apache/hadoop-ozone/pull/50#discussion_r337670962 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hado

[GitHub] [hadoop-ozone] swagle commented on a change in pull request #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call.

2019-10-22 Thread GitBox
swagle commented on a change in pull request #50: HDDS-2131. Optimize replication type and creation time calculation in S3 MPU list call. URL: https://github.com/apache/hadoop-ozone/pull/50#discussion_r337670962 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hado

Re: How should we do about dependency update?

2019-10-22 Thread Steve Loughran
We don't have a complete set of shaded artefacts -so it's not fair to point at the downstream users and say it's "your own fault". We need to do more here ourselves. Here: it is a CVE, they should upgrade anyway. Guava is special because it has been so brittle cross versions and so widely used by

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #6: HDDS-2214. TestSCMContainerPlacementRackAware has an intermittent fai…

2019-10-22 Thread GitBox
xiaoyuyao merged pull request #6: HDDS-2214. TestSCMContainerPlacementRackAware has an intermittent fai… URL: https://github.com/apache/hadoop-ozone/pull/6 This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop-ozone] xiaoyuyao commented on issue #6: HDDS-2214. TestSCMContainerPlacementRackAware has an intermittent fai…

2019-10-22 Thread GitBox
xiaoyuyao commented on issue #6: HDDS-2214. TestSCMContainerPlacementRackAware has an intermittent fai… URL: https://github.com/apache/hadoop-ozone/pull/6#issuecomment-545070633 Thanks @elek for fixing this and @adoroszlai for the review. The change LGTM. I will merge it shortly.

Re: How should we do about dependency update?

2019-10-22 Thread Wei-Chiu Chuang
Hi Sean, Thanks for the valuable feedback. Good point on not using dependency classes in public API parameters. One example is HADOOP-15502 (blame me for breaking the API) >From what I know, the biggest risk is that downstreamers include depende

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-10-22 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1297/ [Oct 21, 2019 12:50:00 PM] (ayushsaxena) HDFS-14916. RBF: line breaks are missing from the output of 'hdfs [Oct 21, 2019 1:05:12 PM] (ayushsaxena) HDFS-14913. Correct the value of available count in [Oct

[GitHub] [hadoop-ozone] adoroszlai commented on issue #73: HDDS-2346. Replication manager config has wrong description

2019-10-22 Thread GitBox
adoroszlai commented on issue #73: HDDS-2346. Replication manager config has wrong description URL: https://github.com/apache/hadoop-ozone/pull/73#issuecomment-545044798 Thanks @bharatviswa504 for reviewing and merging this.

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #27: HDDS-2278. Run S3 test suite on OM HA cluster.

2019-10-22 Thread GitBox
bharatviswa504 commented on issue #27: HDDS-2278. Run S3 test suite on OM HA cluster. URL: https://github.com/apache/hadoop-ozone/pull/27#issuecomment-545044627 /retest This is an automated message from the Apache Git Service

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #73: HDDS-2346. Replication manager config has wrong description

2019-10-22 Thread GitBox
bharatviswa504 commented on issue #73: HDDS-2346. Replication manager config has wrong description URL: https://github.com/apache/hadoop-ozone/pull/73#issuecomment-545043970 Thank You @adoroszlai for the contribution. This is

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #73: HDDS-2346. Replication manager config has wrong description

2019-10-22 Thread GitBox
bharatviswa504 merged pull request #73: HDDS-2346. Replication manager config has wrong description URL: https://github.com/apache/hadoop-ozone/pull/73 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop-ozone] adoroszlai commented on issue #6: HDDS-2214. TestSCMContainerPlacementRackAware has an intermittent fai…

2019-10-22 Thread GitBox
adoroszlai commented on issue #6: HDDS-2214. TestSCMContainerPlacementRackAware has an intermittent fai… URL: https://github.com/apache/hadoop-ozone/pull/6#issuecomment-545039722 @ChenSammi could you please review this fix when you have some time? --

Re: How should we do about dependency update?

2019-10-22 Thread Sean Busbey
speaking with my HBase hat on instead of my Hadoop hat, when the Hadoop project publishes that there's a CVE but does not include a maintenance release that mitigates it for a given minor release line, we assume that means the Hadoop project is saying that release line is EOM and should be abandone

[jira] [Created] (HDDS-2348) remove log4j properties for org.apache.hadoop.ozone

2019-10-22 Thread luhuachao (Jira)
luhuachao created HDDS-2348: --- Summary: remove log4j properties for org.apache.hadoop.ozone Key: HDDS-2348 URL: https://issues.apache.org/jira/browse/HDDS-2348 Project: Hadoop Distributed Data Store

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-10-22 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/482/ [Oct 21, 2019 9:36:42 PM] (kihwal) HDFS-12749. DN may not send block report to NN after NN restart. -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml

[jira] [Created] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-22 Thread Fei Hui (Jira)
Fei Hui created HDFS-14920: -- Summary: Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission Key: HDFS-14920 URL: https://issues.apache.org/jira/browse/HDFS-14920

[GitHub] [hadoop-ozone] timmylicheng commented on issue #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-22 Thread GitBox
timmylicheng commented on issue #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#issuecomment-544932882 /retest This is an automated message from the Ap

[jira] [Created] (HDDS-2347) XCeiverClientGrpc's parallel use leads to NPE

2019-10-22 Thread Istvan Fajth (Jira)
Istvan Fajth created HDDS-2347: -- Summary: XCeiverClientGrpc's parallel use leads to NPE Key: HDDS-2347 URL: https://issues.apache.org/jira/browse/HDDS-2347 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] bshashikant commented on issue #65: HDDS-2334. Dummy chunk manager fails with length mismatch error

2019-10-22 Thread GitBox
bshashikant commented on issue #65: HDDS-2334. Dummy chunk manager fails with length mismatch error URL: https://github.com/apache/hadoop-ozone/pull/65#issuecomment-544886654 Thanks @adoroszlai for working on this, The patch looks good tom me. I am +1 on the change. --

[GitHub] [hadoop-ozone] bshashikant edited a comment on issue #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s…

2019-10-22 Thread GitBox
bshashikant edited a comment on issue #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s… URL: https://github.com/apache/hadoop-ozone/pull/40#issuecomment-544884381 Thanks @hanishakoneru for working on this. I am thinking of a case where, let's say two threads tryin

[GitHub] [hadoop-ozone] bshashikant commented on issue #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s…

2019-10-22 Thread GitBox
bshashikant commented on issue #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s… URL: https://github.com/apache/hadoop-ozone/pull/40#issuecomment-544884381 Thanks @hanishakoneru for working on this. I am thinking of a case where, let's say two threads trying to re

[GitHub] [hadoop-ozone] bshashikant commented on a change in pull request #54: HDDS-2281. ContainerStateMachine#handleWriteChunk should ignore close container exception

2019-10-22 Thread GitBox
bshashikant commented on a change in pull request #54: HDDS-2281. ContainerStateMachine#handleWriteChunk should ignore close container exception URL: https://github.com/apache/hadoop-ozone/pull/54#discussion_r337406349 ## File path: hadoop-hdds/container-service/src/main/java/org/a

[GitHub] [hadoop-ozone] bshashikant commented on a change in pull request #54: HDDS-2281. ContainerStateMachine#handleWriteChunk should ignore close container exception

2019-10-22 Thread GitBox
bshashikant commented on a change in pull request #54: HDDS-2281. ContainerStateMachine#handleWriteChunk should ignore close container exception URL: https://github.com/apache/hadoop-ozone/pull/54#discussion_r337403878 ## File path: hadoop-hdds/container-service/src/main/java/org/a

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #7: HDDS-1228. Chunk Scanner Checkpoints

2019-10-22 Thread GitBox
adoroszlai commented on a change in pull request #7: HDDS-1228. Chunk Scanner Checkpoints URL: https://github.com/apache/hadoop-ozone/pull/7#discussion_r337399474 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/impl/ContainerDataSc

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #73: HDDS-2346. Replication manager config has wrong description

2019-10-22 Thread GitBox
adoroszlai opened a new pull request #73: HDDS-2346. Replication manager config has wrong description URL: https://github.com/apache/hadoop-ozone/pull/73 ## What changes were proposed in this pull request? Copy the correct description from [old `ozone-default.xml`](https://github.co

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

2019-10-22 Thread Zhankun Tang
Thanks for the effort, Jonathan! +1 (non-binding) on RC0. - Set up a single node cluster with the binary tarball - Run Spark Pi and pySpark job BR, Zhankun On Tue, 22 Oct 2019 at 14:31, Konstantin Shvachko wrote: > +1 on RC0. > - Verified signatures > - Built from sources > - Ran unit tests

[jira] [Created] (HDDS-2346) Replication manager config has wrong description

2019-10-22 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2346: -- Summary: Replication manager config has wrong description Key: HDDS-2346 URL: https://issues.apache.org/jira/browse/HDDS-2346 Project: Hadoop Distributed Data Stor

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #72: HDDS-2341. Validate tar entry path during extraction

2019-10-22 Thread GitBox
adoroszlai opened a new pull request #72: HDDS-2341. Validate tar entry path during extraction URL: https://github.com/apache/hadoop-ozone/pull/72 ## What changes were proposed in this pull request? Add a check to verify tar entries during extraction: they should not be able to esca