[GitHub] [hadoop-ozone] cxorm commented on issue #80: HDDS-1701. Move dockerbin script to libexec.

2019-10-24 Thread GitBox
cxorm commented on issue #80: HDDS-1701. Move dockerbin script to libexec. URL: https://github.com/apache/hadoop-ozone/pull/80#issuecomment-546224007 When test-all.sh is ran in distribution, it works well. But when it called by acceptance.sh, it fails. We are looking for the cause.

[jira] [Resolved] (HDDS-2296) ozoneperf compose cluster shouln't start freon by default

2019-10-24 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-2296. -- Fix Version/s: 0.5.0 Resolution: Fixed > ozoneperf compose cluster shouln't start

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #84: HDDS-2365. Fix TestRatisPipelineProvider#testCreatePipelinesDnExclude

2019-10-24 Thread GitBox
adoroszlai opened a new pull request #84: HDDS-2365. Fix TestRatisPipelineProvider#testCreatePipelinesDnExclude URL: https://github.com/apache/hadoop-ozone/pull/84 ## What changes were proposed in this pull request? Fix TestRatisPipelineProvider#testCreatePipelinesDnExclude, which ha

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Bharat Viswanadham
+1 Thanks, Bharat On Thu, Oct 24, 2019 at 10:35 PM Jitendra Pandey wrote: > +1 > > On Thu, Oct 24, 2019 at 6:42 PM Ayush Saxena wrote: > > > Thanx Akira for putting this up. > > +1, Makes sense removing. > > > > -Ayush > > > > > On 25-Oct-2019, at 6:55 AM, Dinesh Chitlangia < > dchitlan...@clo

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Jitendra Pandey
+1 On Thu, Oct 24, 2019 at 6:42 PM Ayush Saxena wrote: > Thanx Akira for putting this up. > +1, Makes sense removing. > > -Ayush > > > On 25-Oct-2019, at 6:55 AM, Dinesh Chitlangia > > > wrote: > > > > +1 and Anu's approach of creating a tag makes sense. > > > > Dinesh > > > > > > > > > >> On

[jira] [Resolved] (HDDS-1015) Cleanup snapshot repository settings

2019-10-24 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-1015. -- Resolution: Won't Fix > Cleanup snapshot repository settings > -

[jira] [Created] (HDDS-2365) TestRatisPipelineProvider#testCreatePipelinesDnExclude is flaky

2019-10-24 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2365: -- Summary: TestRatisPipelineProvider#testCreatePipelinesDnExclude is flaky Key: HDDS-2365 URL: https://issues.apache.org/jira/browse/HDDS-2365 Project: Hadoop Distr

[jira] [Created] (HDFS-14933) Fixing a typo in documentaion of Observer NameNode

2019-10-24 Thread Xieming Li (Jira)
Xieming Li created HDFS-14933: - Summary: Fixing a typo in documentaion of Observer NameNode Key: HDFS-14933 URL: https://issues.apache.org/jira/browse/HDFS-14933 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDDS-2364) Add a OM metrics to find the false positive rate for the keyMayExist

2019-10-24 Thread Mukul Kumar Singh (Jira)
Mukul Kumar Singh created HDDS-2364: --- Summary: Add a OM metrics to find the false positive rate for the keyMayExist Key: HDDS-2364 URL: https://issues.apache.org/jira/browse/HDDS-2364 Project: Hadoo

[jira] [Resolved] (HDFS-3807) hadoop.http.filter.initializers not applied to webhdfs urls

2019-10-24 Thread Clay B. (Jira)
[ https://issues.apache.org/jira/browse/HDFS-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Clay B. resolved HDFS-3807. --- Target Version/s: (was: ) Resolution: Duplicate > hadoop.http.filter.initializers not applied to w

[GitHub] [hadoop-ozone] cxorm commented on issue #80: HDDS-1701. Move dockerbin script to libexec.

2019-10-24 Thread GitBox
cxorm commented on issue #80: HDDS-1701. Move dockerbin script to libexec. URL: https://github.com/apache/hadoop-ozone/pull/80#issuecomment-546195651 /retest This is an automated message from the Apache Git Service. To respond

[jira] [Created] (HDDS-2363) Improve datanode write failure log

2019-10-24 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-2363: Summary: Improve datanode write failure log Key: HDDS-2363 URL: https://issues.apache.org/jira/browse/HDDS-2363 Project: Hadoop Distributed Data Store Issue Type: Im

[GitHub] [hadoop-ozone] dineshchitlangia commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
dineshchitlangia commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#issuecomment-546185975 Thanks @xiaoyuyao for reviews and @bharatviswa504 for contribution. This has been merged to maste

[GitHub] [hadoop-ozone] dineshchitlangia merged pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
dineshchitlangia merged pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71 This is an automated message from the Apache Git Serv

[jira] [Resolved] (HDDS-2360) Update Ratis snapshot to d6d58d0

2019-10-24 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-2360. -- Fix Version/s: 0.5.0 Resolution: Fixed > Update Ratis snapshot to d6d58d0 > -

[GitHub] [hadoop-ozone] adoroszlai commented on issue #83: HDDS-2360. Update Ratis snapshot to d6d58d0

2019-10-24 Thread GitBox
adoroszlai commented on issue #83: HDDS-2360. Update Ratis snapshot to d6d58d0 URL: https://github.com/apache/hadoop-ozone/pull/83#issuecomment-546184089 Thanks @xiaoyuyao for the review and @bharatviswa504 for merging it. Thi

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #83: HDDS-2360. Update Ratis snapshot to d6d58d0

2019-10-24 Thread GitBox
bharatviswa504 commented on issue #83: HDDS-2360. Update Ratis snapshot to d6d58d0 URL: https://github.com/apache/hadoop-ozone/pull/83#issuecomment-546183080 Test failure of ratis is not related to this patch. Thank you @adoroszlai for the contribution and @xiaoyuyao for the review. -

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #83: HDDS-2360. Update Ratis snapshot to d6d58d0

2019-10-24 Thread GitBox
bharatviswa504 merged pull request #83: HDDS-2360. Update Ratis snapshot to d6d58d0 URL: https://github.com/apache/hadoop-ozone/pull/83 This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [hadoop-ozone] ChenSammi edited a comment on issue #29: HDDS-2034. Async RATIS pipeline creation and destroy through heartbeat commands

2019-10-24 Thread GitBox
ChenSammi edited a comment on issue #29: HDDS-2034. Async RATIS pipeline creation and destroy through heartbeat commands URL: https://github.com/apache/hadoop-ozone/pull/29#issuecomment-546182226 Fix failed TestSCMPipelineManager.java. Other failed UT and integration test are either not r

[GitHub] [hadoop-ozone] ChenSammi commented on issue #29: HDDS-2034. Async RATIS pipeline creation and destroy through heartbeat commands

2019-10-24 Thread GitBox
ChenSammi commented on issue #29: HDDS-2034. Async RATIS pipeline creation and destroy through heartbeat commands URL: https://github.com/apache/hadoop-ozone/pull/29#issuecomment-546182226 Fix failed TestSCMPipelineManager.java. Other failed UT and integration test are either not relevant

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s…

2019-10-24 Thread GitBox
bharatviswa504 commented on a change in pull request #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s… URL: https://github.com/apache/hadoop-ozone/pull/40#discussion_r338868517 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/Xceiv

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-10-24 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/485/ No changes - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache

Re: Reminder: APAC Hadoop storage community sync

2019-10-24 Thread Wei-Chiu Chuang
Yesterday's notes: https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit#heading=h.sgy1m4sxusyv 10/23/2019 Attendee: Weichiu, Fei Hui, Didi: a few clusters are upgraded to Hadoop 3.2. The largest production cluster will be the next. Testing Erasure Coding with deco

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Ayush Saxena
Thanx Akira for putting this up. +1, Makes sense removing. -Ayush > On 25-Oct-2019, at 6:55 AM, Dinesh Chitlangia > wrote: > > +1 and Anu's approach of creating a tag makes sense. > > Dinesh > > > > >> On Thu, Oct 24, 2019 at 9:24 PM Sunil Govindan wrote: >> >> +1 on this to remove stal

[GitHub] [hadoop-ozone] dineshchitlangia commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
dineshchitlangia commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#issuecomment-546164220 @bharatviswa504 Thanks for quick turn around. I verified in my local and seems fine. +1 pending C

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
bharatviswa504 commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#issuecomment-546163973 /retest This is an automated messa

[GitHub] [hadoop-ozone] bharatviswa504 closed pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
bharatviswa504 closed pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71 This is an automated message from the Apache Git Servic

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
bharatviswa504 opened a new pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71 …quests. ## What changes were proposed in this pull request? OMVolumeCreateRequest.java L159: o

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
bharatviswa504 commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#issuecomment-546163737 > > Thank You @xiaoyuyao for the review. > > Test failure in OzoneNativeAuthorizer is failing now

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Dinesh Chitlangia
+1 and Anu's approach of creating a tag makes sense. Dinesh On Thu, Oct 24, 2019 at 9:24 PM Sunil Govindan wrote: > +1 on this to remove staleness. > > - Sunil > > On Thu, Oct 24, 2019 at 12:51 PM Akira Ajisaka > wrote: > > > Hi folks, > > > > Both Ozone and Apache Submarine have separate r

[GitHub] [hadoop-ozone] dineshchitlangia commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
dineshchitlangia commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#issuecomment-546162321 > Thank You @xiaoyuyao for the review. > Test failure in OzoneNativeAuthorizer is failing now,

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Sunil Govindan
+1 on this to remove staleness. - Sunil On Thu, Oct 24, 2019 at 12:51 PM Akira Ajisaka wrote: > Hi folks, > > Both Ozone and Apache Submarine have separate repositories. > Can we remove these modules from hadoop-trunk? > > Regards, > Akira >

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
bharatviswa504 commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#issuecomment-546161487 Thank You @xiaoyuyao for the review. Test failure in OzoneNativeAuthorizer is failing now, as we

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Wangda Tan
+1, we should do that earlier than later. It is a code change that I think we don't need to wait for 7 days vote. On Thu, Oct 24, 2019 at 4:18 PM Anu Engineer wrote: > +1 for Ozone. We are in our own repo now. It would be good to remove this > code from Hadoop, otherwise it will confuse new cont

Re: [DISCUSS] Enable github security notifications to all Hadoop committers

2019-10-24 Thread Giovanni Matteo Fumarola
+1 On Thu, Oct 24, 2019 at 12:07 AM Akira Ajisaka wrote: > Thanks Wei-Chiu for starting the discussion, > > +1 > > > I already have hundreds of incoming emails > from various Hadoop alias each day so I don't mind adding a few more. > > Completely agreed. > > -Akira > > On Thu, Oct 24, 2019 at 3:

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Anu Engineer
+1 for Ozone. We are in our own repo now. It would be good to remove this code from Hadoop, otherwise it will confuse new contributors. I would like to add a git tag tro Hadoop, so that people have the ability to sync back and see the code evolution. --Anu On Thu, Oct 24, 2019 at 4:03 PM Giovanni

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Giovanni Matteo Fumarola
+1 Thanks Wei-Chiu for creating HADOOP-16670. On Thu, Oct 24, 2019 at 12:56 PM Wei-Chiu Chuang wrote: > +1 filed HADOOP-16670 > for > stripping the Submarine code. > > On Thu, Oct 24, 2019 at 12:14 PM Subru Krishnan wrote: > > > +1. > > > >

[GitHub] [hadoop-ozone] smengcl commented on issue #9: HDDS-2240. Command line tool for OM Admin

2019-10-24 Thread GitBox
smengcl commented on issue #9: HDDS-2240. Command line tool for OM Admin URL: https://github.com/apache/hadoop-ozone/pull/9#issuecomment-546128373 1. Compilation passed with `mvn clean install -DskipTests=true -Dmaven.javadoc.skip=true` 2. Checked `./hadoop-ozone/dist/target/ozone-0.5.0-

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #4: HDDS-2071. Support filters in ozone insight point

2019-10-24 Thread GitBox
xiaoyuyao merged pull request #4: HDDS-2071. Support filters in ozone insight point URL: https://github.com/apache/hadoop-ozone/pull/4 This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [hadoop-ozone] xiaoyuyao commented on issue #4: HDDS-2071. Support filters in ozone insight point

2019-10-24 Thread GitBox
xiaoyuyao commented on issue #4: HDDS-2071. Support filters in ozone insight point URL: https://github.com/apache/hadoop-ozone/pull/4#issuecomment-546119025 +1, Thanks @elek for adding this and @adoroszlai for the reviews. T

[jira] [Resolved] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-24 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-2356. -- Resolution: Fixed This will be fixed as part of HDDS-2322. > Multipart upload report er

[GitHub] [hadoop-ozone] xiaoyuyao commented on issue #83: HDDS-2360. Update Ratis snapshot to d6d58d0

2019-10-24 Thread GitBox
xiaoyuyao commented on issue #83: HDDS-2360. Update Ratis snapshot to d6d58d0 URL: https://github.com/apache/hadoop-ozone/pull/83#issuecomment-546112572 +1 pending CI. This is an automated message from the Apache Git Service.

[GitHub] [hadoop-ozone] xiaoyuyao commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
xiaoyuyao commented on issue #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#issuecomment-546112181 +1 pending CI. Thanks @bharatviswa504 for the offline discussion and update.

[jira] [Created] (HDDS-2362) XCeiverClientManager issues

2019-10-24 Thread Istvan Fajth (Jira)
Istvan Fajth created HDDS-2362: -- Summary: XCeiverClientManager issues Key: HDDS-2362 URL: https://issues.apache.org/jira/browse/HDDS-2362 Project: Hadoop Distributed Data Store Issue Type: Impro

[jira] [Resolved] (HDFS-14932) XCeiverClientManager issues

2019-10-24 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth resolved HDFS-14932. - Resolution: Invalid Sorry I meant to create this one in HDDS project, closing this one, as I can

[jira] [Created] (HDFS-14932) XCeiverClientManager issues

2019-10-24 Thread Istvan Fajth (Jira)
Istvan Fajth created HDFS-14932: --- Summary: XCeiverClientManager issues Key: HDFS-14932 URL: https://issues.apache.org/jira/browse/HDFS-14932 Project: Hadoop HDFS Issue Type: Bug Rep

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#discussion_r338793028 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/o

[jira] [Created] (HDDS-2361) Ozone Manager init & start command prints out unnecessary line in the beginning.

2019-10-24 Thread Aravindan Vijayan (Jira)
Aravindan Vijayan created HDDS-2361: --- Summary: Ozone Manager init & start command prints out unnecessary line in the beginning. Key: HDDS-2361 URL: https://issues.apache.org/jira/browse/HDDS-2361 Pr

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
xiaoyuyao commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#discussion_r338778482 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/hel

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #83: HDDS-2360. Update Ratis snapshot to d6d58d0

2019-10-24 Thread GitBox
adoroszlai opened a new pull request #83: HDDS-2360. Update Ratis snapshot to d6d58d0 URL: https://github.com/apache/hadoop-ozone/pull/83 ## What changes were proposed in this pull request? Update Ratis dependency version to snapshot [d6d58d0](https://github.com/apache/incubator-rat

[jira] [Created] (HDFS-14931) hdfs crypto commands limit column width

2019-10-24 Thread Eric Badger (Jira)
Eric Badger created HDFS-14931: -- Summary: hdfs crypto commands limit column width Key: HDFS-14931 URL: https://issues.apache.org/jira/browse/HDFS-14931 Project: Hadoop HDFS Issue Type: Bug

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Wei-Chiu Chuang
+1 filed HADOOP-16670 for stripping the Submarine code. On Thu, Oct 24, 2019 at 12:14 PM Subru Krishnan wrote: > +1. > > Thanks, > Subru > > On Thu, Oct 24, 2019 at 12:51 AM 张铎(Duo Zhang) > wrote: > > > +1 > > > > Akira Ajisaka 于2019年10月24日周

Fwd: Cloud Recording - HDFS sync is now available

2019-10-24 Thread Wei-Chiu Chuang
This today's HDFS sync recording. Siyao's Dynamometer presentation starts at around 18th minute. -- Forwarded message - From: Zoom Date: Thu, Oct 24, 2019 at 12:19 PM Subject: Cloud Recording - HDFS sync is now available To: Hi Wei-Chiu Chuang, Your cloud recording is now avai

[jira] [Created] (HDDS-2360) Update Ratis snapshot to d6d58d0

2019-10-24 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2360: -- Summary: Update Ratis snapshot to d6d58d0 Key: HDDS-2360 URL: https://issues.apache.org/jira/browse/HDDS-2360 Project: Hadoop Distributed Data Store Issu

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#discussion_r338750907 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Subru Krishnan
+1. Thanks, Subru On Thu, Oct 24, 2019 at 12:51 AM 张铎(Duo Zhang) wrote: > +1 > > Akira Ajisaka 于2019年10月24日周四 下午3:21写道: > > > Hi folks, > > > > Both Ozone and Apache Submarine have separate repositories. > > Can we remove these modules from hadoop-trunk? > > > > Regards, > > Akira > > >

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode

2019-10-24 Thread GitBox
xiaoyuyao commented on a change in pull request #28: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop-ozone/pull/28#discussion_r338740381 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/states/

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#discussion_r338717238 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
bharatviswa504 commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#discussion_r338717238 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
xiaoyuyao commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#discussion_r338715495 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone

[GitHub] [hadoop-ozone] dineshchitlangia commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests.

2019-10-24 Thread GitBox
dineshchitlangia commented on a change in pull request #71: HDDS-2344. Add immutable entries in to the DoubleBuffer for Volume requests. URL: https://github.com/apache/hadoop-ozone/pull/71#discussion_r338695659 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoo

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s…

2019-10-24 Thread GitBox
hanishakoneru commented on issue #40: HDDS-2285. GetBlock and ReadChunk command from the client should be s… URL: https://github.com/apache/hadoop-ozone/pull/40#issuecomment-546014078 Thanks for the review @bshashikant . I updated the patch to address your comment. I am caching the DN pe

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #82: HDDS-2359. Seeking randomly in a key with more than 2 blocks of data leads to inconsistent reads

2019-10-24 Thread GitBox
hanishakoneru commented on issue #82: HDDS-2359. Seeking randomly in a key with more than 2 blocks of data leads to inconsistent reads URL: https://github.com/apache/hadoop-ozone/pull/82#issuecomment-546006006 Thank you @bshashikant for working on this. LGTM. +1 pending CI.

[GitHub] [hadoop-ozone] lokeshj1703 commented on a change in pull request #29: HDDS-2034. Async RATIS pipeline creation and destroy through heartbeat commands

2019-10-24 Thread GitBox
lokeshj1703 commented on a change in pull request #29: HDDS-2034. Async RATIS pipeline creation and destroy through heartbeat commands URL: https://github.com/apache/hadoop-ozone/pull/29#discussion_r338650934 ## File path: hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds

[GitHub] [hadoop-ozone] lokeshj1703 commented on a change in pull request #29: HDDS-2034. Async RATIS pipeline creation and destroy through heartbeat commands

2019-10-24 Thread GitBox
lokeshj1703 commented on a change in pull request #29: HDDS-2034. Async RATIS pipeline creation and destroy through heartbeat commands URL: https://github.com/apache/hadoop-ozone/pull/29#discussion_r338657486 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds

[GitHub] [hadoop-ozone] lokeshj1703 commented on a change in pull request #29: HDDS-2034. Async RATIS pipeline creation and destroy through heartbeat commands

2019-10-24 Thread GitBox
lokeshj1703 commented on a change in pull request #29: HDDS-2034. Async RATIS pipeline creation and destroy through heartbeat commands URL: https://github.com/apache/hadoop-ozone/pull/29#discussion_r338619918 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds

[GitHub] [hadoop-ozone] lokeshj1703 commented on a change in pull request #29: HDDS-2034. Async RATIS pipeline creation and destroy through heartbeat commands

2019-10-24 Thread GitBox
lokeshj1703 commented on a change in pull request #29: HDDS-2034. Async RATIS pipeline creation and destroy through heartbeat commands URL: https://github.com/apache/hadoop-ozone/pull/29#discussion_r338640936 ## File path: hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds

[GitHub] [hadoop-ozone] bshashikant opened a new pull request #82: HDDS-2359. Seeking randomly in a key with more than 2 blocks of data leads to inconsistent reads

2019-10-24 Thread GitBox
bshashikant opened a new pull request #82: HDDS-2359. Seeking randomly in a key with more than 2 blocks of data leads to inconsistent reads URL: https://github.com/apache/hadoop-ozone/pull/82 ## What changes were proposed in this pull request? The issue was primarily caused when

[GitHub] [hadoop-ozone] arp7 merged pull request #79: HDDS-2357. Add replication factor option to new Freon tests

2019-10-24 Thread GitBox
arp7 merged pull request #79: HDDS-2357. Add replication factor option to new Freon tests URL: https://github.com/apache/hadoop-ozone/pull/79 This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [hadoop-ozone] arp7 merged pull request #78: HDDS-2358. Change to replication factor THREE in acceptance tests

2019-10-24 Thread GitBox
arp7 merged pull request #78: HDDS-2358. Change to replication factor THREE in acceptance tests URL: https://github.com/apache/hadoop-ozone/pull/78 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop-ozone] arp7 merged pull request #7: HDDS-1228. Chunk Scanner Checkpoints

2019-10-24 Thread GitBox
arp7 merged pull request #7: HDDS-1228. Chunk Scanner Checkpoints URL: https://github.com/apache/hadoop-ozone/pull/7 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop-ozone] fapifta commented on issue #81: HDDS-2347 XCeiverClientGrpc's parallel use leads to NPE

2019-10-24 Thread GitBox
fapifta commented on issue #81: HDDS-2347 XCeiverClientGrpc's parallel use leads to NPE URL: https://github.com/apache/hadoop-ozone/pull/81#issuecomment-545899019 /label ozone This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] fapifta opened a new pull request #81: HDDS-2347 XCeiverClientGrpc's parallel use leads to NPE

2019-10-24 Thread GitBox
fapifta opened a new pull request #81: HDDS-2347 XCeiverClientGrpc's parallel use leads to NPE URL: https://github.com/apache/hadoop-ozone/pull/81 ## What changes were proposed in this pull request? We found this issue during Hive TPCDS tests, the basis of the problem is that Hive start

[jira] [Created] (HDDS-2359) Seeking randomly in a key with more than 2 blocks of data leads to inconsistent reads

2019-10-24 Thread Istvan Fajth (Jira)
Istvan Fajth created HDDS-2359: -- Summary: Seeking randomly in a key with more than 2 blocks of data leads to inconsistent reads Key: HDDS-2359 URL: https://issues.apache.org/jira/browse/HDDS-2359 Project

[jira] [Created] (HDFS-14930) [Dynamometer] EC files become missing block groups

2019-10-24 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-14930: --- Summary: [Dynamometer] EC files become missing block groups Key: HDFS-14930 URL: https://issues.apache.org/jira/browse/HDFS-14930 Project: Hadoop HDFS

[GitHub] [hadoop-ozone] cxorm opened a new pull request #80: HDDS-1701. Move dockerbin script to libexec.

2019-10-24 Thread GitBox
cxorm opened a new pull request #80: HDDS-1701. Move dockerbin script to libexec. URL: https://github.com/apache/hadoop-ozone/pull/80 ## What changes were proposed in this pull request? Relocate the docker scripts in dist. (from ```bin/docker/``` to ```libexec/```) ## What

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #78: HDDS-2358. Change to replication factor THREE in acceptance tests

2019-10-24 Thread GitBox
adoroszlai opened a new pull request #78: HDDS-2358. Change to replication factor THREE in acceptance tests URL: https://github.com/apache/hadoop-ozone/pull/78 ## What changes were proposed in this pull request? Let acceptance tests exercise 3-node replication. https://issues.

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #79: HDDS-2357. Add replication factor option to new Freon tests

2019-10-24 Thread GitBox
adoroszlai opened a new pull request #79: HDDS-2357. Add replication factor option to new Freon tests URL: https://github.com/apache/hadoop-ozone/pull/79 ## What changes were proposed in this pull request? New Freon generators (OCKG and OKG) use fixed replication factor of 3. Somet

[jira] [Created] (HDFS-14929) Hadoop 2.9.1 rename functionality infrequent breaking

2019-10-24 Thread abhishek sahani (Jira)
abhishek sahani created HDFS-14929: -- Summary: Hadoop 2.9.1 rename functionality infrequent breaking Key: HDFS-14929 URL: https://issues.apache.org/jira/browse/HDFS-14929 Project: Hadoop HDFS

[jira] [Created] (HDDS-2358) Change to replication factor THREE in acceptance tests

2019-10-24 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2358: -- Summary: Change to replication factor THREE in acceptance tests Key: HDDS-2358 URL: https://issues.apache.org/jira/browse/HDDS-2358 Project: Hadoop Distributed Dat

[jira] [Created] (HDDS-2357) Add replication factor option to new Freon tests

2019-10-24 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2357: -- Summary: Add replication factor option to new Freon tests Key: HDDS-2357 URL: https://issues.apache.org/jira/browse/HDDS-2357 Project: Hadoop Distributed Data Stor

[jira] [Created] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-24 Thread Li Cheng (Jira)
Li Cheng created HDDS-2356: -- Summary: Multipart upload report errors while writing to ozone Ratis pipeline Key: HDDS-2356 URL: https://issues.apache.org/jira/browse/HDDS-2356 Project: Hadoop Distributed Data

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Duo Zhang
+1 Akira Ajisaka 于2019年10月24日周四 下午3:21写道: > Hi folks, > > Both Ozone and Apache Submarine have separate repositories. > Can we remove these modules from hadoop-trunk? > > Regards, > Akira >

[DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Akira Ajisaka
Hi folks, Both Ozone and Apache Submarine have separate repositories. Can we remove these modules from hadoop-trunk? Regards, Akira

Re: [DISCUSS] Enable github security notifications to all Hadoop committers

2019-10-24 Thread Akira Ajisaka
Thanks Wei-Chiu for starting the discussion, +1 > I already have hundreds of incoming emails from various Hadoop alias each day so I don't mind adding a few more. Completely agreed. -Akira On Thu, Oct 24, 2019 at 3:48 PM Bharat Viswanadham wrote: > +1 (binding). I am interested in receiving