Re: [PR] HDDS-9751. [hsync] Make Putblock performance acceptable - DataNode side [ozone]

2024-01-16 Thread via GitHub
jojochuang commented on code in PR #5662: URL: https://github.com/apache/ozone/pull/5662#discussion_r1454869654 ## hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeStoreSchemaThreeImpl.java: ## @@ -224,4 +235,185 @@ public void compa

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807620#comment-17807620 ] Janus Chow commented on HDDS-10137: --- I think this one can be closed and we can focus on

Re: [PR] HDDS-10138. NPE for SstFilteringService in OMDBCheckpointServlet.Lock [ozone]

2024-01-16 Thread via GitHub
symious commented on PR #6015: URL: https://github.com/apache/ozone/pull/6015#issuecomment-1895272750 If it's for null check, can we change to use `Optional`? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807618#comment-17807618 ] Ivan Andika commented on HDDS-10137: [~deveshsingh] We can probably close this once H

[jira] [Updated] (HDDS-7557) Translate "Merge Container RocksDB in DN" doc into Mandarin Chinese

2024-01-16 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-7557: --- Description: This is the "Merge Container RocksDB in DN" doc in the nightly build: https://oz

[jira] [Updated] (HDDS-7558) Translate "Topology awareness" doc into Mandarin Chinese

2024-01-16 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-7558: --- Description: This is the "Topology awareness" doc in the nightly build: https://ozone.apache.

Re: [PR] HDDS-9751. [hsync] Make Putblock performance acceptable - DataNode side [ozone]

2024-01-16 Thread via GitHub
jojochuang commented on code in PR #5662: URL: https://github.com/apache/ozone/pull/5662#discussion_r1454844418 ## hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/keyvalue/impl/TestBlockManagerImpl.java: ## @@ -225,4 +230,173 @@ public void testList

Re: [PR] HDDS-9751. [hsync] Make Putblock performance acceptable - DataNode side [ozone]

2024-01-16 Thread via GitHub
jojochuang commented on code in PR #5662: URL: https://github.com/apache/ozone/pull/5662#discussion_r1454839540 ## hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeStoreSchemaThreeImpl.java: ## @@ -224,4 +235,168 @@ public void compa

[jira] [Updated] (HDDS-7557) Translate "Merge Container RocksDB in DN" doc into Mandarin Chinese

2024-01-16 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-7557: --- Description: This is the "Merge Container RocksDB in DN" doc in the nightly build: https://oz

[jira] [Updated] (HDDS-7558) Translate "Topology awareness" doc into Mandarin Chinese

2024-01-16 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-7558: --- Description: This is the "Topology awareness" doc in the nightly build: https://ozone.apache.

Re: [PR] HDDS-9751. [hsync] Make Putblock performance acceptable - DataNode side [ozone]

2024-01-16 Thread via GitHub
jojochuang commented on PR #5662: URL: https://github.com/apache/ozone/pull/5662#issuecomment-1895240765 Yes HDDS-9753 is the catch-all for handling incremental chunk lists in other operations. -- This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Created] (HDDS-10141) [hsync]Support hard limit and auto recovery for hsync file

2024-01-16 Thread Ashish Kumar (Jira)
Ashish Kumar created HDDS-10141: --- Summary: [hsync]Support hard limit and auto recovery for hsync file Key: HDDS-10141 URL: https://issues.apache.org/jira/browse/HDDS-10141 Project: Apache Ozone

Re: [PR] HDDS-10119. Assertions on object creationTime fail with Java 17 [ozone]

2024-01-16 Thread via GitHub
adoroszlai commented on PR #6008: URL: https://github.com/apache/ozone/pull/6008#issuecomment-1895228348 Thanks @sodonnel for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[jira] [Updated] (HDDS-10119) Assertions on object creationTime fail with Java 17

2024-01-16 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-10119: Fix Version/s: 1.5.0 Resolution: Fixed Status: Resolved (was: Patch Avail

Re: [PR] HDDS-10119. Assertions on object creationTime fail with Java 17 [ozone]

2024-01-16 Thread via GitHub
adoroszlai merged PR #6008: URL: https://github.com/apache/ozone/pull/6008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

Re: [PR] HDDS-10108. [hsync] Adopt RATIS-1994 to reduce hsync latency [ozone]

2024-01-16 Thread via GitHub
jojochuang commented on code in PR #6014: URL: https://github.com/apache/ozone/pull/6014#discussion_r1454789632 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java: ## @@ -589,7 +589,7 @@ private void handleFlushInternal(boolean close)

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Devesh Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807605#comment-17807605 ] Devesh Kumar Singh commented on HDDS-10137: --- [~ivanandika] As you mentioned tha

Re: [PR] HDDS-10134. ManagedReadOptions is not closed properly [ozone]

2024-01-16 Thread via GitHub
adoroszlai commented on PR #6013: URL: https://github.com/apache/ozone/pull/6013#issuecomment-1895219695 > Is the error happening with the latest code on master? Yes. > Also, is there a full log file of the test failure? Attached to HDDS-10134. I don't see any errors in

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807604#comment-17807604 ] Ivan Andika commented on HDDS-10137: [~wanghongbing] Thanks for the verification. >

[jira] [Updated] (HDDS-10134) ManagedReadOptions is not closed properly

2024-01-16 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-10134: Attachment: org.apache.hadoop.fs.ozone.TestRootedDDSWithFSO.txt org.apache.h

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Hongbing Wang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807602#comment-17807602 ] Hongbing Wang commented on HDDS-10137: -- Maybe there's no need to block 1.4.0-RC1 ?

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Hongbing Wang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807596#comment-17807596 ] Hongbing Wang commented on HDDS-10137: -- {quote}Could you try setting ozone.filesyste

Re: [PR] Hdds 7593 rebase [ozone]

2024-01-16 Thread via GitHub
jojochuang closed pull request #6017: Hdds 7593 rebase URL: https://github.com/apache/ozone/pull/6017 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: is

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807565#comment-17807565 ] Ivan Andika edited comment on HDDS-10137 at 1/17/24 7:03 AM: -

[jira] [Updated] (HDDS-10139) Support to get hosts from file when decommissioning or recommissioning DNs.

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-10139: -- Labels: pull-request-available (was: ) > Support to get hosts from file when decommissioning o

[PR] HDDS-10139. Support to get hosts from file when decommissioning or recommissioning DNs. [ozone]

2024-01-16 Thread via GitHub
YuanbenWang opened a new pull request, #6019: URL: https://github.com/apache/ozone/pull/6019 ## What changes were proposed in this pull request? When decommissioning or recommissioning a large number of DNs, current command will be so long because a long list of hosts must be included

Re: [PR] HDDS-9967. Intermittent failure in TestOzoneRpcClientAbstract.testListSnapshot. [ozone]

2024-01-16 Thread via GitHub
sumitagrawl commented on PR #5970: URL: https://github.com/apache/ozone/pull/5970#issuecomment-1895070533 > I have a minor nitpicky comment on the iterator initialization. You can make the changes if you feel it is good. I think above explaination gives why null value key is requried

Re: [PR] HDDS-9967. Intermittent failure in TestOzoneRpcClientAbstract.testListSnapshot. [ozone]

2024-01-16 Thread via GitHub
sumitagrawl commented on code in PR #5970: URL: https://github.com/apache/ozone/pull/5970#discussion_r1454711047 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ListIterator.java: ## @@ -236,14 +241,38 @@ private void populateCacheMap(Iterator, }

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807555#comment-17807555 ] Ivan Andika edited comment on HDDS-10137 at 1/17/24 6:31 AM: -

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807555#comment-17807555 ] Ivan Andika edited comment on HDDS-10137 at 1/17/24 6:31 AM: -

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807573#comment-17807573 ] Ivan Andika commented on HDDS-10137: [~deveshsingh] We should do nullity check on sst

Re: [PR] HDDS-10138. NPE for SstFilteringService in OMDBCheckpointServlet.Lock [ozone]

2024-01-16 Thread via GitHub
ivandika3 commented on PR #6015: URL: https://github.com/apache/ozone/pull/6015#issuecomment-1895021924 We might also need to synchronize the `lock` and `unlock` to prevent possible deadlock. -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Devesh Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807570#comment-17807570 ] Devesh Kumar Singh commented on HDDS-10137: --- [~ivanandika] As [~sammichen] ment

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807568#comment-17807568 ] Ivan Andika commented on HDDS-10137: [~wanghongbing] Could you try setting ozone.file

Re: [PR] HDDS-10138. NPE for SstFilteringService in OMDBCheckpointServlet.Lock [ozone]

2024-01-16 Thread via GitHub
ivandika3 commented on PR #6015: URL: https://github.com/apache/ozone/pull/6015#issuecomment-1895007199 @GeorgeJahad @ChenSammi @symious Could you help to review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Hongbing Wang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807566#comment-17807566 ] Hongbing Wang commented on HDDS-10137: -- [~ivanandika]  Hi, can this error be reprodu

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807565#comment-17807565 ] Ivan Andika commented on HDDS-10137: [~sammichen] I restarted the OMs with ozone.file

Re: [PR] HDDS-10085. Improve Method Name in ContainerBalancerSelectionCriteria [ozone]

2024-01-16 Thread via GitHub
siddhantsangwan commented on PR #5957: URL: https://github.com/apache/ozone/pull/5957#issuecomment-1894995553 Thanks @adoroszlai for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[jira] [Assigned] (HDDS-10122) GSON requires tweaks for Java 17

2024-01-16 Thread Devesh Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devesh Kumar Singh reassigned HDDS-10122: - Assignee: Mohammad Arafat Khan > GSON requires tweaks for Java 17 >

[jira] [Assigned] (HDDS-10121) GenericTestUtils.getFieldReflection fails with Java 17

2024-01-16 Thread Devesh Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devesh Kumar Singh reassigned HDDS-10121: - Assignee: Devesh Kumar Singh > GenericTestUtils.getFieldReflection fails with Ja

[jira] [Assigned] (HDDS-10120) BindException in integration tests with Java 17

2024-01-16 Thread Devesh Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devesh Kumar Singh reassigned HDDS-10120: - Assignee: Devesh Kumar Singh > BindException in integration tests with Java 17 >

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807555#comment-17807555 ] Ivan Andika edited comment on HDDS-10137 at 1/17/24 5:59 AM: -

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807539#comment-17807539 ] Ivan Andika edited comment on HDDS-10137 at 1/17/24 5:57 AM: -

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807537#comment-17807537 ] Ivan Andika edited comment on HDDS-10137 at 1/17/24 5:54 AM: -

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807539#comment-17807539 ] Ivan Andika edited comment on HDDS-10137 at 1/17/24 5:54 AM: -

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807555#comment-17807555 ] Ivan Andika commented on HDDS-10137: > by default SstFilteringService is enabled and

Re: [PR] HDDS-9944. NSSummary commands should close OzoneClient. [ozone]

2024-01-16 Thread via GitHub
devmadhuu commented on PR #6018: URL: https://github.com/apache/ozone/pull/6018#issuecomment-1894981605 @adoroszlai Pls review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[jira] [Updated] (HDDS-9944) NSSummary commands should close OzoneClient

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-9944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-9944: - Labels: newbie pull-request-available (was: newbie) > NSSummary commands should close OzoneClient

[jira] [Assigned] (HDDS-10053) DataNode should not build audit parameters unnecessarily

2024-01-16 Thread Krishna Kumar Asawa (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar Asawa reassigned HDDS-10053: -- Assignee: Mohammad Arafat Khan > DataNode should not build audit parameters un

[jira] [Assigned] (HDDS-10132) TestStorageContainerManager.testScmProcessDatanodeHeartbeat fails with Java 17

2024-01-16 Thread Krishna Kumar Asawa (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar Asawa reassigned HDDS-10132: -- Assignee: Mohammad Arafat Khan > TestStorageContainerManager.testScmProcessDat

[jira] [Commented] (HDDS-9840) ozone freon dfsg takes very long time when HSYNC is enabled

2024-01-16 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807553#comment-17807553 ] Wei-Chiu Chuang commented on HDDS-9840: --- According to HDDS-9752 this one will be add

[jira] [Assigned] (HDDS-9840) ozone freon dfsg takes very long time when HSYNC is enabled

2024-01-16 Thread Krishna Kumar Asawa (Jira)
[ https://issues.apache.org/jira/browse/HDDS-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar Asawa reassigned HDDS-9840: - Assignee: Ashish Kumar > ozone freon dfsg takes very long time when HSYNC is enab

[jira] [Resolved] (HDDS-6925) Atomic renames behavior with OBJECT_STORE not as expected

2024-01-16 Thread Hemant Kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemant Kumar resolved HDDS-6925. Resolution: Duplicate It has been fixed in HDDS-6924. Resolving this. Please feel free to reopen if

[jira] [Resolved] (HDDS-9707) Intermittent NO_REPLICA_FOUND errors caused by OM pipeline cache

2024-01-16 Thread Hemant Kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-9707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemant Kumar resolved HDDS-9707. Resolution: Duplicate It has been fixed in HDDS-9709, Closing this for now. Feel free to reopen if

[jira] [Assigned] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Krishna Kumar Asawa (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar Asawa reassigned HDDS-10137: -- Assignee: Devesh Kumar Singh > OM DB snapshot unable to be downloaded > --

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807545#comment-17807545 ] Sammi Chen edited comment on HDDS-10137 at 1/17/24 5:02 AM: I

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807545#comment-17807545 ] Sammi Chen edited comment on HDDS-10137 at 1/17/24 5:02 AM: I

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807548#comment-17807548 ] Sammi Chen commented on HDDS-10137: --- [~ivanandika] , is there "{color:#6a8759}Unable to

[jira] [Assigned] (HDDS-10136) Recon displaying DELETED container as missing

2024-01-16 Thread Krishna Kumar Asawa (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar Asawa reassigned HDDS-10136: -- Assignee: Mohammad Arafat Khan > Recon displaying DELETED container as missing

Re: [PR] HDDS-8492. Intermittent timeout in TestStorageContainerManager#testBlockDeletionTransactions. [ozone]

2024-01-16 Thread via GitHub
devmadhuu commented on code in PR #5928: URL: https://github.com/apache/ozone/pull/5928#discussion_r1454583274 ## hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/scm/TestStorageContainerManager.java: ## @@ -311,7 +324,7 @@ public void testBlockDeletionTransac

Re: [PR] HDDS-8492. Intermittent timeout in TestStorageContainerManager#testBlockDeletionTransactions. [ozone]

2024-01-16 Thread via GitHub
devmadhuu commented on code in PR #5928: URL: https://github.com/apache/ozone/pull/5928#discussion_r1454582259 ## hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/scm/TestStorageContainerManager.java: ## @@ -311,7 +324,7 @@ public void testBlockDeletionTransac

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807545#comment-17807545 ] Sammi Chen edited comment on HDDS-10137 at 1/17/24 4:37 AM: I

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807545#comment-17807545 ] Sammi Chen commented on HDDS-10137: --- In 1.4.0 branch, by default SstFilteringService is

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread George Jahad (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807542#comment-17807542 ] George Jahad commented on HDDS-10137: - There is a good chance this problem is entirel

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807541#comment-17807541 ] Ivan Andika edited comment on HDDS-10137 at 1/17/24 4:18 AM: -

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807541#comment-17807541 ] Ivan Andika edited comment on HDDS-10137 at 1/17/24 4:18 AM: -

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807541#comment-17807541 ] Ivan Andika edited comment on HDDS-10137 at 1/17/24 4:18 AM: -

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807541#comment-17807541 ] Ivan Andika commented on HDDS-10137: Probably the SstFilteringService NPE in OMDBChec

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807533#comment-17807533 ] Sammi Chen edited comment on HDDS-10137 at 1/17/24 4:17 AM: [

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807539#comment-17807539 ] Ivan Andika edited comment on HDDS-10137 at 1/17/24 4:15 AM: -

Re: [PR] HDDS-10140. [hsync] Rebase HDDS-7593 branch onto master [ozone]

2024-01-16 Thread via GitHub
jojochuang closed pull request #6016: HDDS-10140. [hsync] Rebase HDDS-7593 branch onto master URL: https://github.com/apache/ozone/pull/6016 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807539#comment-17807539 ] Ivan Andika edited comment on HDDS-10137 at 1/17/24 4:14 AM: -

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807539#comment-17807539 ] Ivan Andika commented on HDDS-10137: While not in an entirely new cluster, I also fou

[PR] Hdds 7593 rebase [ozone]

2024-01-16 Thread via GitHub
jojochuang opened a new pull request, #6017: URL: https://github.com/apache/ozone/pull/6017 ## What changes were proposed in this pull request? Rebase HDDS-7593 branch onto master ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-10140 ## Ho

[jira] [Created] (HDDS-10140) [hsync] Rebase HDDS-7593 branch onto master

2024-01-16 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDDS-10140: -- Summary: [hsync] Rebase HDDS-7593 branch onto master Key: HDDS-10140 URL: https://issues.apache.org/jira/browse/HDDS-10140 Project: Apache Ozone Issue Ty

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807533#comment-17807533 ] Sammi Chen edited comment on HDDS-10137 at 1/17/24 4:13 AM: [

[jira] [Updated] (HDDS-10140) [hsync] Rebase HDDS-7593 branch onto master

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-10140: -- Labels: pull-request-available (was: ) > [hsync] Rebase HDDS-7593 branch onto master > ---

[PR] HDDS-10140. [hsync] Rebase HDDS-7593 branch onto master [ozone]

2024-01-16 Thread via GitHub
jojochuang opened a new pull request, #6016: URL: https://github.com/apache/ozone/pull/6016 ## What changes were proposed in this pull request? Rebase HDDS-7593 branch onto master ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-10140 ## Ho

[jira] [Comment Edited] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807533#comment-17807533 ] Sammi Chen edited comment on HDDS-10137 at 1/17/24 4:11 AM: [

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807537#comment-17807537 ] Ivan Andika commented on HDDS-10137: [~sammichen] Thanks for checking this out. The

[jira] [Comment Edited] (HDDS-6925) Atomic renames behavior with OBJECT_STORE not as expected

2024-01-16 Thread Hemant Kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807536#comment-17807536 ] Hemant Kumar edited comment on HDDS-6925 at 1/17/24 4:02 AM: -

[jira] [Commented] (HDDS-6925) Atomic renames behavior with OBJECT_STORE not as expected

2024-01-16 Thread Hemant Kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807536#comment-17807536 ] Hemant Kumar commented on HDDS-6925: I tired on later master and seems like it has bee

Re: [PR] HDDS-10133. Add a method to check key name in OMKeyRequest [ozone]

2024-01-16 Thread via GitHub
jianghuazhu commented on code in PR #6012: URL: https://github.com/apache/ozone/pull/6012#discussion_r1454519923 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRequest.java: ## @@ -173,6 +174,16 @@ protected KeyArgs resolveBucketAndCheckO

[jira] [Updated] (HDDS-10138) NPE for SstFilteringService in OMDBCheckpointServlet.Lock

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-10138: -- Labels: pull-request-available (was: ) > NPE for SstFilteringService in OMDBCheckpointServlet.

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807533#comment-17807533 ] Sammi Chen commented on HDDS-10137: --- [~ivanandika] , I find the same recon error logs.

[jira] [Updated] (HDDS-10138) NPE for SstFilteringService in OMDBCheckpointServlet.Lock

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-10138: --- Description: Found when testing Ozone-1.4.0-rc1. If KeyManagerImpl# {code:java} 2024-01-17 10:56:29,3

[jira] [Updated] (HDDS-10138) NPE for SstFilteringService in OMDBCheckpointServlet.Lock

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-10138: --- Description: Found when testing Ozone-1.4.0-rc1. {code:java} 2024-01-17 10:56:29,321 [qtp3981395-71]

[jira] [Created] (HDDS-10139) Support to get hosts from file when decommissioning or recommissioning DNs.

2024-01-16 Thread WangYuanben (Jira)
WangYuanben created HDDS-10139: -- Summary: Support to get hosts from file when decommissioning or recommissioning DNs. Key: HDDS-10139 URL: https://issues.apache.org/jira/browse/HDDS-10139 Project: Apache

[jira] [Updated] (HDDS-10138) NPE for SstFilteringService in OMDBCheckpointServlet.Lock

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-10138: --- Description: Found when testing Ozone-1.4.0-rc1 {code:java} 2024-01-17 10:56:29,321 [qtp3981395-71] E

[jira] [Created] (HDDS-10138) NPE for SstFilteringService in OMDBCheckpointServlet.Lock

2024-01-16 Thread Ivan Andika (Jira)
Ivan Andika created HDDS-10138: -- Summary: NPE for SstFilteringService in OMDBCheckpointServlet.Lock Key: HDDS-10138 URL: https://issues.apache.org/jira/browse/HDDS-10138 Project: Apache Ozone Is

[jira] [Commented] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807531#comment-17807531 ] Ivan Andika commented on HDDS-10137: [~georgeJahad] Seems related to some Snapshot fe

[jira] [Updated] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-10137: --- Description: To test 1.4.0-rc1, I rebuild a new Ozone cluster to do some testing. After I initialize

[jira] [Updated] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-10137: --- Description: To test 1.4.0-rc1, I rebuild a new Ozone cluster to do some testing. After I initialize

[jira] [Created] (HDDS-10137) OM DB snapshot unable to be downloaded

2024-01-16 Thread Ivan Andika (Jira)
Ivan Andika created HDDS-10137: -- Summary: OM DB snapshot unable to be downloaded Key: HDDS-10137 URL: https://issues.apache.org/jira/browse/HDDS-10137 Project: Apache Ozone Issue Type: Bug

Re: [PR] HDDS-10133. Add a method to check key name in OMKeyRequest [ozone]

2024-01-16 Thread via GitHub
jianghuazhu commented on code in PR #6012: URL: https://github.com/apache/ozone/pull/6012#discussion_r1454406648 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRequest.java: ## @@ -173,6 +174,16 @@ protected KeyArgs resolveBucketAndCheckO

Re: [PR] HDDS-10134. ManagedReadOptions is not closed properly [ozone]

2024-01-16 Thread via GitHub
duongkame commented on PR #6013: URL: https://github.com/apache/ozone/pull/6013#issuecomment-1894818038 Is the error happening with the latest code on master? I don't think we're comfortable not understanding how this happens, tbh (I tried, but I couldn't comprehend it either). Also,

[PR] HDDS-10108. [hsync] Adopt RATIS-1994 to reduce hsync latency [ozone]

2024-01-16 Thread via GitHub
smengcl opened a new pull request, #6014: URL: https://github.com/apache/ozone/pull/6014 Do not merge. Requires Ratis 3.1.0. ## What changes were proposed in this pull request? Adopt the new Ratis API added in RATIS-1994 to (hopefully) reduce hsync latency. ## What is th

[jira] [Updated] (HDDS-10108) [hsync] adopt RATIS-1994 to reduce hsync latency once released

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-10108: -- Labels: pull-request-available (was: ) > [hsync] adopt RATIS-1994 to reduce hsync latency once

[jira] [Resolved] (HDDS-10107) Remove the static dbNameToCfHandleMap from RocksDatabase

2024-01-16 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HDDS-10107. --- Fix Version/s: 1.5.0 Resolution: Fixed The pull request is now merged. > Remove the static db

Re: [PR] HDDS-10107. Remove the static dbNameToCfHandleMap from RocksDatabase. [ozone]

2024-01-16 Thread via GitHub
szetszwo merged PR #5976: URL: https://github.com/apache/ozone/pull/5976 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apache

  1   2   >