[jira] [Updated] (HDDS-12108) Grafana Dashboard for visualizing commitindex across OMs

2025-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12108: -- Labels: pull-request-available (was: ) > Grafana Dashboard for visualizing commitindex across

Re: [PR] HDDS-12108. Grafana Dashboard for OM CommitIndex [ozone]

2025-01-22 Thread via GitHub
kerneltime commented on PR #7719: URL: https://github.com/apache/ozone/pull/7719#issuecomment-2608793261 Thank you for this! LGTM, make a change along the following line. 1. Each follower reports its index 2. The leader reports the follower index it knows about. Thus, the lea

[jira] [Updated] (HDDS-12123) PutObject using the latest awscli later than or equal to 1.37.0 is fail

2025-01-22 Thread Kohei Sugihara (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kohei Sugihara updated HDDS-12123: -- Description: S3G returns internal server errors (500) when we upload some files using awscli >

Re: [PR] HDDS-12114. Prevent delete commands running after a long lock wait and send ICR earlier [ozone]

2025-01-22 Thread via GitHub
sodonnel commented on PR #7726: URL: https://github.com/apache/ozone/pull/7726#issuecomment-2608396443 @errose28 I believe I have addressed the comments. Please have another check. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [PR] HDDS-12114. Prevent delete commands running after a long lock wait and send ICR earlier [ozone]

2025-01-22 Thread via GitHub
sodonnel commented on code in PR #7726: URL: https://github.com/apache/ozone/pull/7726#discussion_r1926036731 ## hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/OzoneConfigKeys.java: ## @@ -322,6 +322,11 @@ public final class OzoneConfigKeys { public static final Str

[jira] [Updated] (HDDS-12079) Improve container merkle tree write handling

2025-01-22 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose updated HDDS-12079: -- Description: * Rename {{ContainerMerkleTree}} to {{ContainerMerkleTreeWriter}} to better reflect its p

[jira] [Resolved] (HDDS-11077) Optimize checksum calculations in container merkle tree

2025-01-22 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose resolved HDDS-11077. --- Resolution: Done > Optimize checksum calculations in container merkle tree >

Re: [PR] HDDS-12114. Prevent delete commands running after a long lock wait and send ICR earlier [ozone]

2025-01-22 Thread via GitHub
errose28 commented on code in PR #7726: URL: https://github.com/apache/ozone/pull/7726#discussion_r1925933064 ## hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/keyvalue/TestKeyValueHandler.java: ## @@ -456,6 +459,68 @@ public void testDeleteContain

[jira] [Comment Edited] (HDDS-11345) Add metrics specific to reconciliation tasks

2025-01-22 Thread Aswin Shakil (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17915830#comment-17915830 ] Aswin Shakil edited comment on HDDS-11345 at 1/22/25 8:40 PM: -

[jira] [Comment Edited] (HDDS-11345) Add metrics specific to reconciliation tasks

2025-01-22 Thread Aswin Shakil (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17915830#comment-17915830 ] Aswin Shakil edited comment on HDDS-11345 at 1/22/25 8:37 PM: -

[jira] [Created] (HDDS-12129) Allow search engines to index the v2 website before launching it

2025-01-22 Thread Rishabh Patel (Jira)
Rishabh Patel created HDDS-12129: Summary: Allow search engines to index the v2 website before launching it Key: HDDS-12129 URL: https://issues.apache.org/jira/browse/HDDS-12129 Project: Apache Ozone

[jira] [Created] (HDDS-12128) Prevent under-construction v2 site from being indexed by web search engines

2025-01-22 Thread Rishabh Patel (Jira)
Rishabh Patel created HDDS-12128: Summary: Prevent under-construction v2 site from being indexed by web search engines Key: HDDS-12128 URL: https://issues.apache.org/jira/browse/HDDS-12128 Project: Ap

[jira] [Assigned] (HDDS-12128) Prevent under-construction v2 site from being indexed by web search engines

2025-01-22 Thread Rishabh Patel (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rishabh Patel reassigned HDDS-12128: Assignee: Rishabh Patel > Prevent under-construction v2 site from being indexed by web sea

[jira] [Created] (HDDS-12127) RM should not expire pending deletes, but retry instead.

2025-01-22 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-12127: Summary: RM should not expire pending deletes, but retry instead. Key: HDDS-12127 URL: https://issues.apache.org/jira/browse/HDDS-12127 Project: Apache Ozone

Re: [PR] HDDS-11626. Document short-circuit read feature [ozone]

2025-01-22 Thread via GitHub
errose28 commented on code in PR #7529: URL: https://github.com/apache/ozone/pull/7529#discussion_r1925723835 ## hadoop-hdds/docs/content/feature/Short-Circuit-Read.md: ## @@ -0,0 +1,78 @@ +--- +title: "Short Circuit Local Read in Datanode" +weight: 2 +menu: + main: + par

Re: [PR] HDDS-11946. Require all ozone repair commands to support a --dry-run option [ozone]

2025-01-22 Thread via GitHub
errose28 commented on PR #7682: URL: https://github.com/apache/ozone/pull/7682#issuecomment-2607840726 It looks like we will need to add tests individually, so I'm ok with just adding tests for `QuotaTrigger` dry run in this PR and merging it. We can use the other Jiras for adding dry run t

Re: [PR] HDDS-11946. Require all ozone repair commands to support a --dry-run option [ozone]

2025-01-22 Thread via GitHub
errose28 commented on code in PR #7682: URL: https://github.com/apache/ozone/pull/7682#discussion_r1925691360 ## hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/repair/om/FSORepairTool.java: ## @@ -359,15 +343,10 @@ private void handleUnreachableAndUnreferencedObjects(

[jira] [Commented] (HDDS-11939) Ratis Memory leak of DataStreamMapImpl when Stream write

2025-01-22 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17916119#comment-17916119 ] Tsz-wo Sze commented on HDDS-11939: --- [~XiChen], do you know if RATIS-2197 could fix thi

Re: [PR] HDDS-12114. Prevent delete commands running after a long lock wait and send ICR earlier [ozone]

2025-01-22 Thread via GitHub
errose28 commented on code in PR #7726: URL: https://github.com/apache/ozone/pull/7726#discussion_r1925679223 ## hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/KeyValueHandler.java: ## @@ -1521,8 +1547,8 @@ private void deleteInternal(Cont

Re: [PR] HDDS-11898. design doc leader side execution [ozone]

2025-01-22 Thread via GitHub
xichen01 commented on code in PR #7583: URL: https://github.com/apache/ozone/pull/7583#discussion_r1925551082 ## hadoop-hdds/docs/content/design/leader-execution/leader-execution.md: ## @@ -0,0 +1,477 @@ +--- +title: Ozone Leader Side Execution +summary: Ozone request execution

Re: [PR] HDDS-11837. Support executing multiple commands in Ozone CLI [ozone]

2025-01-22 Thread via GitHub
sodonnel commented on PR #7727: URL: https://github.com/apache/ozone/pull/7727#issuecomment-2607680874 > I guess batch mode should stop on first error. Yea, I think that makes sense, as often subsequent commands depend on earlier ones, or might have unexpected results if the earlier

Re: [PR] HDDS-11837. Support executing multiple commands in Ozone CLI [ozone]

2025-01-22 Thread via GitHub
adoroszlai commented on PR #7727: URL: https://github.com/apache/ozone/pull/7727#issuecomment-2607618551 > 1. If one command in a batch fails, what happens? Do the others keep executing or does it stop the batch? Yes, it keeps executing. The behavior is inherited from interactive she

Re: [PR] HDDS-11837. Support executing multiple commands in Ozone CLI [ozone]

2025-01-22 Thread via GitHub
sodonnel commented on PR #7727: URL: https://github.com/apache/ozone/pull/7727#issuecomment-2607573684 This looks very useful. A couple of questions: 1. If one command in a batch fails, what happens? Do the others keep executing or does it stop the batch? 2. What if commands have o

[jira] [Created] (HDDS-12126) Exercise https endpoints in acceptance tests

2025-01-22 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-12126: --- Summary: Exercise https endpoints in acceptance tests Key: HDDS-12126 URL: https://issues.apache.org/jira/browse/HDDS-12126 Project: Apache Ozone Issue

[jira] [Created] (HDDS-12125) Enable https in secure compose environments

2025-01-22 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-12125: --- Summary: Enable https in secure compose environments Key: HDDS-12125 URL: https://issues.apache.org/jira/browse/HDDS-12125 Project: Apache Ozone Issue

[jira] [Resolved] (HDDS-12075) Ozone debug read-replicas command fails when there is a slash character in key names

2025-01-22 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-12075. - Fix Version/s: 2.0.0 Resolution: Fixed > Ozone debug read-replicas command fails w

Re: [PR] HDDS-12057. Handle '/' in key names for the readreplicas command [ozone]

2025-01-22 Thread via GitHub
adoroszlai merged PR #7735: URL: https://github.com/apache/ozone/pull/7735 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

Re: [PR] HDDS-12057. Handle '/' in key names for the readreplicas command [ozone]

2025-01-22 Thread via GitHub
adoroszlai commented on PR #7735: URL: https://github.com/apache/ozone/pull/7735#issuecomment-2607500665 Thanks @ptlrs for the patch, @dombizita for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[jira] [Updated] (HDDS-12124) Disable resource filtering for VI swap files

2025-01-22 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-12124: Fix Version/s: 2.0.0 Resolution: Fixed Status: Resolved (was: Patch Avail

Re: [PR] HDDS-12124. Disable resource filtering for VI swap files [ozone]

2025-01-22 Thread via GitHub
adoroszlai commented on PR #7736: URL: https://github.com/apache/ozone/pull/7736#issuecomment-2607406660 Thanks @nandakumar131 for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] HDDS-12124. Disable resource filtering for VI swap files [ozone]

2025-01-22 Thread via GitHub
adoroszlai merged PR #7736: URL: https://github.com/apache/ozone/pull/7736 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

[jira] [Updated] (HDDS-12124) Disable resource filtering for VI swap files

2025-01-22 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-12124: Status: Patch Available (was: In Progress) > Disable resource filtering for VI swap files

[jira] [Assigned] (HDDS-12122) Add tests for SnapshotChainRepair

2025-01-22 Thread Peter Lee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Lee reassigned HDDS-12122: Assignee: Peter Lee > Add tests for SnapshotChainRepair > - > >

Re: [PR] HDDS-11763. Implement container repair logic within datanodes. [ozone]

2025-01-22 Thread via GitHub
peterxcli commented on code in PR #7474: URL: https://github.com/apache/ozone/pull/7474#discussion_r1925081978 ## hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/statemachine/DatanodeStateMachine.java: ## @@ -753,4 +754,8 @@ public DatanodeQu

[jira] [Updated] (HDDS-12124) Disable resource filtering for VI swap files

2025-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12124: -- Labels: pull-request-available (was: ) > Disable resource filtering for VI swap files > --

[PR] HDDS-12124. Disable resource filtering for VI swap files [ozone]

2025-01-22 Thread via GitHub
adoroszlai opened a new pull request, #7736: URL: https://github.com/apache/ozone/pull/7736 ## What changes were proposed in this pull request? Build fails when files from `hadoop-ozone/dist/src/main/compose` (or similar directories) are open in VI due to the binary swap files it crea

[jira] [Commented] (HDDS-11974) Split Container Safemode Rule into Ratis & EC Container Safemode Rules

2025-01-22 Thread Peter Lee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17916007#comment-17916007 ] Peter Lee commented on HDDS-11974: -- Hi [~nanda], May I take this? > Split Container Saf

Re: [PR] HDDS-11900. obs granular lock for existing request [ozone]

2025-01-22 Thread via GitHub
sumitagrawl commented on code in PR #7647: URL: https://github.com/apache/ozone/pull/7647#discussion_r1925066741 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/lock/KeyLock.java: ## @@ -0,0 +1,145 @@ +/** + * Licensed to the Apache Software Foundation (AS

Re: [PR] HDDS-11900. obs granular lock for existing request [ozone]

2025-01-22 Thread via GitHub
sumitagrawl commented on code in PR #7647: URL: https://github.com/apache/ozone/pull/7647#discussion_r1925063255 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/OMClientRequest.java: ## @@ -122,6 +123,13 @@ public OMRequest preExecute(OzoneManager

Re: [PR] HDDS-11900. obs granular lock for existing request [ozone]

2025-01-22 Thread via GitHub
sumitagrawl commented on code in PR #7647: URL: https://github.com/apache/ozone/pull/7647#discussion_r1925053459 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/lock/OmLockOpr.java: ## @@ -0,0 +1,268 @@ +/** + * Licensed to the Apache Software Foundation (

Re: [PR] HDDS-11900. obs granular lock for existing request [ozone]

2025-01-22 Thread via GitHub
sumitagrawl commented on code in PR #7647: URL: https://github.com/apache/ozone/pull/7647#discussion_r1925049236 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/file/OMDirectoryCreateRequest.java: ## @@ -121,6 +122,18 @@ public OMRequest preExecute

Re: [PR] HDDS-12114. Prevent delete commands running after a long lock wait and send ICR earlier [ozone]

2025-01-22 Thread via GitHub
sodonnel commented on code in PR #7726: URL: https://github.com/apache/ozone/pull/7726#discussion_r1924999115 ## hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/KeyValueHandler.java: ## @@ -1521,8 +1547,8 @@ private void deleteInternal(Cont

Re: [PR] HDDS-12114. Prevent delete commands running after a long lock wait and send ICR earlier [ozone]

2025-01-22 Thread via GitHub
sodonnel commented on code in PR #7726: URL: https://github.com/apache/ozone/pull/7726#discussion_r1924994584 ## hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/KeyValueHandler.java: ## @@ -1490,6 +1509,13 @@ private void deleteInternal(Con

[jira] [Updated] (HDDS-12123) PutObject using the latest awscli later than or equal to 1.37.0 is fail

2025-01-22 Thread Kohei Sugihara (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kohei Sugihara updated HDDS-12123: -- Description: S3G returns internal server errors (500) when we upload some files using awscli >

Re: [PR] HDDS-12116. Customizable Protobuf shaded prefix in ozonefs-hadoop3-client. [ozone]

2025-01-22 Thread via GitHub
myskov commented on PR #7729: URL: https://github.com/apache/ozone/pull/7729#issuecomment-2606633055 Thanks @apotheque for the patch! I think using the same JAR file but building it differently can cause issues: once built, we can't determine whether it was built for Spark or Trino. Woul

[jira] [Updated] (HDDS-12106) Enable sortpom in integration-test and fault-injection-test

2025-01-22 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-12106: Fix Version/s: 2.0.0 Resolution: Implemented Status: Resolved (was: Patch

[jira] [Created] (HDDS-12124) Disable resource filtering for VI swap files

2025-01-22 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-12124: --- Summary: Disable resource filtering for VI swap files Key: HDDS-12124 URL: https://issues.apache.org/jira/browse/HDDS-12124 Project: Apache Ozone Issue

[jira] [Resolved] (HDDS-11905) Sort POM

2025-01-22 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-11905. - Fix Version/s: 2.0.0 Resolution: Implemented > Sort POM > > >

Re: [PR] HDDS-12106. Enable sortpom in integration-test and fault-injection-test. [ozone]

2025-01-22 Thread via GitHub
nandakumar131 commented on PR #7734: URL: https://github.com/apache/ozone/pull/7734#issuecomment-2606594386 Thanks @adoroszlai for the quick review and merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[jira] [Updated] (HDDS-12123) PutObject using the latest awscli later than or equal to 1.37.0 is fail

2025-01-22 Thread Kohei Sugihara (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kohei Sugihara updated HDDS-12123: -- Description: S3G returns internal server errors (500) when we upload some files using awscli >

Re: [PR] HDDS-12106. Enable sortpom in integration-test and fault-injection-test. [ozone]

2025-01-22 Thread via GitHub
adoroszlai merged PR #7734: URL: https://github.com/apache/ozone/pull/7734 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

[jira] [Updated] (HDDS-12123) PutObject using the latest awscli later than or equal to 1.37.0 is fail

2025-01-22 Thread Kohei Sugihara (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kohei Sugihara updated HDDS-12123: -- Description: S3G returns internal server errors (500) when we upload some files using awscli >

[jira] [Created] (HDDS-12123) PutObject using the latest awscli later than or equal to 1.37.0 is fail

2025-01-22 Thread Kohei Sugihara (Jira)
Kohei Sugihara created HDDS-12123: - Summary: PutObject using the latest awscli later than or equal to 1.37.0 is fail Key: HDDS-12123 URL: https://issues.apache.org/jira/browse/HDDS-12123 Project: Apac