Re: [PR] HDDS-12781. Implement LifecycleConfiguration proto [ozone]

2025-04-30 Thread via GitHub
ChenSammi commented on code in PR #8276: URL: https://github.com/apache/ozone/pull/8276#discussion_r2068526180 ## hadoop-ozone/interface-client/src/main/proto/OmClientProtocol.proto: ## @@ -2311,6 +2311,51 @@ message DeleteObjectTaggingRequest { message DeleteObjectTaggingRespo

[jira] [Updated] (HDDS-12925) Update datanode volume used space on container deletion

2025-04-30 Thread Peter Lee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Lee updated HDDS-12925: - Status: Patch Available (was: Open) > Update datanode volume used space on container deletion >

Re: [PR] HDDS-12575. Set default JUnit5 timeout via property [ozone]

2025-04-30 Thread via GitHub
adoroszlai merged PR #8348: URL: https://github.com/apache/ozone/pull/8348 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

Re: [PR] HDDS-12728. Add Ozone 2.0.0 to compatibility acceptance tests [ozone]

2025-04-30 Thread via GitHub
adoroszlai commented on code in PR #8361: URL: https://github.com/apache/ozone/pull/8361#discussion_r2068730074 ## hadoop-ozone/dist/src/main/compose/xcompat/lib.sh: ## @@ -24,7 +24,7 @@ source "${COMPOSE_DIR}/../testlib.sh" current_version="${OZONE_CURRENT_VERSION}" # TODO:

[jira] [Resolved] (HDDS-12575) Set default JUnit5 timeout via property

2025-04-30 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-12575. - Fix Version/s: 2.1.0 Resolution: Done > Set default JUnit5 timeout via property >

[PR] HDDS-12925. Update datanode volume used space on container deletion [ozone]

2025-04-30 Thread via GitHub
siddhantsangwan opened a new pull request, #8364: URL: https://github.com/apache/ozone/pull/8364 ## What changes were proposed in this pull request? Ozone Datanode caches the used space of a volume in-memory and updates this cached value on: 1. Write chunk 2. Block Delete 3.

[jira] [Updated] (HDDS-12925) Update datanode volume used space on container deletion

2025-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12925: -- Labels: pull-request-available (was: ) > Update datanode volume used space on container deleti

Re: [PR] HDDS-11633. Delete message body too large, causing SCM to fail writing raft log [ozone]

2025-04-30 Thread via GitHub
aryangupta1998 commented on code in PR #8354: URL: https://github.com/apache/ozone/pull/8354#discussion_r2068082071 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/block/DeletedBlockLogImpl.java: ## @@ -285,16 +285,29 @@ public void addTransactions(Map> conta

[jira] [Updated] (HDDS-12934) Split submodule for Freon

2025-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12934: -- Labels: pull-request-available (was: ) > Split submodule for Freon > -

[jira] [Updated] (HDDS-12934) Split submodule for Freon

2025-04-30 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-12934: Description: Extract parts of {{ozone-tools}} specific to {{ozone freon}} into a new submod

[PR] HDDS-12934. Split submodule for Freon [ozone]

2025-04-30 Thread via GitHub
adoroszlai opened a new pull request, #8367: URL: https://github.com/apache/ozone/pull/8367 ## What changes were proposed in this pull request? Extract parts of `ozone-tools` specific to `ozone freon` into a new submodule. https://issues.apache.org/jira/browse/HDDS-12934

Re: [PR] HDDS-12207. Unify output of `ozone debug replicas verify` checks [ozone]

2025-04-30 Thread via GitHub
dombizita commented on code in PR #8248: URL: https://github.com/apache/ozone/pull/8248#discussion_r2068573136 ## hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/replicas/ReplicasVerify.java: ## @@ -80,42 +93,120 @@ void findCandidateKeys(OzoneClient ozoneClient,

[jira] [Assigned] (HDDS-6688) S3G API tests should validate metrics in addition to metric specific testing

2025-04-30 Thread Chia-Chuan Yu (Jira)
[ https://issues.apache.org/jira/browse/HDDS-6688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Chuan Yu reassigned HDDS-6688: --- Assignee: Chia-Chuan Yu > S3G API tests should validate metrics in addition to metric specifi

Re: [PR] HDDS-12932. Rewrite OMDBDefinition. [ozone]

2025-04-30 Thread via GitHub
szetszwo commented on PR #8362: URL: https://github.com/apache/ozone/pull/8362#issuecomment-2842458921 @adoroszlai , thanks for reviewing this! > ... Some of the indentations look a bit odd, ... I also don't like the indentations, which were done by IntelliJ. Just have fixed t

Re: [PR] HDDS-12053. Make print-log-dag command run locally and offline [ozone]

2025-04-30 Thread via GitHub
adoroszlai commented on code in PR #8016: URL: https://github.com/apache/ozone/pull/8016#discussion_r2067981416 ## hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/graph/Edge.java: ## @@ -15,7 +15,7 @@ * limitations under the License. */ -package org.apache.ozone.g

Re: [PR] HDDS-12053. Make print-log-dag command run locally and offline [ozone]

2025-04-30 Thread via GitHub
Tejaskriya commented on code in PR #8016: URL: https://github.com/apache/ozone/pull/8016#discussion_r2068060136 ## hadoop-ozone/s3gateway/src/test/java/org/apache/hadoop/ozone/client/ClientProtocolStub.java: ## @@ -724,6 +724,7 @@ public OzoneSnapshot getSnapshotInfo(String volu

Re: [PR] HDDS-12209. Make replica verification concurrent [ozone]

2025-04-30 Thread via GitHub
ptlrs commented on PR #8363: URL: https://github.com/apache/ozone/pull/8363#issuecomment-2842753750 Hi @adoroszlai, this PR is dependent on https://github.com/apache/ozone/pull/8248. I will fix any conflicts once that PR is merged. -- This is an automated message from the Apache Git Se

Re: [PR] HDDS-12560. Reclaimable Filter for Snaphost Garbage Collections [ozone]

2025-04-30 Thread via GitHub
hemantk-12 commented on code in PR #8053: URL: https://github.com/apache/ozone/pull/8053#discussion_r2028155530 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/snapshot/filter/ReclaimableFilter.java: ## @@ -0,0 +1,247 @@ +/* + * Licensed to the Apache Soft

Re: [PR] HDDS-12715. create a common miniozone cluster for ozone debug tools tests [ozone]

2025-04-30 Thread via GitHub
adoroszlai commented on code in PR #8209: URL: https://github.com/apache/ozone/pull/8209#discussion_r2069151729 ## hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/shell/TestOzoneDebugReplicasVerify.java: ## @@ -0,0 +1,370 @@ +/* + * Licensed to the Apache Sof

Re: [PR] HDDS-12501. Remove OMKeyInfo from SST files in backup directory. [ozone]

2025-04-30 Thread via GitHub
swamirishi commented on code in PR #8214: URL: https://github.com/apache/ozone/pull/8214#discussion_r2069352809 ## hadoop-hdds/rocksdb-checkpoint-differ/src/main/java/org/apache/ozone/rocksdiff/RocksDBCheckpointDiffer.java: ## @@ -163,14 +178,20 @@ public class RocksDBCheckpoint

Re: [PR] HDDS-12560. Reclaimable Filter for Snaphost Garbage Collections [ozone]

2025-04-30 Thread via GitHub
swamirishi commented on code in PR #8053: URL: https://github.com/apache/ozone/pull/8053#discussion_r2069340206 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/snapshot/filter/ReclaimableFilter.java: ## @@ -0,0 +1,247 @@ +/* + * Licensed to the Apache Soft

Re: [PR] HDDS-12685. Add 2.0 release page [ozone-site]

2025-04-30 Thread via GitHub
jojochuang commented on PR #141: URL: https://github.com/apache/ozone-site/pull/141#issuecomment-2843105153 Thanks @adoroszlai great catch ! Updated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] HDDS-12501. Remove OMKeyInfo from SST files in backup directory. [ozone]

2025-04-30 Thread via GitHub
swamirishi commented on code in PR #8214: URL: https://github.com/apache/ozone/pull/8214#discussion_r2069355325 ## hadoop-hdds/rocks-native/src/main/java/org/apache/hadoop/hdds/utils/db/managed/ManagedRawSSTFileReader.java: ## @@ -48,10 +49,13 @@ public static boolean tryLoadLib

Re: [PR] HDDS-12501. Remove OMKeyInfo from SST files in backup directory. [ozone]

2025-04-30 Thread via GitHub
swamirishi commented on code in PR #8214: URL: https://github.com/apache/ozone/pull/8214#discussion_r2069352006 ## hadoop-hdds/rocksdb-checkpoint-differ/src/main/java/org/apache/ozone/rocksdiff/RocksDBCheckpointDiffer.java: ## @@ -171,6 +185,9 @@ public class RocksDBCheckpointDi

Re: [PR] HDDS-11651. Support short-circuit read channel for freon rk command [ozone]

2025-04-30 Thread via GitHub
adoroszlai commented on code in PR #8316: URL: https://github.com/apache/ozone/pull/8316#discussion_r2069363786 ## hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/RandomKeyGenerator.java: ## @@ -168,6 +169,11 @@ enum FreonOps { defaultValue = "1") privat

[jira] [Updated] (HDDS-12933) Remove the table names declared in OmMetadataManagerImpl

2025-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12933: -- Labels: pull-request-available (was: ) > Remove the table names declared in OmMetadataManagerI

[PR] HDDS-12933. Remove the table names declared in OmMetadataManagerImpl. [ozone]

2025-04-30 Thread via GitHub
szetszwo opened a new pull request, #8370: URL: https://github.com/apache/ozone/pull/8370 ## What changes were proposed in this pull request? We should use the table names defined in `OMDBDefinition`. ## What is the link to the Apache JIRA HDDS-12933 ## How was thi

Re: [PR] HDDS-12715. create a common miniozone cluster for ozone debug tools tests [ozone]

2025-04-30 Thread via GitHub
ptlrs commented on PR #8209: URL: https://github.com/apache/ozone/pull/8209#issuecomment-2842709151 Hi @adoroszlai, the PR has been updated to use the existing TestOzoneIntegrationNonHA class. Could you please take another look. -- This is an automated message from the Apache Git Service.

Re: [PR] HDDS-12560. Reclaimable Filter for Snaphost Garbage Collections [ozone]

2025-04-30 Thread via GitHub
swamirishi commented on code in PR #8053: URL: https://github.com/apache/ozone/pull/8053#discussion_r2069338496 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/snapshot/filter/ReclaimableFilter.java: ## @@ -0,0 +1,247 @@ +/* + * Licensed to the Apache Soft

Re: [PR] HDDS-12560. Reclaimable Filter for Snaphost Garbage Collections [ozone]

2025-04-30 Thread via GitHub
swamirishi commented on code in PR #8053: URL: https://github.com/apache/ozone/pull/8053#discussion_r2069337955 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/snapshot/filter/ReclaimableFilter.java: ## @@ -0,0 +1,247 @@ +/* + * Licensed to the Apache Soft

Re: [PR] HDDS-12560. Reclaimable Filter for Snaphost Garbage Collections [ozone]

2025-04-30 Thread via GitHub
swamirishi commented on code in PR #8053: URL: https://github.com/apache/ozone/pull/8053#discussion_r2069338886 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/snapshot/filter/ReclaimableFilter.java: ## @@ -0,0 +1,247 @@ +/* + * Licensed to the Apache Soft

Re: [PR] HDDS-12560. Reclaimable Filter for Snaphost Garbage Collections [ozone]

2025-04-30 Thread via GitHub
swamirishi commented on code in PR #8053: URL: https://github.com/apache/ozone/pull/8053#discussion_r2069339404 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/snapshot/filter/ReclaimableFilter.java: ## @@ -0,0 +1,247 @@ +/* + * Licensed to the Apache Soft

Re: [PR] HDDS-12560. Reclaimable Filter for Snaphost Garbage Collections [ozone]

2025-04-30 Thread via GitHub
swamirishi commented on code in PR #8053: URL: https://github.com/apache/ozone/pull/8053#discussion_r2069339404 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/snapshot/filter/ReclaimableFilter.java: ## @@ -0,0 +1,247 @@ +/* + * Licensed to the Apache Soft

Re: [PR] HDDS-12932. Rewrite OMDBDefinition. [ozone]

2025-04-30 Thread via GitHub
adoroszlai merged PR #8362: URL: https://github.com/apache/ozone/pull/8362 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

[jira] [Resolved] (HDDS-12932) Rewrite OMDBDefinition

2025-04-30 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-12932. - Fix Version/s: 2.1.0 Resolution: Implemented > Rewrite OMDBDefinition > --

Re: [PR] HDDS-11631. Add Run with Docker Compose guide [ozone-site]

2025-04-30 Thread via GitHub
ptlrs commented on PR #101: URL: https://github.com/apache/ozone-site/pull/101#issuecomment-2842696380 Hi @kerneltime, @errose28, @adoroszlai. Could you please review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [PR] HDDS-12781. Implement LifecycleConfiguration proto [ozone]

2025-04-30 Thread via GitHub
xichen01 commented on code in PR #8276: URL: https://github.com/apache/ozone/pull/8276#discussion_r2069037730 ## hadoop-ozone/interface-client/src/main/proto/OmClientProtocol.proto: ## @@ -2311,6 +2311,51 @@ message DeleteObjectTaggingRequest { message DeleteObjectTaggingRespon

Re: [PR] HDDS-11894. PreAllocate and Cache Blocks in OM [ozone]

2025-04-30 Thread via GitHub
errose28 commented on PR #7550: URL: https://github.com/apache/ozone/pull/7550#issuecomment-2842779816 Thanks for working on this @tanvipenumudy. I have some suggestions for managing the changes: - Let's leave HDDS-11894 as the top level jira for tracking this feature with no code change

Re: [PR] HDDS-12501. Remove OMKeyInfo from SST files in backup directory. [ozone]

2025-04-30 Thread via GitHub
swamirishi commented on code in PR #8214: URL: https://github.com/apache/ozone/pull/8214#discussion_r2069225130 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OmMetadataManagerImpl.java: ## @@ -534,21 +534,23 @@ public void start(OzoneConfiguration config

Re: [PR] HDDS-12501. Remove OMKeyInfo from SST files in backup directory. [ozone]

2025-04-30 Thread via GitHub
swamirishi commented on code in PR #8214: URL: https://github.com/apache/ozone/pull/8214#discussion_r2069241051 ## hadoop-hdds/rocksdb-checkpoint-differ/src/main/java/org/apache/ozone/rocksdiff/RocksDBCheckpointDiffer.java: ## @@ -1382,6 +1445,113 @@ public void pruneSstFiles()

Re: [PR] HDDS-12501. Remove OMKeyInfo from SST files in backup directory. [ozone]

2025-04-30 Thread via GitHub
swamirishi commented on code in PR #8214: URL: https://github.com/apache/ozone/pull/8214#discussion_r2069283821 ## hadoop-hdds/rocksdb-checkpoint-differ/src/main/java/org/apache/ozone/rocksdiff/CompactionNode.java: ## @@ -41,18 +42,25 @@ public class CompactionNode { public

Re: [PR] HDDS-12685. Add 2.0 release page [ozone-site]

2025-04-30 Thread via GitHub
adoroszlai commented on code in PR #141: URL: https://github.com/apache/ozone-site/pull/141#discussion_r2069332518 ## static/doap_ozone.rdf: ## @@ -39,8 +39,8 @@ Applications using frameworks like Apache Spark, YARN and Hive work natively wit Stable Relea

[jira] [Created] (HDDS-12935) Fix S3G signature mismatch for STREAMING-UNSIGNED-PAYLOAD-TRAILER

2025-04-30 Thread Ivan Andika (Jira)
Ivan Andika created HDDS-12935: -- Summary: Fix S3G signature mismatch for STREAMING-UNSIGNED-PAYLOAD-TRAILER Key: HDDS-12935 URL: https://issues.apache.org/jira/browse/HDDS-12935 Project: Apache Ozone

[jira] [Updated] (HDDS-12842) Handle "Expect: 100-continue" header

2025-04-30 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-12842: --- Parent: (was: HDDS-12716) Issue Type: Task (was: Sub-task) > Handle "Expect: 100-continu

[jira] [Updated] (HDDS-12935) Fix S3G signature mismatch for STREAMING-UNSIGNED-PAYLOAD-TRAILER

2025-04-30 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-12935: --- Description: HDDS-12488 fixes the issue where the AWS checksum trailer data is silently appended to

[jira] [Updated] (HDDS-12924) Optimize DU for used space calculation

2025-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12924: -- Labels: pull-request-available (was: ) > Optimize DU for used space calculation >

[PR] HDDS-12924. datanode used space calculation optimization [ozone]

2025-04-30 Thread via GitHub
sumitagrawl opened a new pull request, #8365: URL: https://github.com/apache/ozone/pull/8365 ## What changes were proposed in this pull request? This PR consists of datanode used space calculation" approach. Based on the final approach, need further implement the solution ## Wh

[jira] [Assigned] (HDDS-12936) Consider hdds.scm.safemode.threshold.pct in RatisContainerSafemodeRule

2025-04-30 Thread Nandakumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar reassigned HDDS-12936: - Assignee: Szabolcs Gál > Consider hdds.scm.safemode.threshold.pct in RatisContainerSafemodeRule

Re: [PR] HDDS-12728. Add Ozone 2.0.0 to compatibility acceptance tests [ozone]

2025-04-30 Thread via GitHub
adoroszlai commented on code in PR #8361: URL: https://github.com/apache/ozone/pull/8361#discussion_r2068490363 ## hadoop-ozone/dist/src/main/compose/xcompat/lib.sh: ## @@ -24,7 +24,7 @@ source "${COMPOSE_DIR}/../testlib.sh" current_version="${OZONE_CURRENT_VERSION}" # TODO:

Re: [PR] HDDS-12728. Add Ozone 2.0.0 to compatibility acceptance tests [ozone]

2025-04-30 Thread via GitHub
adoroszlai commented on code in PR #8361: URL: https://github.com/apache/ozone/pull/8361#discussion_r2068490363 ## hadoop-ozone/dist/src/main/compose/xcompat/lib.sh: ## @@ -24,7 +24,7 @@ source "${COMPOSE_DIR}/../testlib.sh" current_version="${OZONE_CURRENT_VERSION}" # TODO:

Re: [PR] HDDS-12728. Add Ozone 2.0.0 to compatibility acceptance tests [ozone]

2025-04-30 Thread via GitHub
adoroszlai commented on code in PR #8361: URL: https://github.com/apache/ozone/pull/8361#discussion_r2068490363 ## hadoop-ozone/dist/src/main/compose/xcompat/lib.sh: ## @@ -24,7 +24,7 @@ source "${COMPOSE_DIR}/../testlib.sh" current_version="${OZONE_CURRENT_VERSION}" # TODO:

[jira] [Resolved] (HDDS-11633) Delete message body too large, causing SCM to fail writing raft log

2025-04-30 Thread Ashish Kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Kumar resolved HDDS-11633. - Fix Version/s: 2.1.0 Resolution: Fixed > Delete message body too large, causing SCM to fai

Re: [PR] HDDS-12053. Make print-log-dag command run locally and offline [ozone]

2025-04-30 Thread via GitHub
Tejaskriya commented on code in PR #8016: URL: https://github.com/apache/ozone/pull/8016#discussion_r2068006370 ## hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/om/CompactionLogDagPrinter.java: ## @@ -0,0 +1,115 @@ +/* + * Licensed to the Apache Software Foundat

Re: [PR] HDDS-12053. Make print-log-dag command run locally and offline [ozone]

2025-04-30 Thread via GitHub
Tejaskriya commented on code in PR #8016: URL: https://github.com/apache/ozone/pull/8016#discussion_r2067983218 ## hadoop-ozone/s3gateway/src/test/java/org/apache/hadoop/ozone/client/ClientProtocolStub.java: ## @@ -724,6 +724,7 @@ public OzoneSnapshot getSnapshotInfo(String volu

[jira] [Updated] (HDDS-12935) Fix S3G signature mismatch for STREAMING-UNSIGNED-PAYLOAD-TRAILER

2025-04-30 Thread ASF GitHub Bot (Jira)
IGNED-PAYLOAD-TRAILER > x-amz-date:20250430T071131Z > x-amz-decoded-content-length:5 > x-amz-sdk-checksum-algorithm:CRC64NVME > x-amz-trailer:x-amz-checksum-crc64nvme > content-encoding;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-sdk-checks

Re: [PR] HDDS-12053. Make print-log-dag command run locally and offline [ozone]

2025-04-30 Thread via GitHub
Tejaskriya commented on PR #8016: URL: https://github.com/apache/ozone/pull/8016#issuecomment-2841350856 Thanks for the review @adoroszlai , I have made the suggestions as you suggested. Could you please take a look at it again? -- This is an automated message from the Apache Git Service.

[jira] [Updated] (HDDS-12934) Split submodule for Freon

2025-04-30 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-12934: Status: Patch Available (was: In Progress) > Split submodule for Freon > -

Re: [PR] HDDS-12920. Configure log4j to gzip rolled over service log files [ozone]

2025-04-30 Thread via GitHub
adoroszlai commented on code in PR #8357: URL: https://github.com/apache/ozone/pull/8357#discussion_r2068474891 ## hadoop-ozone/dist/src/shell/conf/log4j.properties: ## @@ -31,21 +31,40 @@ log4j.appender.NullAppender=org.apache.log4j.varia.NullAppender # # Rolling File Append

[jira] [Assigned] (HDDS-11514) Set optimal default values for delete configurations based on live cluster testing

2025-04-30 Thread Krishna Kumar Asawa (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar Asawa reassigned HDDS-11514: -- Assignee: Aryan Gupta > Set optimal default values for delete configurations b

Re: [PR] HDDS-11633. Delete message body too large, causing SCM to fail writing raft log [ozone]

2025-04-30 Thread via GitHub
ashishkumar50 merged PR #8354: URL: https://github.com/apache/ozone/pull/8354 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.a

[jira] [Updated] (HDDS-12935) Fix S3G signature mismatch for STREAMING-UNSIGNED-PAYLOAD-TRAILER

2025-04-30 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-12935: --- Description: HDDS-12488 fixes the issue where the AWS checksum trailer data is silently appended to

[jira] [Created] (HDDS-12937) Consider hdds.scm.safemode.threshold.pct in ECContainerSafemodeRule

2025-04-30 Thread Nandakumar (Jira)
Nandakumar created HDDS-12937: - Summary: Consider hdds.scm.safemode.threshold.pct in ECContainerSafemodeRule Key: HDDS-12937 URL: https://issues.apache.org/jira/browse/HDDS-12937 Project: Apache Ozone

[jira] [Assigned] (HDDS-12937) Consider hdds.scm.safemode.threshold.pct in ECContainerSafemodeRule

2025-04-30 Thread Nandakumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar reassigned HDDS-12937: - Assignee: Szabolcs Gál > Consider hdds.scm.safemode.threshold.pct in ECContainerSafemodeRule > -

[jira] [Created] (HDDS-12936) Consider hdds.scm.safemode.threshold.pct in RatisContainerSafemodeRule

2025-04-30 Thread Nandakumar (Jira)
Nandakumar created HDDS-12936: - Summary: Consider hdds.scm.safemode.threshold.pct in RatisContainerSafemodeRule Key: HDDS-12936 URL: https://issues.apache.org/jira/browse/HDDS-12936 Project: Apache Ozone

Re: [PR] HDDS-12877. Support StorageClass field in the S3 HeadObject request [ozone]

2025-04-30 Thread via GitHub
chungen0126 commented on code in PR #8351: URL: https://github.com/apache/ozone/pull/8351#discussion_r2068391175 ## hadoop-ozone/dist/src/main/smoketest/s3/objecthead.robot: ## @@ -60,3 +60,13 @@ Head non existing key ${result} = Execute AWSS3APICli and checkrch

Re: [PR] HDDS-12378. Change default hdds.scm.safemode.min.datanode to 3 [ozone]

2025-04-30 Thread via GitHub
nandakumar131 commented on code in PR #8331: URL: https://github.com/apache/ozone/pull/8331#discussion_r2068390762 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/safemode/DataNodeSafeModeRule.java: ## @@ -66,7 +69,17 @@ protected boolean validate() { if

Re: [PR] HDDS-12378. Change default hdds.scm.safemode.min.datanode to 3 [ozone]

2025-04-30 Thread via GitHub
nandakumar131 commented on code in PR #8331: URL: https://github.com/apache/ozone/pull/8331#discussion_r2068390762 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/safemode/DataNodeSafeModeRule.java: ## @@ -66,7 +69,17 @@ protected boolean validate() { if

[jira] [Assigned] (HDDS-11904) Fix HealthyPipelineSafeModeRule logic

2025-04-30 Thread Nandakumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar reassigned HDDS-11904: - Assignee: Aryan Gupta (was: Nandakumar) > Fix HealthyPipelineSafeModeRule logic > -

[jira] [Assigned] (HDDS-11904) Fix HealthyPipelineSafeModeRule logic

2025-04-30 Thread Nandakumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar reassigned HDDS-11904: - Assignee: Aryan Gupta (was: Aryan Gupta) > Fix HealthyPipelineSafeModeRule logic >

[jira] [Created] (HDDS-12938) Refactor OneReplicaPipelineSafeModeRule to not use PipelineReportFromDatanode

2025-04-30 Thread Nandakumar (Jira)
Nandakumar created HDDS-12938: - Summary: Refactor OneReplicaPipelineSafeModeRule to not use PipelineReportFromDatanode Key: HDDS-12938 URL: https://issues.apache.org/jira/browse/HDDS-12938 Project: Apache

Re: [PR] HDDS-12053. Make print-log-dag command run locally and offline [ozone]

2025-04-30 Thread via GitHub
adoroszlai commented on code in PR #8016: URL: https://github.com/apache/ozone/pull/8016#discussion_r2068500447 ## hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/debug/om/PrefixParser.java: ## @@ -71,16 +69,16 @@ public class PrefixParser implements Callable { priva

[jira] [Assigned] (HDDS-7295) listKeys for large FSO-enabled bucket is timeout

2025-04-30 Thread Peter Lee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Lee reassigned HDDS-7295: --- Assignee: Peter Lee > listKeys for large FSO-enabled bucket is timeout >

[jira] [Created] (HDDS-12941) Revisit method and variable names related to reserved / committed (allocated) space

2025-04-30 Thread Siyao Meng (Jira)
Siyao Meng created HDDS-12941: - Summary: Revisit method and variable names related to reserved / committed (allocated) space Key: HDDS-12941 URL: https://issues.apache.org/jira/browse/HDDS-12941 Project:

Re: [PR] HDDS-12924. datanode used space calculation optimization [ozone]

2025-04-30 Thread via GitHub
smengcl commented on code in PR #8365: URL: https://github.com/apache/ozone/pull/8365#discussion_r2069840812 ## hadoop-hdds/docs/content/design/dn-usedspace-calculation.md: ## @@ -0,0 +1,87 @@ +--- +title: Datanode used space calculation +summary: Describe proposal for optimiza

[jira] [Resolved] (HDDS-12933) Remove the table names declared in OmMetadataManagerImpl

2025-04-30 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-12933. - Fix Version/s: 2.1.0 Resolution: Done > Remove the table names declared in OmMetad

Re: [PR] HDDS-11603. Reclaimable Filter for Snapshots garbage reclaimation [ozone]

2025-04-30 Thread via GitHub
adoroszlai closed pull request #7345: HDDS-11603. Reclaimable Filter for Snapshots garbage reclaimation URL: https://github.com/apache/ozone/pull/7345 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Updated] (HDDS-11603) Reclaimable Key Filter for Snapshots garbage reclaimation

2025-04-30 Thread Swaminathan Balachandran (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swaminathan Balachandran updated HDDS-11603: Summary: Reclaimable Key Filter for Snapshots garbage reclaimation (was: R

[jira] [Assigned] (HDDS-12941) Revisit method and variable naming conventions related to reserved / committed (allocated) space

2025-04-30 Thread Peter Lee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Lee reassigned HDDS-12941: Assignee: Peter Lee > Revisit method and variable naming conventions related to reserved / > comm

Re: [PR] HDDS-12728. Add Ozone 2.0.0 to compatibility acceptance tests [ozone]

2025-04-30 Thread via GitHub
adoroszlai commented on code in PR #8361: URL: https://github.com/apache/ozone/pull/8361#discussion_r2069871606 ## hadoop-ozone/dist/src/main/compose/xcompat/lib.sh: ## @@ -24,7 +24,7 @@ source "${COMPOSE_DIR}/../testlib.sh" current_version="${OZONE_CURRENT_VERSION}" # TODO:

Re: [PR] HDDS-12933. Remove the table names declared in OmMetadataManagerImpl. [ozone]

2025-04-30 Thread via GitHub
adoroszlai merged PR #8370: URL: https://github.com/apache/ozone/pull/8370 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

[jira] [Updated] (HDDS-11603) Reclaimable Key Filter for Snapshots garbage reclaimation

2025-04-30 Thread Swaminathan Balachandran (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Swaminathan Balachandran updated HDDS-11603: Description: Currently deleted key entries are reclaimed by just peeking in

Re: [PR] HDDS-12561. Reclaimable Rename entry filter for reclaiming renaming entries [ozone]

2025-04-30 Thread via GitHub
adoroszlai commented on PR #8054: URL: https://github.com/apache/ozone/pull/8054#issuecomment-2844147717 Please wait for clean CI run in fork before marking ready for review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] HDDS-12728. Add Ozone 2.0.0 to compatibility acceptance tests [ozone]

2025-04-30 Thread via GitHub
adoroszlai commented on code in PR #8361: URL: https://github.com/apache/ozone/pull/8361#discussion_r2069873026 ## hadoop-ozone/dist/src/main/compose/upgrade/test.sh: ## @@ -33,8 +33,10 @@ RESULT_DIR="$ALL_RESULT_DIR" create_results_dir # This is the version of Ozone that sho

Re: [PR] HDDS-12901. Introduce EventExecutorMetrics instead of setting the metrics props unsafely [ozone]

2025-04-30 Thread via GitHub
peterxcli commented on code in PR #8371: URL: https://github.com/apache/ozone/pull/8371#discussion_r2069884829 ## hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/server/events/SingleThreadExecutor.java: ## @@ -77,42 +59,43 @@ public SingleThreadExecutor(String name, S

Re: [PR] HDDS-12901. Introduce EventExecutorMetrics instead of setting the metrics props unsafely [ozone]

2025-04-30 Thread via GitHub
jojochuang commented on code in PR #8371: URL: https://github.com/apache/ozone/pull/8371#discussion_r2069873000 ## hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/server/events/SingleThreadExecutor.java: ## @@ -77,42 +59,43 @@ public SingleThreadExecutor(String name,

Re: [PR] HDDS-12933. Remove the table names declared in OmMetadataManagerImpl. [ozone]

2025-04-30 Thread via GitHub
szetszwo commented on PR #8370: URL: https://github.com/apache/ozone/pull/8370#issuecomment-2844149546 @adoroszlai , thanks a lot for reviewing and merging this! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] HDDS-12901. Introduce EventExecutorMetrics instead of setting the metrics props unsafely [ozone]

2025-04-30 Thread via GitHub
peterxcli commented on code in PR #8371: URL: https://github.com/apache/ozone/pull/8371#discussion_r2069882219 ## hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/server/events/SingleThreadExecutor.java: ## @@ -77,42 +59,43 @@ public SingleThreadExecutor(String name, S

[jira] [Assigned] (HDDS-12455) Merge the SimpleMockNodeManager with MockNodeManager

2025-04-30 Thread Peter Lee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Lee reassigned HDDS-12455: Assignee: (was: Peter Lee) > Merge the SimpleMockNodeManager with MockNodeManager > --

[jira] [Created] (HDDS-12942) Init layout version config should not be public

2025-04-30 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-12942: --- Summary: Init layout version config should not be public Key: HDDS-12942 URL: https://issues.apache.org/jira/browse/HDDS-12942 Project: Apache Ozone Is

Re: [PR] HDDS-12728. Add Ozone 2.0.0 to compatibility acceptance tests [ozone]

2025-04-30 Thread via GitHub
adoroszlai merged PR #8361: URL: https://github.com/apache/ozone/pull/8361 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

[jira] [Resolved] (HDDS-12728) [Ozone 2.0] Add Ozone 2.0.0 to compatibility acceptance tests

2025-04-30 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-12728. - Fix Version/s: 2.1.0 Resolution: Done > [Ozone 2.0] Add Ozone 2.0.0 to compatibili

[jira] [Created] (HDDS-12940) Ozone Snapshot Phase 3: Scale up Snapshot Operations

2025-04-30 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDDS-12940: -- Summary: Ozone Snapshot Phase 3: Scale up Snapshot Operations Key: HDDS-12940 URL: https://issues.apache.org/jira/browse/HDDS-12940 Project: Apache Ozone

[jira] [Updated] (HDDS-10265) Use SnapshotId in BackgroundServices

2025-04-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-10265: --- Parent: HDDS-12940 (was: HDDS-8544) > Use SnapshotId in BackgroundServices > ---

[jira] [Updated] (HDDS-12308) HA Aware Reads for Snapdiff

2025-04-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-12308: --- Parent: HDDS-12940 (was: HDDS-8544) > HA Aware Reads for Snapdiff >

[jira] [Updated] (HDDS-10858) [snapshot] Error message is not thrown when trying to create '.snapshot' directory the 2nd time

2025-04-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-10858: --- Parent: HDDS-12940 (was: HDDS-8544) > [snapshot] Error message is not thrown when trying to

[jira] [Updated] (HDDS-12491) Snapshot diff should use direct byte buffers on SSTFileReader and RawSstFileReader while fetching keys

2025-04-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-12491: --- Parent: HDDS-12940 (was: HDDS-8544) > Snapshot diff should use direct byte buffers on SSTFil

[jira] [Updated] (HDDS-8862) [Snapshot] Make SnapshotChainManager singleton

2025-04-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-8862: -- Parent: HDDS-12940 (was: HDDS-8544) > [Snapshot] Make SnapshotChainManager singleton > ---

[jira] [Updated] (HDDS-8903) Add validation for OZONE_OM_SNAPSHOT_DB_MAX_OPEN_FILES

2025-04-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-8903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-8903: -- Parent: HDDS-12940 (was: HDDS-8544) > Add validation for OZONE_OM_SNAPSHOT_DB_MAX_OPEN_FILES >

[jira] [Updated] (HDDS-7780) [Snapshot] Improve visibility into background service SnapshotDeletingTask

2025-04-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-7780: -- Parent: HDDS-12940 (was: HDDS-8544) > [Snapshot] Improve visibility into background service Sna

[jira] [Updated] (HDDS-8529) [Snapshot] Refactor OmSnapshotManager constructor to reduce initialization done when snapshot feature is disabled

2025-04-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-8529: -- Parent: HDDS-12940 (was: HDDS-8544) > [Snapshot] Refactor OmSnapshotManager constructor to redu

  1   2   >