[jira] [Created] (HDDS-12226) TestSecureOzoneRpcClient test cases are not run

2025-02-05 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-12226: --- Summary: TestSecureOzoneRpcClient test cases are not run Key: HDDS-12226 URL: https://issues.apache.org/jira/browse/HDDS-12226 Project: Apache Ozone Is

[jira] [Commented] (HDDS-12222) Add Freon subcommand to generate artificial OM rocks DB updates

2025-02-05 Thread Peter Lee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924399#comment-17924399 ] Peter Lee commented on HDDS-1: -- Could you please give me a day to investigate? I wil

[jira] [Updated] (HDDS-12222) Add Freon subcommand to generate artificial OM rocks DB updates

2025-02-05 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-1: Summary: Add Freon subcommand to generate artificial OM rocks DB updates (was: Ozone freon

[jira] [Updated] (HDDS-12222) Add Freon subcommand to generate artificial OM rocks DB updates

2025-02-05 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-1: Component/s: freon (was: Ozone CLI) > Add Freon subcommand to generate

[jira] [Updated] (HDDS-12224) Add dashboards in Grafana based on Recon metrics

2025-02-05 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-12224: Summary: Add dashboards in Grafana based on Recon metrics (was: Ozone Observability - Add

[jira] [Updated] (HDDS-12223) Add metrics in Recon for OM and SCM background tasks at fine grained level

2025-02-05 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-12223: Summary: Add metrics in Recon for OM and SCM background tasks at fine grained level (was:

[jira] [Created] (HDDS-12225) Move EC read-replicas test to EC suite

2025-02-05 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-12225: --- Summary: Move EC read-replicas test to EC suite Key: HDDS-12225 URL: https://issues.apache.org/jira/browse/HDDS-12225 Project: Apache Ozone Issue Type:

[jira] [Updated] (HDDS-7003) Tweak read-replicas tool to be compatible with EC replication type

2025-02-05 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-7003: --- Fix Version/s: 2.0.0 Resolution: Implemented Status: Resolved (was: Patch Av

Re: [PR] HDDS-7003. Tweak read-replicas tool to be compatible with EC replication type [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on PR #7528: URL: https://github.com/apache/ozone/pull/7528#issuecomment-2638980104 Thanks @len548 for the patch, @dombizita, @fapifta, @peterxcli, @weimingdiit for the review. -- This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [PR] HDDS-7003. Tweak read-replicas tool to be compatible with EC replication type [ozone]

2025-02-05 Thread via GitHub
adoroszlai merged PR #7528: URL: https://github.com/apache/ozone/pull/7528 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

[jira] [Assigned] (HDDS-12188) Move server-only classes from hdds-common to hdds-server-framework

2025-02-05 Thread Chia-Chuan Yu (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Chuan Yu reassigned HDDS-12188: Assignee: Chia-Chuan Yu (was: Attila Doroszlai) > Move server-only classes from hdds-comm

[jira] [Commented] (HDDS-12188) Move server-only classes from hdds-common to hdds-server-framework

2025-02-05 Thread Chia-Chuan Yu (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924380#comment-17924380 ] Chia-Chuan Yu commented on HDDS-12188: -- Hi, [~adoroszlai]  I would like to go for a

[jira] [Assigned] (HDDS-12224) Ozone Observability - Add dashbaords in Grafana based on Recon metrics

2025-02-05 Thread Devesh Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devesh Kumar Singh reassigned HDDS-12224: - Assignee: Devesh Kumar Singh > Ozone Observability - Add dashbaords in Grafana b

[jira] [Comment Edited] (HDDS-12222) Ozone freon tool - add support to generate artificial OM rocks DB updates

2025-02-05 Thread Devesh Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924378#comment-17924378 ] Devesh Kumar Singh edited comment on HDDS-1 at 2/6/25 6:47 AM:

[jira] [Commented] (HDDS-12222) Ozone freon tool - add support to generate artificial OM rocks DB updates

2025-02-05 Thread Devesh Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924378#comment-17924378 ] Devesh Kumar Singh commented on HDDS-1: --- [~peterxcli] Would be working on t

[jira] [Created] (HDDS-12224) Ozone Observability - Add dashbaords in Grafana based on Recon metrics

2025-02-05 Thread Devesh Kumar Singh (Jira)
Devesh Kumar Singh created HDDS-12224: - Summary: Ozone Observability - Add dashbaords in Grafana based on Recon metrics Key: HDDS-12224 URL: https://issues.apache.org/jira/browse/HDDS-12224 Projec

[jira] [Created] (HDDS-12223) Ozone Recon - Add metrics in Recon for OM and SCM background tasks at fine grained level

2025-02-05 Thread Devesh Kumar Singh (Jira)
Devesh Kumar Singh created HDDS-12223: - Summary: Ozone Recon - Add metrics in Recon for OM and SCM background tasks at fine grained level Key: HDDS-12223 URL: https://issues.apache.org/jira/browse/HDDS-12223

Re: [PR] HDDS-12185. Enhance FileSizeCountTask for Faster Processing. [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on code in PR #7796: URL: https://github.com/apache/ozone/pull/7796#discussion_r1944179016 ## hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/tasks/FileSizeCountTask.java: ## @@ -76,52 +83,83 @@ public FileSizeCountTask(FileCountBySizeDao fil

[jira] [Assigned] (HDDS-12222) Ozone freon tool - add support to generate artificial OM rocks DB updates

2025-02-05 Thread Peter Lee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Lee reassigned HDDS-1: Assignee: Peter Lee > Ozone freon tool - add support to generate artificial OM rocks DB updates >

[jira] [Commented] (HDDS-12188) Move server-only classes from hdds-common to hdds-server-framework

2025-02-05 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924372#comment-17924372 ] Attila Doroszlai commented on HDDS-12188: - Thanks [~chiacyu]. It's not urgent, b

[jira] [Updated] (HDDS-12222) Ozone freon tool - add support to generate artificial OM rocks DB updates

2025-02-05 Thread Devesh Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devesh Kumar Singh updated HDDS-1: -- Component/s: Ozone CLI Ozone Recon Labels: ozone ozone-recon o

[jira] [Assigned] (HDDS-12170) Enable RocksDB Bloom filter optimization for memory

2025-02-05 Thread Chia-Chuan Yu (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Chuan Yu reassigned HDDS-12170: Assignee: Chia-Chuan Yu > Enable RocksDB Bloom filter optimization for memory > --

[jira] [Created] (HDDS-12222) Ozone freon tool - add support to generate artificial OM rocks DB updates

2025-02-05 Thread Devesh Kumar Singh (Jira)
Devesh Kumar Singh created HDDS-1: - Summary: Ozone freon tool - add support to generate artificial OM rocks DB updates Key: HDDS-1 URL: https://issues.apache.org/jira/browse/HDDS-1 Pro

[jira] [Commented] (HDDS-11956) Deprecate/remove Hadoop 2 support

2025-02-05 Thread Chia-Chuan Yu (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924367#comment-17924367 ] Chia-Chuan Yu commented on HDDS-11956: -- Hi, [~adoroszlai]  Since we're going to put

[jira] [Commented] (HDDS-12188) Move server-only classes from hdds-common to hdds-server-framework

2025-02-05 Thread Chia-Chuan Yu (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924370#comment-17924370 ] Chia-Chuan Yu commented on HDDS-12188: -- Hi, [~adoroszlai]  If the task is not so ur

Re: [PR] HDDS-10607. Remove unused ozone.block.deleting.container.limit.per.interval config property [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on PR #7816: URL: https://github.com/apache/ozone/pull/7816#issuecomment-2638906389 > > Please remove `ozone.block.deleting.limit.per.task` (constant: `OZONE_BLOCK_DELETING_LIMIT_PER_CONTAINER`) similarly. > > @Gargi-jais11 you can take up this task , specified in

Re: [PR] HDDS-10607. Remove unused ozone.block.deleting.container.limit.per.interval config property [ozone]

2025-02-05 Thread via GitHub
sreejasahithi commented on PR #7816: URL: https://github.com/apache/ozone/pull/7816#issuecomment-2638887661 >Please remove `ozone.block.deleting.limit.per.task` (constant: `OZONE_BLOCK_DELETING_LIMIT_PER_CONTAINER`) similarly. > @Gargi-jais11 you can take up this task , specified in th

[jira] [Created] (HDDS-12221) Remove ozone.block.deleting.limit.per.task property as it's not used anymore

2025-02-05 Thread Sreeja (Jira)
Sreeja created HDDS-12221: - Summary: Remove ozone.block.deleting.limit.per.task property as it's not used anymore Key: HDDS-12221 URL: https://issues.apache.org/jira/browse/HDDS-12221 Project: Apache Ozone

[jira] [Updated] (HDDS-12218) Add more to integration test with shared cluster

2025-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12218: -- Labels: pull-request-available (was: ) > Add more to integration test with shared cluster > --

[PR] HDDS-12218. Add more to integration test with shared cluster [ozone]

2025-02-05 Thread via GitHub
adoroszlai opened a new pull request, #7821: URL: https://github.com/apache/ozone/pull/7821 ## What changes were proposed in this pull request? Run few more integration tests with shared cluster to save time. ``` [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time e

Re: [PR] HDDS-12175. Audit logs in SCM shouldn't print delete txns [ozone]

2025-02-05 Thread via GitHub
Tejaskriya commented on PR #7805: URL: https://github.com/apache/ozone/pull/7805#issuecomment-2638777438 @adoroszlai I have addressed all the comments, Thanks for suggesting these improvements! -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] HDDS-11530. Support listMultipartUploads max uploads and markers [ozone]

2025-02-05 Thread via GitHub
jojochuang commented on PR #7817: URL: https://github.com/apache/ozone/pull/7817#issuecomment-2638669911 Thanks for contributing the PR, @peterxcli Could you add assertions in the tests to make sure limit is adhered? (i.e. isTruncated is set) Also please rebase the PR to resolve the c

Re: [PR] HDDS-12159. Remove redundant seek for rocksDBs [ozone]

2025-02-05 Thread via GitHub
jojochuang commented on PR #7794: URL: https://github.com/apache/ozone/pull/7794#issuecomment-2638531561 Merged. Thanks @Tejaskriya for contribution and @nandakumar131 @sadanand48 for reviews. -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [PR] HDDS-12159. Remove redundant seek for rocksDBs [ozone]

2025-02-05 Thread via GitHub
jojochuang merged PR #7794: URL: https://github.com/apache/ozone/pull/7794 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

[jira] [Resolved] (HDDS-12159) Remove unnecessary iterator seek in fileTable and DirectoryTable uses

2025-02-05 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDDS-12159. Fix Version/s: 2.0.0 Resolution: Fixed > Remove unnecessary iterator seek in fileTab

[jira] [Updated] (HDDS-12213) Review and fix the default proto enum value

2025-02-05 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-12213: --- Description: https://protobuf.dev/programming-guides/proto2/#enum-default https://protobuf.dev/progra

Re: [PR] HDDS-10336. Allow setting client side ozone.replication configs to EC. [ozone]

2025-02-05 Thread via GitHub
aswinshakil commented on PR #7750: URL: https://github.com/apache/ozone/pull/7750#issuecomment-2638344179 The old ordering in (2) and (3) is fine as long as the same order is followed in all the code paths. As @adoroszlai mentioned we can simulate this in integration tests with all possibl

[jira] [Updated] (HDDS-11442) Dashboard for memory consumption metrics

2025-02-05 Thread Jira
[ https://issues.apache.org/jira/browse/HDDS-11442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] István Fajth updated HDDS-11442: Fix Version/s: 2.0.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

Re: [PR] HDDS-11442. Add dashboard for memory consumption metrics [ozone]

2025-02-05 Thread via GitHub
fapifta commented on PR #7198: URL: https://github.com/apache/ozone/pull/7198#issuecomment-2638319648 I am merging this one, it looks good in general, if we find any further tweaks, we can do a follow up to fix it. -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] HDDS-11442. Add dashboard for memory consumption metrics [ozone]

2025-02-05 Thread via GitHub
fapifta merged PR #7198: URL: https://github.com/apache/ozone/pull/7198 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apache.

Re: [PR] HDDS-12033. ScmHAUnfinalizedStateValidationAction can be remove as it's not used [ozone]

2025-02-05 Thread via GitHub
jojochuang commented on PR #7820: URL: https://github.com/apache/ozone/pull/7820#issuecomment-2638312077 @nandakumar131 please check if this is what you suggested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[jira] [Updated] (HDDS-12033) ScmHAUnfinalizedStateValidationAction can be remove as it's not used

2025-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12033: -- Labels: pull-request-available (was: ) > ScmHAUnfinalizedStateValidationAction can be remove a

[PR] HDDS-12033. ScmHAUnfinalizedStateValidationAction can be remove as it's not used [ozone]

2025-02-05 Thread via GitHub
jojochuang opened a new pull request, #7820: URL: https://github.com/apache/ozone/pull/7820 ## What changes were proposed in this pull request? HDDS-12033. ScmHAUnfinalizedStateValidationAction can be remove as it's not used Please describe your PR in detail: * Remove ScmHAUnfin

[PR] Ratis group remove Repro [ozone]

2025-02-05 Thread via GitHub
swamirishi opened a new pull request, #7819: URL: https://github.com/apache/ozone/pull/7819 ## What changes were proposed in this pull request? Provide a one-liner summary of the changes in the PR **Title** field above. It should be in the form of `HDDS-1234. Short summary of the change

[jira] [Created] (HDDS-12220) Add RocksDB maximum log file number to OM, SCM, and Recon

2025-02-05 Thread Ryan Blough (Jira)
Ryan Blough created HDDS-12220: -- Summary: Add RocksDB maximum log file number to OM, SCM, and Recon Key: HDDS-12220 URL: https://issues.apache.org/jira/browse/HDDS-12220 Project: Apache Ozone Is

[jira] [Updated] (HDDS-12217) Remove reference to FileUtil in hdds-common

2025-02-05 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-12217: Status: Patch Available (was: In Progress) > Remove reference to FileUtil in hdds-common >

Re: [PR] HDDS-12175. Audit logs in SCM shouldn't print delete txns [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on code in PR #7805: URL: https://github.com/apache/ozone/pull/7805#discussion_r1943675167 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/server/SCMDatanodeProtocolServer.java: ## @@ -280,6 +280,29 @@ public static SCMRegisteredResponsePr

[PR] HDDS-12217. Remove reference to FileUtil in hdds-common [ozone]

2025-02-05 Thread via GitHub
adoroszlai opened a new pull request, #7818: URL: https://github.com/apache/ozone/pull/7818 ## What changes were proposed in this pull request? Hadoop `FileUtil` requires `commons-compress` at runtime. Remove a reference to it from `hdds-common` to reduce client's dependencies.

[jira] [Updated] (HDDS-12217) Remove reference to FileUtil in hdds-common

2025-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12217: -- Labels: pull-request-available (was: ) > Remove reference to FileUtil in hdds-common > ---

Re: [PR] HDDS-11866. Remove code paths for non-Ratis OM [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on code in PR #7778: URL: https://github.com/apache/ozone/pull/7778#discussion_r1943583949 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/protocolPB/OzoneManagerProtocolServerSideTranslatorPB.java: ## @@ -79,7 +71,6 @@ public class Ozone

Re: [PR] HDDS-11866. Remove code paths for non-Ratis OM [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on code in PR #7778: URL: https://github.com/apache/ozone/pull/7778#discussion_r1943586069 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/PrefixManagerImpl.java: ## @@ -64,13 +64,7 @@ public class PrefixManagerImpl implements PrefixMa

[jira] [Updated] (HDDS-11725) Add support to read an SST file

2025-02-05 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose updated HDDS-11725: -- Parent Issue: HDDS-12219 (was: HDDS-8097) > Add support to read an SST file >

[jira] [Updated] (HDDS-11746) Support arbitrary schemas as an option in ozone debug ldb

2025-02-05 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose updated HDDS-11746: -- Parent Issue: HDDS-12219 (was: HDDS-8097) > Support arbitrary schemas as an option in ozone debug ldb

[jira] [Updated] (HDDS-11777) Create common method for tasks that need to iterate OM namespace in parallel

2025-02-05 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose updated HDDS-11777: -- Parent: HDDS-8097 Issue Type: Sub-task (was: Improvement) > Create common method for tasks tha

[jira] [Updated] (HDDS-11706) ldb tool should support db.snapdiff

2025-02-05 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose updated HDDS-11706: -- Parent Issue: HDDS-12219 (was: HDDS-8097) > ldb tool should support db.snapdiff >

[jira] [Updated] (HDDS-11743) Provide debug/repair commands for OM DB import/export

2025-02-05 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose updated HDDS-11743: -- Parent Issue: HDDS-12219 (was: HDDS-8097) > Provide debug/repair commands for OM DB import/export > --

[jira] [Created] (HDDS-12219) Debug and repair tools for filesystem snapshots

2025-02-05 Thread Ethan Rose (Jira)
Ethan Rose created HDDS-12219: - Summary: Debug and repair tools for filesystem snapshots Key: HDDS-12219 URL: https://issues.apache.org/jira/browse/HDDS-12219 Project: Apache Ozone Issue Type: Im

Re: [PR] HDDS-11866. Remove code paths for non-Ratis OM [ozone]

2025-02-05 Thread via GitHub
jojochuang commented on code in PR #7778: URL: https://github.com/apache/ozone/pull/7778#discussion_r1943486067 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/protocolPB/OzoneManagerProtocolServerSideTranslatorPB.java: ## @@ -79,7 +71,6 @@ public class Ozone

Re: [PR] HDDS-12175. Audit logs in SCM shouldn't print delete txns [ozone]

2025-02-05 Thread via GitHub
Tejaskriya commented on PR #7805: URL: https://github.com/apache/ozone/pull/7805#issuecomment-2637765303 @adoroszlai Thanks for the review! I have made the changes and added the old and new audit log in the PR description. -- This is an automated message from the Apache Git Service. To r

Re: [PR] [DRAFT] Raft group for each bucket [ozone]

2025-02-05 Thread via GitHub
juncevich commented on PR #7808: URL: https://github.com/apache/ozone/pull/7808#issuecomment-2637700821 @kerneltime could you tell me if this https://issues.apache.org/jira/browse/HDDS-11897 has already been implemented? I would be very interested to see the implementation. -- This is an

Re: [PR] HDDS-10220. Add test case to cover HDDS-9930 batch key deletion [ozone]

2025-02-05 Thread via GitHub
jojochuang commented on code in PR #7792: URL: https://github.com/apache/ozone/pull/7792#discussion_r1943447811 ## hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestHSync.java: ## @@ -583,6 +583,49 @@ public void testHSyncDeletedKey() throws Exception {

[jira] [Created] (HDDS-12218) Add more to integration test with shared cluster

2025-02-05 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-12218: --- Summary: Add more to integration test with shared cluster Key: HDDS-12218 URL: https://issues.apache.org/jira/browse/HDDS-12218 Project: Apache Ozone I

[jira] [Commented] (HDDS-10607) Remove ozone.block.deleting.container.limit.per.interval property as it's not used anymore

2025-02-05 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924185#comment-17924185 ] Attila Doroszlai commented on HDDS-10607: - {{ozone.block.deleting.limit.per.task}

[jira] [Comment Edited] (HDDS-10607) Remove ozone.block.deleting.container.limit.per.interval property as it's not used anymore

2025-02-05 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924185#comment-17924185 ] Attila Doroszlai edited comment on HDDS-10607 at 2/5/25 5:42 PM: --

Re: [PR] HDDS-12164. Rename DFSConfigKeysLegacy config keys prefixed with 'dfs' [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on code in PR #7803: URL: https://github.com/apache/ozone/pull/7803#discussion_r1943358602 ## hadoop-ozone/dist/src/main/compose/common/security.conf: ## @@ -36,10 +36,10 @@ OZONE-SITE.XML_ozone.s3g.kerberos.principal=s3g/s...@example.com OZONE-SITE.XML_o

Re: [PR] HDDS-11866. Remove code paths for non-Ratis OM [ozone]

2025-02-05 Thread via GitHub
jojochuang commented on code in PR #7778: URL: https://github.com/apache/ozone/pull/7778#discussion_r1943347548 ## hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/PrefixManagerImpl.java: ## @@ -260,9 +254,6 @@ public OMPrefixAclOpResult addAcl(OzoneObj ozoneO

[jira] [Commented] (HDDS-10509) Allow running ratis shell commands in secure Ozone cluster.

2025-02-05 Thread Jira
[ https://issues.apache.org/jira/browse/HDDS-10509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924164#comment-17924164 ] István Fajth commented on HDDS-10509: - The problem is not because of the authenticati

[PR] HDDS-11530. Support listMultipartUploads max uploads and markers [ozone]

2025-02-05 Thread via GitHub
peterxcli opened a new pull request, #7817: URL: https://github.com/apache/ozone/pull/7817 ## What changes were proposed in this pull request? https://docs.aws.amazon.com/AmazonS3/latest/API/API_ListMultipartUploads.html Currently, ListMultipartUploads will only list up to 1000 mult

[jira] [Updated] (HDDS-11530) Support listMultipartUploads max uploads and markers

2025-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-11530: -- Labels: pull-request-available (was: ) > Support listMultipartUploads max uploads and markers

[jira] [Created] (HDDS-12217) Remove reference to FileUtil in hdds-common

2025-02-05 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-12217: --- Summary: Remove reference to FileUtil in hdds-common Key: HDDS-12217 URL: https://issues.apache.org/jira/browse/HDDS-12217 Project: Apache Ozone Issue

[jira] [Updated] (HDDS-6931) Support for serialized pre-process validators

2025-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-6931: - Labels: pull-request-available (was: ) > Support for serialized pre-process validators >

Re: [PR] HDDS-6931. Support for serialized pre-process validators [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on PR #7698: URL: https://github.com/apache/ozone/pull/7698#issuecomment-2637391397 @errose28 @kerneltime can you please help review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [PR] HDDS-10607. Removed the ozone.block.deleting.container.limit.per.interval property as it's not used anymore [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on PR #7816: URL: https://github.com/apache/ozone/pull/7816#issuecomment-2637290710 Block deletion logic was changed in HDDS-4504 to use different configuration, back in 1.2.0. Since it's already unused, I don't think we need to deprecate it now. -- This is an autom

Re: [PR] HDDS-10607. Remove unused ozone.block.deleting.container.limit.per.interval config property [ozone]

2025-02-05 Thread via GitHub
sreejasahithi commented on PR #7816: URL: https://github.com/apache/ozone/pull/7816#issuecomment-2637353108 @adoroszlai ok sure will look into it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] HDDS-10607. Remove unused ozone.block.deleting.container.limit.per.interval config property [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on PR #7816: URL: https://github.com/apache/ozone/pull/7816#issuecomment-2637350614 > Please remove `ozone.block.deleting.limit.per.task` (constant: `OZONE_BLOCK_DELETING_LIMIT_PER_CONTAINER`) similarly. Also, I think the description of `ozone.block.deleting.servi

Re: [PR] HDDS-10607. Remove unused ozone.block.deleting.container.limit.per.interval config property [ozone]

2025-02-05 Thread via GitHub
sreejasahithi commented on PR #7816: URL: https://github.com/apache/ozone/pull/7816#issuecomment-2637347370 @adoroszlai Thanks for the suggestions , I will work on ozone.block.deleting.limit.per.task aswell -- This is an automated message from the Apache Git Service. To respond to the me

Re: [PR] HDDS-10607. Remove unused ozone.block.deleting.container.limit.per.interval config property [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on PR #7816: URL: https://github.com/apache/ozone/pull/7816#issuecomment-2637329311 > ## How was this patch tested? > The patch was tested by the following tests: > > Integration (client) > Integration (container) > Integration (filesystem) > Integration

Re: [PR] HDDS-10607. Remove unused ozone.block.deleting.container.limit.per.interval config property [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on code in PR #7816: URL: https://github.com/apache/ozone/pull/7816#discussion_r1943211776 ## hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/common/TestSchemaOneBackwardsCompatibility.java: ## @@ -66,7 +66,7 @@ import java.uti

[jira] [Updated] (HDDS-12194) Distinguish update/purge snapshot

2025-02-05 Thread Venkat Sambath (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkat Sambath updated HDDS-12194: -- Description: Currently when snapshot is created/deleted in ozone-ha env, ozone-om logs indicat

Re: [PR] HDDS-12112. Fix interval used for Chunk read write Dashboard [ozone]

2025-02-05 Thread via GitHub
adoroszlai merged PR #7724: URL: https://github.com/apache/ozone/pull/7724 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

[jira] [Resolved] (HDDS-12112) Fix interval used for Chunk read write Dashboard

2025-02-05 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-12112. - Fix Version/s: 2.0.0 Resolution: Fixed > Fix interval used for Chunk read write Da

Re: [PR] HDDS-12112. Fix interval used for Chunk read write Dashboard [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on PR #7724: URL: https://github.com/apache/ozone/pull/7724#issuecomment-2637108559 Thanks @kerneltime for the patch, @jojochuang, @tanvipenumudy for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [PR] HDDS-10607. Removed the ozone.block.deleting.container.limit.per.interval property as it's not used anymore [ozone]

2025-02-05 Thread via GitHub
tanvipenumudy commented on PR #7816: URL: https://github.com/apache/ozone/pull/7816#issuecomment-2636943171 @nandakumar131, @adoroszlai just wanted to check if the configuration: `ozone.block.deleting.container.limit.per.interval` was being used previously but not used anymore - as in this

Re: [PR] HDDS-12200. Fix grammar in OM HA, EC and Snapshot doc [ozone]

2025-02-05 Thread via GitHub
sreejasahithi commented on PR #7806: URL: https://github.com/apache/ozone/pull/7806#issuecomment-2636956069 @adoroszlai Thanks! Glad to help! 😊 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (HDDS-12201) Remove unused, dead code in httpfsgateway

2025-02-05 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-12201: Status: Patch Available (was: In Progress) > Remove unused, dead code in httpfsgateway > -

[PR] HDDS-10607. Removed the ozone.block.deleting.container.limit.per.interval property as it's not used anymore [ozone]

2025-02-05 Thread via GitHub
sreejasahithi opened a new pull request, #7816: URL: https://github.com/apache/ozone/pull/7816 ## What changes were proposed in this pull request? The ozone.block.deleting.container.limit.per.interval property, along with the test cases referring to this property, were removed as it is no

[jira] [Updated] (HDDS-10607) Remove ozone.block.deleting.container.limit.per.interval property as it's not used anymore

2025-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-10607: -- Labels: pull-request-available (was: ) > Remove ozone.block.deleting.container.limit.per.inter

Re: [PR] HDDS-12212. Fix grammar in decommissioning and observability documentation [ozone]

2025-02-05 Thread via GitHub
tanvipenumudy merged PR #7815: URL: https://github.com/apache/ozone/pull/7815 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.a

Re: [PR] HDDS-12185. Enhance FileSizeCountTask for Faster Processing. [ozone]

2025-02-05 Thread via GitHub
devmadhuu commented on code in PR #7796: URL: https://github.com/apache/ozone/pull/7796#discussion_r1942942414 ## hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/tasks/FileSizeCountTask.java: ## @@ -233,20 +272,25 @@ private void writeCountsToDB(boolean isDbTrunca

[jira] [Resolved] (HDDS-12212) Fix grammar in Decommissioning and Observability in the doc

2025-02-05 Thread Tanvi Penumudy (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanvi Penumudy resolved HDDS-12212. --- Resolution: Fixed > Fix grammar in Decommissioning and Observability in the doc > ---

[jira] [Updated] (HDDS-12212) Fix grammar in Decommissioning and Observability in the doc

2025-02-05 Thread Tanvi Penumudy (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanvi Penumudy updated HDDS-12212: -- Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Fix grammar in Decommissioning and Observ

[PR] HDDS-12212. Fix grammar in Decommissioning and Observability in the doc [ozone]

2025-02-05 Thread via GitHub
Gargi-jais11 opened a new pull request, #7815: URL: https://github.com/apache/ozone/pull/7815 ## What changes were proposed in this pull request? 1. In the Decommissioning feature in upstream doc for the OM decommissioning one grammatical mistake is there: "Add **the OM NodeId

[jira] [Updated] (HDDS-12212) Fix grammar in Decommissioning and Observability in the doc

2025-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12212: -- Labels: pull-request-available (was: ) > Fix grammar in Decommissioning and Observability in t

Re: [PR] HDDS-12192. Fix TestOzoneShellHA and extract set-bucket-encryption test case [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on PR #7802: URL: https://github.com/apache/ozone/pull/7802#issuecomment-2636709828 @tanvipenumudy please review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] HDDS-12175. Audit logs in SCM shouldn't print delete txns [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on code in PR #7805: URL: https://github.com/apache/ozone/pull/7805#discussion_r1942900830 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/server/SCMDatanodeProtocolServer.java: ## @@ -280,6 +280,22 @@ public static SCMRegisteredResponsePr

[jira] [Created] (HDDS-12216) Intermittent disk out of space in integration check

2025-02-05 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-12216: --- Summary: Intermittent disk out of space in integration check Key: HDDS-12216 URL: https://issues.apache.org/jira/browse/HDDS-12216 Project: Apache Ozone

[jira] [Created] (HDDS-12215) Intermittent timeout in testContainerStateMachineRestartWithDNChangePipeline

2025-02-05 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-12215: --- Summary: Intermittent timeout in testContainerStateMachineRestartWithDNChangePipeline Key: HDDS-12215 URL: https://issues.apache.org/jira/browse/HDDS-12215 Proj

[jira] [Updated] (HDDS-12215) Intermittent timeout in testContainerStateMachineRestartWithDNChangePipeline

2025-02-05 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-12215: Description: {code:title=https://github.com/adoroszlai/ozone-build-results/blob/master/2025

Re: [PR] HDDS-12200. Fix grammar in OM HA, EC and Snapshot doc [ozone]

2025-02-05 Thread via GitHub
adoroszlai commented on PR #7806: URL: https://github.com/apache/ozone/pull/7806#issuecomment-2636309035 Thanks @sreejasahithi for the contribution. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[jira] [Updated] (HDDS-12201) Remove unused, dead code in httpfsgateway

2025-02-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12201: -- Labels: pull-request-available (was: ) > Remove unused, dead code in httpfsgateway > -

  1   2   >