Re: [PR] HDDS-12116. Customizable Protobuf shaded prefix in ozonefs-hadoop3-client. [ozone]

2025-01-23 Thread via GitHub
jojochuang commented on PR #7729: URL: https://github.com/apache/ozone/pull/7729#issuecomment-2611829216 It's not a scalable solution. We have ozonefs-hadoop3-client built for Spark (because Spark expects the hadoop-client-runtime which contains shaded protobuf jars) Now we need to bui

Re: [PR] HDDS-12094. Update BasicKeyInfo to include isFile payload [ozone]

2025-01-23 Thread via GitHub
ptlrs commented on code in PR #7740: URL: https://github.com/apache/ozone/pull/7740#discussion_r1928200956 ## hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/OzoneRpcClientTests.java: ## @@ -2839,6 +2839,46 @@ public void testListKey() assertF

[jira] [Updated] (HDDS-12089) Move execute_debug_tests out of testlib.sh

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12089: -- Labels: pull-request-available (was: ) > Move execute_debug_tests out of testlib.sh >

[jira] [Updated] (HDDS-11688) Ozone Recon - Improve processing performance of OM DB events by NSSummary task

2025-01-23 Thread Devesh Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devesh Kumar Singh updated HDDS-11688: -- Summary: Ozone Recon - Improve processing performance of OM DB events by NSSummary task

[jira] [Updated] (HDDS-11688) Ozone Recon - Improve processing performance of OM DB events by NSSummaryTask

2025-01-23 Thread Devesh Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devesh Kumar Singh updated HDDS-11688: -- Summary: Ozone Recon - Improve processing performance of OM DB events by NSSummaryTask

[jira] [Updated] (HDDS-12110) Optimize memory overhead for OM background tasks

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12110: -- Labels: pull-request-available (was: ) > Optimize memory overhead for OM background tasks > --

[jira] [Commented] (HDDS-12131) NPE in OM when overwriting empty file using multipart upload

2025-01-23 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17916599#comment-17916599 ] Attila Doroszlai commented on HDDS-12131: - Thanks [~ksugihara] for fixing this.

[jira] [Updated] (HDDS-12131) NPE in OM when overwriting empty file using multipart upload

2025-01-23 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-12131: Summary: NPE in OM when overwriting empty file using multipart upload (was: Overwrite an e

[jira] [Resolved] (HDDS-12131) Overwrite an empty file with multipart-upload throws NPE

2025-01-23 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-12131. - Fix Version/s: 2.0.0 Resolution: Fixed > Overwrite an empty file with multipart-up

Re: [PR] HDDS-12131. Overwrite an empty file with multipart-upload throws NPE [ozone]

2025-01-23 Thread via GitHub
adoroszlai merged PR #7739: URL: https://github.com/apache/ozone/pull/7739 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

Re: [PR] HDDS-12081. TestKeyInputStream repeats tests with default container layout [ozone]

2025-01-23 Thread via GitHub
adoroszlai commented on PR #7704: URL: https://github.com/apache/ozone/pull/7704#issuecomment-2611665004 Thanks @jojochuang for the review, good points. I have updated the patch. (I don't intend to remove usage of `FILE_PER_CHUNK` from unit tests.) -- This is an automated message from t

Re: [PR] HDDS-12130. Improve assertion compatibility with old Hadoop [ozone]

2025-01-23 Thread via GitHub
adoroszlai commented on PR #7738: URL: https://github.com/apache/ozone/pull/7738#issuecomment-2611625133 Thanks @nandakumar131 for reviewing and merging it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] HDDS-12130. Improve assertion compatibility with old Hadoop [ozone]

2025-01-23 Thread via GitHub
nandakumar131 merged PR #7738: URL: https://github.com/apache/ozone/pull/7738 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.a

[jira] [Updated] (HDDS-12130) Improve assertion compatibility with old Hadoop

2025-01-23 Thread Nandakumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDDS-12130: -- Fix Version/s: 2.0.0 Resolution: Fixed Status: Resolved (was: Patch Available) The P

Re: [PR] HDDS-12130. Improve assertion compatibility with old Hadoop [ozone]

2025-01-23 Thread via GitHub
nandakumar131 commented on PR #7738: URL: https://github.com/apache/ozone/pull/7738#issuecomment-2611570025 Thanks @adoroszlai for finding and fixing this! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HDDS-11798) Move SafeModeRule names to respective rules

2025-01-23 Thread Nandakumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDDS-11798: -- Status: Patch Available (was: In Progress) > Move SafeModeRule names to respective rules > ---

[jira] [Updated] (HDDS-11798) Move SafeModeRule names to respective rules

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-11798: -- Labels: pull-request-available (was: ) > Move SafeModeRule names to respective rules > ---

[PR] HDDS-11798. Move SafeModeRule names to respective rules. [ozone]

2025-01-23 Thread via GitHub
nandakumar131 opened a new pull request, #7742: URL: https://github.com/apache/ozone/pull/7742 ## What changes were proposed in this pull request? Move SafeModeRule names to respective rules. ## What is the link to the Apache JIRA HDDS-11798 ## How was this patch teste

Re: [PR] HDDS-11626. Document short-circuit read feature [ozone]

2025-01-23 Thread via GitHub
ChenSammi commented on code in PR #7529: URL: https://github.com/apache/ozone/pull/7529#discussion_r1928025544 ## hadoop-hdds/docs/content/feature/Short-Circuit-Read.md: ## @@ -0,0 +1,78 @@ +--- +title: "Short Circuit Local Read in Datanode" +weight: 2 +menu: + main: + pa

Re: [PR] HDDS-11626. Document short-circuit read feature [ozone]

2025-01-23 Thread via GitHub
ChenSammi commented on code in PR #7529: URL: https://github.com/apache/ozone/pull/7529#discussion_r1928022014 ## hadoop-hdds/docs/content/feature/Short-Circuit-Read.md: ## @@ -0,0 +1,78 @@ +--- +title: "Short Circuit Local Read in Datanode" +weight: 2 +menu: + main: + pa

Re: [PR] HDDS-10338. Implement a Client Datanode API to stream a block [ozone]

2025-01-23 Thread via GitHub
guohao-rosicky commented on PR #6613: URL: https://github.com/apache/ozone/pull/6613#issuecomment-2611397881 Can you resolve the code conflict? @chungen0126 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] HDDS-12081. TestKeyInputStream repeats tests with default container layout [ozone]

2025-01-23 Thread via GitHub
jojochuang commented on code in PR #7704: URL: https://github.com/apache/ozone/pull/7704#discussion_r1927961019 ## hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/read/TestInputStreamBase.java: ## @@ -81,4 +86,38 @@ static String getNewKeyName() {

[jira] [Updated] (HDDS-12122) Add tests for SnapshotChainRepair

2025-01-23 Thread Peter Lee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Lee updated HDDS-12122: - Status: Patch Available (was: In Progress) Just filed a PR for this, but have some type in original PR t

[PR] H12122. Add tests for SnapshotChainRepair [ozone]

2025-01-23 Thread via GitHub
peterxcli opened a new pull request, #7741: URL: https://github.com/apache/ozone/pull/7741 ## What changes were proposed in this pull request? Add test coverage (integration) for ozone repair om snapshot chain. ## What is the link to the Apache JIRA https://issues.apache.org/

[jira] [Resolved] (HDDS-12128) Prevent under-construction v2 site from being indexed by web search engines

2025-01-23 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose resolved HDDS-12128. --- Resolution: Fixed > Prevent under-construction v2 site from being indexed by web search engines > ---

Re: [PR] HDDS-12128. Disable indexing of the under-construction site [ozone-site]

2025-01-23 Thread via GitHub
errose28 merged PR #123: URL: https://github.com/apache/ozone-site/pull/123 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apa

[PR] HDDS-12094. Update BasicKeyInfo to include isFile payload [ozone]

2025-01-23 Thread via GitHub
ptlrs opened a new pull request, #7740: URL: https://github.com/apache/ozone/pull/7740 ## What changes were proposed in this pull request? The filename of directories and subdirectories do not have a trailing slash. This results in them being interpreted as files instead of director

[jira] [Updated] (HDDS-12128) Prevent under-construction v2 site from being indexed by web search engines

2025-01-23 Thread Rishabh Patel (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rishabh Patel updated HDDS-12128: - Description:  Ozone v2 site's webpages are indexed by Google and visible to the world. This is p

[jira] [Updated] (HDDS-12094) OzoneKey isFile returns true for directories

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12094: -- Labels: pull-request-available (was: ) > OzoneKey isFile returns true for directories > --

[jira] [Updated] (HDDS-12131) Overwrite an empty file with multipart-upload throws NPE

2025-01-23 Thread Kohei Sugihara (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kohei Sugihara updated HDDS-12131: -- Description: OM throws NullPointerException (NPE) on S3MultipartUploadCompleteRequestWithFSO w

[jira] [Updated] (HDDS-12128) Prevent under-construction v2 site from being indexed by web search engines

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12128: -- Labels: pull-request-available (was: ) > Prevent under-construction v2 site from being indexed

[PR] HDDS-12128. Disable indexing of the under-construction site [ozone-site]

2025-01-23 Thread via GitHub
ptlrs opened a new pull request, #123: URL: https://github.com/apache/ozone-site/pull/123 ## What changes were proposed in this pull request? Do not allow search engines to index the under-construction website. We do this by updating the HTML headers to `` via https://docusaurus.

[jira] [Updated] (HDDS-12128) Prevent under-construction v2 site from being indexed by web search engines

2025-01-23 Thread Rishabh Patel (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rishabh Patel updated HDDS-12128: - Description:  Ozone v2 site's webpages are indexed by Google and visible to the world. This is p

[jira] [Created] (HDDS-12134) Implement Snapshot Cache lock for OM Bootstrap

2025-01-23 Thread Swaminathan Balachandran (Jira)
Swaminathan Balachandran created HDDS-12134: --- Summary: Implement Snapshot Cache lock for OM Bootstrap Key: HDDS-12134 URL: https://issues.apache.org/jira/browse/HDDS-12134 Project: Apache Ozo

Re: [PR] HDDS-12114. Prevent delete commands running after a long lock wait and send ICR earlier [ozone]

2025-01-23 Thread via GitHub
errose28 commented on code in PR #7726: URL: https://github.com/apache/ozone/pull/7726#discussion_r1927712436 ## hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/OzoneConfigKeys.java: ## @@ -322,7 +322,6 @@ public final class OzoneConfigKeys { public static final Stri

Re: [PR] HDDS-12114. Prevent delete commands running after a long lock wait and send ICR earlier [ozone]

2025-01-23 Thread via GitHub
errose28 commented on code in PR #7726: URL: https://github.com/apache/ozone/pull/7726#discussion_r1927706185 ## hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/OzoneConfigKeys.java: ## @@ -322,6 +322,11 @@ public final class OzoneConfigKeys { public static final Str

Re: [PR] HDDS-11345. Add metrics specific tests for reconciliation tasks. [ozone]

2025-01-23 Thread via GitHub
errose28 commented on code in PR #7732: URL: https://github.com/apache/ozone/pull/7732#discussion_r1927649216 ## hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/common/statemachine/commandhandler/TestReconcileContainerCommandHandler.java: ## @@ -141

[jira] [Resolved] (HDDS-10585) ManagedChannelImpl not closed properly in TestContainerMapper

2025-01-23 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-10585. - Resolution: Cannot Reproduce Last seen 2024/04/30 > ManagedChannelImpl not closed proper

[jira] [Created] (HDDS-12133) Define replication metrics task names and descriptions as constants to reuse in CommandHandler

2025-01-23 Thread Ethan Rose (Jira)
Ethan Rose created HDDS-12133: - Summary: Define replication metrics task names and descriptions as constants to reuse in CommandHandler Key: HDDS-12133 URL: https://issues.apache.org/jira/browse/HDDS-12133

[jira] [Commented] (HDDS-12077) Make container scanner generate metadata checksum for use by EC

2025-01-23 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17916502#comment-17916502 ] Ethan Rose commented on HDDS-12077: --- We have decided to move this out of phase 1. If we

[jira] [Updated] (HDDS-12077) Make container scanner generate metadata checksum for use by EC

2025-01-23 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose updated HDDS-12077: -- Description: As part of design discussions for identifying container divergence and fixing it increment

[jira] [Created] (HDDS-12132) Parameterize testUpdateTransactionInfoTable for SCM

2025-01-23 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-12132: --- Summary: Parameterize testUpdateTransactionInfoTable for SCM Key: HDDS-12132 URL: https://issues.apache.org/jira/browse/HDDS-12132 Project: Apache Ozone

[jira] [Updated] (HDDS-12050) Implement TransactionInfoRepair command for SCM

2025-01-23 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-12050: Fix Version/s: 2.0.0 Resolution: Implemented Status: Resolved (was: Patch

[jira] [Assigned] (HDDS-12131) Overwrite an empty file with multipart-upload throws NPE

2025-01-23 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai reassigned HDDS-12131: --- Assignee: Kohei Sugihara > Overwrite an empty file with multipart-upload throws NPE

Re: [PR] HDDS-12050. Implement TransactionInfoRepair command for SCM [ozone]

2025-01-23 Thread via GitHub
adoroszlai merged PR #7689: URL: https://github.com/apache/ozone/pull/7689 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

Re: [PR] HDDS-12050. Implement TransactionInfoRepair command for SCM [ozone]

2025-01-23 Thread via GitHub
adoroszlai commented on PR #7689: URL: https://github.com/apache/ozone/pull/7689#issuecomment-2610573779 Thanks @sarvekshayr for the patch, @nandakumar131, @Tejaskriya for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Updated] (HDDS-12131) Overwrite an empty file with multipart-upload throws NPE

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-12131: -- Labels: pull-request-available (was: ) > Overwrite an empty file with multipart-upload throws

[PR] HDDS-12131. Overwrite an empty file with multipart-upload throws NPE [ozone]

2025-01-23 Thread via GitHub
k5342 opened a new pull request, #7739: URL: https://github.com/apache/ozone/pull/7739 ## What changes were proposed in this pull request? S3MultipartUploadCompleteRequestWithFSO seems to throw NPE when an empty file is being overwritten by non-zero file because omBucketInfo allows null

[jira] [Updated] (HDDS-12131) Overwrite an empty file with multipart-upload throws NPE

2025-01-23 Thread Kohei Sugihara (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kohei Sugihara updated HDDS-12131: -- Summary: Overwrite an empty file with multipart-upload throws NPE (was: Overwrite an empty fil

[jira] [Updated] (HDDS-12131) Overwrite an empty file with multipart-upload occurs NPE

2025-01-23 Thread Kohei Sugihara (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kohei Sugihara updated HDDS-12131: -- Description: OM throws NullPointerException (NPE) on S3MultipartUploadCompleteRequestWithFSO w

[jira] [Updated] (HDDS-12131) Overwrite an empty file with multipart-upload occurs NPE

2025-01-23 Thread Kohei Sugihara (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kohei Sugihara updated HDDS-12131: -- Description: OM throws NullPointerException (NPE) on S3MultipartUploadCompleteRequestWithFSO w

[jira] [Created] (HDDS-12131) Overwrite an empty file with multipart-upload occurs NPE

2025-01-23 Thread Kohei Sugihara (Jira)
Kohei Sugihara created HDDS-12131: - Summary: Overwrite an empty file with multipart-upload occurs NPE Key: HDDS-12131 URL: https://issues.apache.org/jira/browse/HDDS-12131 Project: Apache Ozone

[jira] [Updated] (HDDS-12108) Grafana Dashboard for visualizing commitindex across OMs

2025-01-23 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-12108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-12108: Fix Version/s: 2.0.0 Resolution: Implemented Status: Resolved (was: Patch

Re: [PR] HDDS-12108. Grafana Dashboard for OM CommitIndex [ozone]

2025-01-23 Thread via GitHub
adoroszlai commented on PR #7719: URL: https://github.com/apache/ozone/pull/7719#issuecomment-2610242527 Thanks @venkatsambath for the patch, @kerneltime for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] HDDS-12108. Grafana Dashboard for OM CommitIndex [ozone]

2025-01-23 Thread via GitHub
adoroszlai merged PR #7719: URL: https://github.com/apache/ozone/pull/7719 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

Re: [PR] HDDS-12116. Customizable Protobuf shaded prefix in ozonefs-hadoop3-client. [ozone]

2025-01-23 Thread via GitHub
adoroszlai commented on PR #7729: URL: https://github.com/apache/ozone/pull/7729#issuecomment-2610032600 Thanks @apotheque for the patch. > I didn’t even know that the ozonefs-hadoop3-client is intended for Spark `ozonefs-hadoop3-client` is intended for anything that uses `hado

Re: [PR] HDDS-12116. Customizable Protobuf shaded prefix in ozonefs-hadoop3-client. [ozone]

2025-01-23 Thread via GitHub
apotheque commented on PR #7729: URL: https://github.com/apache/ozone/pull/7729#issuecomment-2609883433 I didn’t even know that the ozonefs-hadoop3-client is intended for Spark; it’s not clear as it is. Perhaps a better solution would be to add a suffix to this jar. For example, the final j

[jira] [Updated] (HDDS-11892) Remove config from SCM for disabling Ratis

2025-01-23 Thread Nandakumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDDS-11892: -- Status: Patch Available (was: In Progress) > Remove config from SCM for disabling Ratis >

Re: [PR] HDDS-11714. resetDeletedBlockRetryCount with --all may fail and can cause long db lock in large cluster [ozone]

2025-01-23 Thread via GitHub
nandakumar131 commented on code in PR #7665: URL: https://github.com/apache/ozone/pull/7665#discussion_r1926824601 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/block/DeletedBlockLogImpl.java: ## @@ -129,7 +129,7 @@ public List getFailedTransactions(int cou

Re: [PR] HDDS-12050. Implement TransactionInfoRepair command for SCM [ozone]

2025-01-23 Thread via GitHub
nandakumar131 commented on PR #7689: URL: https://github.com/apache/ozone/pull/7689#issuecomment-2609548318 Thanks @adoroszlai for solving the conflict. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Updated] (HDDS-11799) Remove hdds.scm.safemode.pipeline-availability.check property.

2025-01-23 Thread Nandakumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDDS-11799: -- Description: The Pipeline creation logic has changed a lot from the time {{"hdds.scm.safemode.pipeline

[jira] [Updated] (HDDS-11799) Remove hdds.scm.safemode.pipeline-availability.check property.

2025-01-23 Thread Nandakumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDDS-11799: -- Summary: Remove hdds.scm.safemode.pipeline-availability.check property. (was: Move isRuleEnabled check

Re: [PR] HDDS-12108. Grafana Dashboard for OM CommitIndex [ozone]

2025-01-23 Thread via GitHub
kerneltime commented on PR #7719: URL: https://github.com/apache/ozone/pull/7719#issuecomment-2609429089 > Thank you for this! LGTM, make a change along the following line. > > 1. Each follower reports its index > 2. The leader reports the follower index it knows about. > > T

[jira] [Updated] (HDDS-11730) Use serviceloader to load SafeModeRules

2025-01-23 Thread Nandakumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDDS-11730: -- Summary: Use serviceloader to load SafeModeRules (was: Use annotations to load SafeModeRules) > Use s

Re: [PR] HDDS-11946. Require all ozone repair commands to support a --dry-run option [ozone]

2025-01-23 Thread via GitHub
adoroszlai merged PR #7682: URL: https://github.com/apache/ozone/pull/7682 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@ozone.apac

[jira] [Updated] (HDDS-11946) Require all ozone repair commands to support a --dry-run option

2025-01-23 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-11946: Fix Version/s: 2.0.0 Resolution: Implemented Status: Resolved (was: Patch

Re: [PR] HDDS-11946. Require all ozone repair commands to support a --dry-run option [ozone]

2025-01-23 Thread via GitHub
adoroszlai commented on PR #7682: URL: https://github.com/apache/ozone/pull/7682#issuecomment-2609319418 Thanks @errose28, @nandakumar131, @sarvekshayr, @Tejaskriya for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH