[
https://issues.apache.org/jira/browse/HDDS-13079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aryan Gupta resolved HDDS-13079.
--------------------------------
Fix Version/s: 2.1.0
Resolution: Fixed
> Improve logging in DN for delete operation
> ------------------------------------------
>
> Key: HDDS-13079
> URL: https://issues.apache.org/jira/browse/HDDS-13079
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: DN
> Reporter: Ashish Kumar
> Assignee: Ashish Kumar
> Priority: Major
> Labels: pull-request-available
> Fix For: 2.1.0
>
>
> 1. Below log can come in some scenario and leads to confusion.
> One of the scenario is when container is open and deletes are happening on
> those container. Those transactions remains in SCM db until container gets
> CLOSED.
> When container gets closed, SCM sends delete transactions for that container
> to DN at the same time. DN uses multiple thread in command handler which may
> lead to higher transaction value is processed before smaller one and causing
> logs to flood like below.
> We can change below log to DEBUG level.
> {code:java}
> 2025-05-19 08:52:51,883 INFO
> [DeleteBlocksCommandHandlerThread-1]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler:
> Delete blocks for containerId: 3 is either received out of order or retried,
> 98 <= 150
> 2025-05-19 08:52:51,884 INFO
> [DeleteBlocksCommandHandlerThread-3]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler:
> Delete blocks for containerId: 3 is either received out of order or retried,
> 124 <= 150
> 2025-05-19 08:52:51,884 INFO
> [DeleteBlocksCommandHandlerThread-4]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler:
> Delete blocks for containerId: 3 is either received out of order or retried,
> 146 <= 150
> 2025-05-19 08:52:51,885 INFO
> [DeleteBlocksCommandHandlerThread-0]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler:
> Delete blocks for containerId: 3 is either received out of order or retried,
> 160 <= 200
> 2025-05-19 08:52:51,885 INFO
> [DeleteBlocksCommandHandlerThread-2]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler:
> Delete blocks for containerId: 3 is either received out of order or retried,
> 174 <= 210
> 2025-05-19 08:52:51,886 INFO
> [DeleteBlocksCommandHandlerThread-1]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler:
> Delete blocks for containerId: 3 is either received out of order or retried,
> 182 <= 210
> 2025-05-19 08:52:51,886 INFO
> [DeleteBlocksCommandHandlerThread-3]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler:
> Delete blocks for containerId: 3 is either received out of order or retried,
> 197 <= 210
> 2025-05-19 08:52:51,887 INFO
> [DeleteBlocksCommandHandlerThread-4]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler:
> Delete blocks for containerId: 3 is either received out of order or retried,
> 205 <= 255
> 2025-05-19 08:52:51,887 INFO
> [DeleteBlocksCommandHandlerThread-0]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler:
> Delete blocks for containerId: 3 is either received out of order or retried,
> 216 <= 265
> 2025-05-19 08:52:51,888 INFO
> [DeleteBlocksCommandHandlerThread-2]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler:
> Delete blocks for containerId: 3 is either received out of order or retried,
> 230 <= 296
> 2025-05-19 08:52:51,888 INFO
> [DeleteBlocksCommandHandlerThread-1]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler:
> Delete blocks for containerId: 3 is either received out of order or retried,
> 242 <= 296 {code}
>
> 2. Change below log to info level also add count of success and failed
> transaction when DN process delete request from SCM.
> {code:java}
> LOG.debug("Sending following block deletion ACK to SCM");{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
