Nandakumar created HDDS-12292:
---------------------------------
Summary: Change log level in SCMNodeManager#getNodesByAddress to
debug
Key: HDDS-12292
URL: https://issues.apache.org/jira/browse/HDDS-12292
Project: Apache Ozone
Issue Type: Sub-task
Components: SCM
Reporter: Nandakumar
Assignee: Nandakumar
{{SCMNodeManager#getNodesByAddress}} is called from
{{BlockProtocolServer#allocateBlock}} and
{{BlockProtocolServer#sortDatanodes}}, in both the cases the client could be
running on a node that's not a datanode. Because of this the SCM log file is
flooded with {{Cannot find node for address}} messages.
{code}
2025-01-14 13:36:23,602 WARN [IPC Server handler 79 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.151
2025-01-14 13:36:23,602 WARN [IPC Server handler 78 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.152
2025-01-14 13:36:23,614 WARN [IPC Server handler 18 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.152
2025-01-14 13:36:23,614 WARN [IPC Server handler 32 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.151
2025-01-14 13:36:23,614 WARN [IPC Server handler 18 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.152
2025-01-14 13:36:23,614 WARN [IPC Server handler 78 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.115
2025-01-14 13:36:23,614 WARN [IPC Server handler 64 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.115
2025-01-14 13:36:23,614 WARN [IPC Server handler 58 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.151
2025-01-14 13:36:23,614 WARN [IPC Server handler 11 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.153
2025-01-14 13:36:23,614 WARN [IPC Server handler 31 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.151
2025-01-14 13:36:23,614 WARN [IPC Server handler 33 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.153
2025-01-14 13:36:23,614 WARN [IPC Server handler 11 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.152
2025-01-14 13:36:23,614 WARN [IPC Server handler 25 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.117
2025-01-14 13:36:23,614 WARN [IPC Server handler 15 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.152
2025-01-14 13:36:23,614 WARN [IPC Server handler 83 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.152
2025-01-14 13:36:23,614 WARN [IPC Server handler 43 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.140
2025-01-14 13:36:23,614 WARN [IPC Server handler 66 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.151
2025-01-14 13:36:23,614 WARN [IPC Server handler 4 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.28.6.115
2025-01-14 13:36:23,614 WARN [IPC Server handler 4 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.28.6.153
2025-01-14 13:36:23,614 WARN [IPC Server handler 74 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.115
2025-01-14 13:36:23,614 WARN [IPC Server handler 38 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.151
2025-01-14 13:36:23,614 WARN [IPC Server handler 12 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.152
2025-01-14 13:36:23,614 WARN [IPC Server handler 42 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.140
2025-01-14 13:36:23,614 WARN [IPC Server handler 67 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.152
2025-01-14 13:36:23,614 WARN [IPC Server handler 71 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.117
2025-01-14 13:36:23,614 WARN [IPC Server handler 34 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.152
2025-01-14 13:36:23,614 WARN [IPC Server handler 12 on
9863]-org.apache.hadoop.hdds.scm.node.SCMNodeManager: Cannot find node for
address 172.xx.x.151
{code}
We don't have to log a WARN message for this case, we can change this is DEBUG
message.
This will reduce the log file size and make it easier to debug other issues.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
