aryangupta1998 opened a new pull request, #8347:
URL: https://github.com/apache/ozone/pull/8347

   ## What changes were proposed in this pull request?
   
   When deleting the block status from the SCM record, there will be a 
`transactionToDNsCommitMap` structure record. We encountered this structure 
accumulating too much content and occupying too much memory, causing the SCM to 
have a long GC time of 327 seconds.
   
   ```
   GC log:
   
   2025-01-15 08:25:14,789 [JvmPauseMonitor0] ERROR 
org.apache.ratis.server.RaftServer: 127e9d82-790c-40c5-af90-050564a06a45: JVM 
pause detected 372.305s longer than the close-threshold 120s, shutting down ... 
   ```
   
   Before iterating the deleteBlocks table and sending a delete request to dn, 
if the content in the `transactionToDNsCommitMap` is found to be too large and 
exceeds a certain threshold, pause the iteration of the deleteBlocks table for 
a while.
   
   ## What is the link to the Apache JIRA
   
   https://issues.apache.org/jira/browse/HDDS-12087
   
   ## How was this patch tested?
   
   Tested Manually.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to