[ https://issues.apache.org/jira/browse/HDFS-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Scott Chen resolved HDFS-1143. ------------------------------ Resolution: Not A Problem > Implement Background deletion > ----------------------------- > > Key: HDFS-1143 > URL: https://issues.apache.org/jira/browse/HDFS-1143 > Project: Hadoop HDFS > Issue Type: Improvement > Components: name-node > Affects Versions: 0.22.0 > Reporter: Dmytro Molkov > Assignee: Scott Chen > Attachments: HDFS-1143-v2.txt, HDFS-1143.txt > > > Right now if you try to delete massive number of files from the namenode it > will freeze (sometimes for minutes). Most of the time is spent going through > the blocks map and invalidating all the blocks. > This can probably be improved by having a background GC process. The deletion > will basically just remove the inode being deleted and then give the subtree > that was just deleted to the background thread running cleanup. > This way the namenode becomes available for the clients soon after deletion, > and all the heavy operations are done in the background. > Thoughts? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira