Thanks for driving this. It's very meaningful. The performance improvement looks very good.
Many users are facing the write performance issue. As far as I know, some companies already implemented the similar idea on their internal branches. But the internal branch is very different from the community one. So it's very hard to be in sync with the community. If this improvement can be involved in the community, that would be great to both end-user and the community. It is very worth doing. Zengqiang XU <zande...@apache.org> 于2024年2月2日周五 11:07写道： > Hi everyone > > I have started a discussion about NameNode Fine-grained Locking to improve > performance of write operations in NameNode. > > I started this discussion again for serval main reasons: > 1. We have implemented it and gained nearly 7x performance improvement in > our prod environment > 2. Many other companies made similar improvements based on their internal > branch. > 3. This topic has been discussed for a long time, but still without any > results. > > I hope we can push this important improvement in the community so that all > end-users can enjoy this significant improvement. > > I'd really appreciate you can join in and work with me to push this feature > forward. > > Thanks very much. > > Ticket: HDFS-17366 <https://issues.apache.org/jira/browse/HDFS-17366> > Design: NameNode Fine-grained locking based on directory tree > < > https://docs.google.com/document/d/1bVBQcI4jfzS0UrczB7UhsrQTXmrERGvBV-a9W3HCCjk/edit?usp=sharing > > >
