Thanks for bringing this and considering all the history around this. One of the outstanding bottleneck(global lock) from a long time.
Hopefully we can push forward this time. On Fri, Feb 2, 2024 at 12:23 PM Hui Fei <feihui.u...@gmail.com> wrote: > Thanks for driving this. It's very meaningful. The performance improvement > looks very good. > > Many users are facing the write performance issue. As far as I know, some > companies already implemented the similar idea on their internal branches. > But the internal branch is very different from the community one. So it's > very hard to be in sync with the community. If this improvement can be > involved in the community, that would be great to both end-user and the > community. > > It is very worth doing. > > Zengqiang XU <zande...@apache.org> 于2024年2月2日周五 11:07写道： > > > Hi everyone > > > > I have started a discussion about NameNode Fine-grained Locking to > improve > > performance of write operations in NameNode. > > > > I started this discussion again for serval main reasons: > > 1. We have implemented it and gained nearly 7x performance improvement in > > our prod environment > > 2. Many other companies made similar improvements based on their internal > > branch. > > 3. This topic has been discussed for a long time, but still without any > > results. > > > > I hope we can push this important improvement in the community so that > all > > end-users can enjoy this significant improvement. > > > > I'd really appreciate you can join in and work with me to push this > feature > > forward. > > > > Thanks very much. > > > > Ticket: HDFS-17366 <https://issues.apache.org/jira/browse/HDFS-17366> > > Design: NameNode Fine-grained locking based on directory tree > > < > > > https://docs.google.com/document/d/1bVBQcI4jfzS0UrczB7UhsrQTXmrERGvBV-a9W3HCCjk/edit?usp=sharing > > > > > >
