Thank you for raising the issue of this long-standing bottleneck, this will be a very important improvement!
Hopefully can participate and push forward together. Best Regards~ Brahma Reddy Battula <bra...@apache.org> 于2024年2月3日周六 00:40写道： > Thanks for bringing this and considering all the history around this. > One of the outstanding bottleneck(global lock) from a long time. > > Hopefully we can push forward this time. > > > On Fri, Feb 2, 2024 at 12:23 PM Hui Fei <feihui.u...@gmail.com> wrote: > > > Thanks for driving this. It's very meaningful. The performance > improvement > > looks very good. > > > > Many users are facing the write performance issue. As far as I know, some > > companies already implemented the similar idea on their internal > branches. > > But the internal branch is very different from the community one. So it's > > very hard to be in sync with the community. If this improvement can be > > involved in the community, that would be great to both end-user and the > > community. > > > > It is very worth doing. > > > > Zengqiang XU <zande...@apache.org> 于2024年2月2日周五 11:07写道： > > > > > Hi everyone > > > > > > I have started a discussion about NameNode Fine-grained Locking to > > improve > > > performance of write operations in NameNode. > > > > > > I started this discussion again for serval main reasons: > > > 1. We have implemented it and gained nearly 7x performance improvement > in > > > our prod environment > > > 2. Many other companies made similar improvements based on their > internal > > > branch. > > > 3. This topic has been discussed for a long time, but still without any > > > results. > > > > > > I hope we can push this important improvement in the community so that > > all > > > end-users can enjoy this significant improvement. > > > > > > I'd really appreciate you can join in and work with me to push this > > feature > > > forward. > > > > > > Thanks very much. > > > > > > Ticket: HDFS-17366 <https://issues.apache.org/jira/browse/HDFS-17366> > > > Design: NameNode Fine-grained locking based on directory tree > > > < > > > > > > https://docs.google.com/document/d/1bVBQcI4jfzS0UrczB7UhsrQTXmrERGvBV-a9W3HCCjk/edit?usp=sharing > > > > > > > > > >
