[jira] [Created] (HDFS-17728) TestDFSIO can use another name service except the default one

2025-02-18 Thread Hui Fei (Jira)
Hui Fei created HDFS-17728: -- Summary: TestDFSIO can use another name service except the default one Key: HDFS-17728 URL: https://issues.apache.org/jira/browse/HDFS-17728 Project: Hadoop HDFS Issue

Re: [VOTE] Request to merge branch HDFS-17531 into trunk.

2025-02-13 Thread Hui Fei
Did some test work referring to the documentation. - Compiled source codes, built a local cluster and the async feature worked fine. - it is disabled by default - can increase or decrease the thread number by changing the related configurations +1 jian zhang 于2025年2月14日周五 15:21写道

Re: [DISCUSS] Request to merge branch HDFS-17531 into trunk.

2025-02-13 Thread Hui Fei
> >> >> Hi, all, >> >> Currently this feature has been developed and passed the pipeline. >> Please >> >> continue to help review this feature. >> >> >> >> Best Regards, >> >> Jian Zhang >> >> >> >&g

[jira] [Resolved] (HDFS-17384) HDFS NameNode Fine-Grained Locking Phase I

2025-01-23 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17384. Fix Version/s: 3.5.0 Resolution: Fixed > HDFS NameNode Fine-Grained Locking Phas

Re: [DISCUSS] Request to merge branch HDFS-17531 into trunk.

2025-01-22 Thread Hui Fei
days. If it takes a long time, I think it may block the trunk release and All community members need to remember that there is documentation required. It doesn't look good. That's my thought, and we can wait for others' opinions jian zhang 于2025年1月22日周三 16:53写道: > Hi, Hu

Re: [DISCUSS] Request to merge branch HDFS-17531 into trunk.

2025-01-22 Thread Hui Fei
Thanks for your great work, looking forward to this feature. Some comments from me. - I checked and found that there are still 3 sub tasks under this feature jira ticket, are they necessary to be solved? - I didn't find the documentation for this feature. It's a key feature, Is it necessary to a

Re: [VOTE] Merge HDFS-17384 to trunk

2025-01-13 Thread Hui Fei
merge request: > >- *+1* : Approve the merge >- * -1* : Disapprove the merge (please provide a reason) >- * 0* : Abstain > > This vote will remain open for at least *1 week*, closing on *2025-01-17* > (or > until a consensus is reached). > > I

Re: Discussion about NameNode Fine-grained locking

2024-12-31 Thread Hui Fei
t; https://docs.google.com/document/d/1DXkiVxef9wCmICjpZyIQO-yxsgwc4wnf2lTKQ3UXe30/edit?tab=t.0#heading=h.zesd6omuu3kr > > Seeking Community Feedback > > Your questions and concerns are always welcome. > > We can discuss them in detail on the Slack Channel: > https://app.sla

[jira] [Resolved] (HDFS-17701) [FGL] Fix some javadocs

2024-12-30 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17701. Resolution: Fixed > [FGL] Fix some javadocs > > >

[jira] [Resolved] (HDFS-17691) [FGL] Move FSNamesystemLockMode to org.apache.hadoop.hdfs.util package

2024-12-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17691. Resolution: Fixed > [FGL] Move FSNamesystemLockMode to org.apache.hadoop.hdfs.util pack

[jira] [Resolved] (HDFS-17506) [FGL] Performance for phase 1

2024-05-12 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17506. Resolution: Fixed > [FGL] Performance for phase 1 > - > >

Re: Discussion about NameNode Fine-grained locking

2024-05-06 Thread Hui Fei
BTW, there is a Slack channel hdfs-fgl for this feature. can join it and discuss more details. Is it necessary to hold a meeting to discuss this? So that we can push it forward quickly. Agreed with ZanderXu, it seems inefficient to discuss details via email list. Hui Fei 于2024年5月6日周一 23:50写道

Re: Discussion about NameNode Fine-grained locking

2024-05-06 Thread Hui Fei
Pool, we can't let it > grow > > infinitely in case of heavy loads and we need to have some auto > > throttling mechanism for it > > * I didn't catch your Storage Policy problem. If I decode it right, the > > problem is like the policy could be set on an ancestor

Re: Discussion about NameNode Fine-grained locking

2024-04-26 Thread Hui Fei
; > > Thank you for your hard work! This is a very meaningful improvement, and > > from the design document, we can see a significant increase in HDFS > > read/write throughput. > > > > I am happy to see the progress made on HDFS-17384. > > > > However, I

[jira] [Resolved] (HDFS-17457) [FGL] UTs support fine-grained locking

2024-04-22 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17457. Resolution: Fixed > [FGL] UTs support fine-grained lock

[jira] [Resolved] (HDFS-17459) [FGL] Summarize this feature

2024-04-19 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17459. Resolution: Fixed > [FGL] Summarize this feature > - > >

[jira] [Resolved] (HDFS-17472) [FGL] gcDeletedSnapshot and getDelegationToken support FGL

2024-04-17 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17472. Resolution: Fixed > [FGL] gcDeletedSnapshot and getDelegationToken support

[jira] [Resolved] (HDFS-17424) [FGL] DelegationTokenSecretManager supports fine-grained lock

2024-04-15 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17424. Resolution: Fixed > [FGL] DelegationTokenSecretManager supports fine-grained l

[jira] [Resolved] (HDFS-17445) [FGL] All remaining operations support fine-grained locking

2024-04-09 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17445. Resolution: Fixed > [FGL] All remaining operations support fine-grained lock

[jira] [Resolved] (HDFS-17411) [FGL] Client RPCs involving snapshot support fine-grained lock

2024-04-08 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17411. Resolution: Fixed > [FGL] Client RPCs involving snapshot support fine-grained l

[jira] [Resolved] (HDFS-17389) [FGL] Client RPCs involving read process supports fine-grained lock

2024-03-29 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17389. Resolution: Fixed > [FGL] Client RPCs involving read process supports fine-grained l

[jira] [Resolved] (HDFS-17388) [FGL] Client RPCs involving write process supports fine-grained lock

2024-03-29 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17388. Resolution: Fixed > [FGL] Client RPCs involving write process supports fine-grained l

[jira] [Resolved] (HDFS-17420) [FGL] FSEditLogLoader supports fine-grained lock

2024-03-27 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17420. Resolution: Fixed > [FGL] FSEditLogLoader supports fine-grained l

[jira] [Resolved] (HDFS-17412) [FGL] Client RPCs involving maintenance supports fine-grained lock

2024-03-27 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17412. Resolution: Fixed > [FGL] Client RPCs involving maintenance supports fine-grained l

[jira] [Resolved] (HDFS-17417) [FGL] HeartbeatManager and DatanodeAdminMonitor support fine-grained lock

2024-03-26 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17417. Resolution: Fixed > [FGL] HeartbeatManager and DatanodeAdminMonitor support fine-grained l

[jira] [Resolved] (HDFS-17415) [FGL] RPCs in NamenodeProtocol support fine-grained lock

2024-03-26 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17415. Resolution: Fixed > [FGL] RPCs in NamenodeProtocol support fine-grained l

[jira] [Resolved] (HDFS-17410) [FGL] Client RPCs that changes file attributes supports fine-grained lock

2024-03-26 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17410. Resolution: Fixed > [FGL] Client RPCs that changes file attributes supports fine-grained l

[jira] [Resolved] (HDFS-17423) [FGL] BlockManagerSafeMode supports fine-grained lock

2024-03-25 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17423. Resolution: Fixed > [FGL] BlockManagerSafeMode supports fine-grained l

[jira] [Resolved] (HDFS-17416) [FGL] Monitor threads in BlockManager.class support fine-grained lock

2024-03-25 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17416. Resolution: Fixed > [FGL] Monitor threads in BlockManager.class support fine-grained l

[jira] [Resolved] (HDFS-17414) [FGL] RPCs in DatanodeProtocol support fine-grained lock

2024-03-23 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17414. Resolution: Fixed > [FGL] RPCs in DatanodeProtocol support fine-grained l

[jira] [Resolved] (HDFS-17413) [FGL] CacheReplicationMonitor supports fine-grained lock

2024-03-21 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17413. Resolution: Fixed > [FGL] CacheReplicationMonitor supports fine-grained l

[jira] [Created] (HDFS-17437) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit failed

2024-03-21 Thread Hui Fei (Jira)
Hui Fei created HDFS-17437: -- Summary: TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit failed Key: HDFS-17437 URL: https://issues.apache.org/jira/browse/HDFS-17437 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-17390) [FGL] FSDirectory supports this fine-grained locking

2024-03-06 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17390. Resolution: Fixed > [FGL] FSDirectory supports this fine-grained lock

[jira] [Resolved] (HDFS-17405) [FGL] Using different metric name to trace FGL and Global lock

2024-03-05 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17405. Resolution: Fixed > [FGL] Using different metric name to trace FGL and Global l

Re: Discussion about NameNode Fine-grained locking

2024-03-05 Thread Hui Fei
ou for raising the issue of this long-standing bottleneck, > this > > > > will be a very important improvement! > > > > > > > > Hopefully can participate and push forward together. > > > > > > > > Best Regards~ > > > > > > > > Brahm

[jira] [Reopened] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-03-05 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-17384: > [FGL] Replace the global lock with global FS Lock and global BM l

[jira] [Resolved] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-03-05 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17384. Resolution: Fixed > [FGL] Replace the global lock with global FS Lock and global BM l

[jira] [Resolved] (HDFS-17387) [FGL] Abstract the configurable locking mode

2024-03-04 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17387. Resolution: Fixed > [FGL] Abstract the configurable locking m

[jira] [Reopened] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-03-04 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-17384: > [FGL] Replace the global lock with global FS Lock and global BM l

[jira] [Resolved] (HDFS-17384) [FGL] Replace the global lock with global FS Lock and global BM lock

2024-03-04 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17384. Resolution: Fixed > [FGL] Replace the global lock with global FS Lock and global BM l

[jira] [Resolved] (HDFS-17394) [FGL] Remove unused WriteHoldCount of FSNamesystemLock

2024-02-26 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17394. Resolution: Fixed > [FGL] Remove unused WriteHoldCount of FSNamesystemL

[jira] [Resolved] (HDFS-17393) Remove unused cond in FSNamesystem

2024-02-22 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17393. Fix Version/s: 3.5.0 Resolution: Fixed > Remove unused cond in FSNamesys

Re: Discussion about NameNode Fine-grained locking

2024-02-01 Thread Hui Fei
Thanks for driving this. It's very meaningful. The performance improvement looks very good. Many users are facing the write performance issue. As far as I know, some companies already implemented the similar idea on their internal branches. But the internal branch is very different from the commun

Re: [VOTE] Hadoop 3.2.x EOL

2023-12-06 Thread Hui Fei
+1 Xiaoqiao He 于2023年12月6日周三 12:10写道: > Dear Hadoop devs, > > Given the feedback from the discussion thread [1], I'd like to start > an official thread for the community to vote on release line 3.2 EOL. > > It will include, > a. An official announcement informs no further regular Hadoop 3.2.x >

[jira] [Resolved] (HDFS-16771) JN should tersely print logs about NewerTxnIdException

2022-09-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16771. Resolution: Fixed > JN should tersely print logs about NewerTxnIdExcept

[jira] [Resolved] (HDFS-16738) Invalid CallerContext caused NullPointerException

2022-08-25 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16738. Fix Version/s: 3.4.0 Resolution: Fixed > Invalid CallerContext caused NullPointerExcept

[jira] [Reopened] (HDFS-16689) Standby NameNode crashes when transitioning to Active with in-progress tailer

2022-08-15 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-16689: > Standby NameNode crashes when transitioning to Active with in-progress tai

[jira] [Resolved] (HDFS-16689) Standby NameNode crashes when transitioning to Active with in-progress tailer

2022-08-11 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16689. Fix Version/s: 3.4.0 Resolution: Fixed > Standby NameNode crashes when transitioning to Active w

[jira] [Resolved] (HDFS-16648) Normalize the usage of debug logs in NameNode

2022-08-06 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16648. Fix Version/s: 3.4.0 Resolution: Fixed > Normalize the usage of debug logs in NameN

[jira] [Resolved] (HDFS-16642) [SBN read] Moving selecting inputstream from JN in EditlogTailer out of FSNLock

2022-08-03 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16642. Fix Version/s: 3.4.0 Resolution: Fixed > [SBN read] Moving selecting inputstream from JN

[jira] [Resolved] (HDFS-16671) RBF: RouterRpcFairnessPolicyController supports configurable permit acquire timeout

2022-07-28 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16671. Fix Version/s: 1.3.0 Resolution: Fixed > RBF: RouterRpcFairnessPolicyController suppo

[jira] [Resolved] (HDFS-16525) System.err should be used when error occurs in multiple methods in DFSAdmin class

2022-05-12 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16525. Fix Version/s: 3.4.0 Resolution: Fixed > System.err should be used when error occurs in multi

[jira] [Resolved] (HDFS-16488) [SPS]: Expose metrics to JMX for external SPS

2022-04-25 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16488. Resolution: Fixed > [SPS]: Expose metrics to JMX for external

[jira] [Reopened] (HDFS-16488) [SPS]: Expose metrics to JMX for external SPS

2022-04-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-16488: > [SPS]: Expose metrics to JMX for external

[jira] [Resolved] (HDFS-16488) [SPS]: Expose metrics to JMX for external SPS

2022-04-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16488. Fix Version/s: 3.4.0 Resolution: Fixed > [SPS]: Expose metrics to JMX for external

[jira] [Resolved] (HDFS-16460) [SPS]: Handle failure retries for moving tasks

2022-04-07 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16460. Fix Version/s: 3.4.0 Resolution: Fixed > [SPS]: Handle failure retries for moving ta

[jira] [Resolved] (HDFS-16499) [SPS]: Should not start indefinitely while another SPS process is running

2022-03-16 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16499. Fix Version/s: 3.4.0 Resolution: Fixed > [SPS]: Should not start indefinitely while another

Re: [ANNOUNCE] Apache Hadoop 3.3.2 release

2022-03-03 Thread Hui Fei
Great work! Thanks, Chao! Chao Sun 于2022年3月4日周五 09:30写道: > Hi All, > > It gives me great pleasure to announce that the Apache Hadoop community has > voted to release Apache Hadoop 3.3.2. > > This is the second stable release of Apache Hadoop 3.3 line. It contains > 284 bug fixes, improvements an

[jira] [Resolved] (HDFS-16458) [SPS]: Fix bug for unit test of reconfiguring SPS mode

2022-03-01 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16458. Fix Version/s: 3.4.0 Resolution: Fixed > [SPS]: Fix bug for unit test of reconfiguring SPS m

[jira] [Resolved] (HDFS-16480) Fix typo: indicies -> indices

2022-02-28 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16480. Fix Version/s: 3.4.0 Assignee: Jiale Qi Resolution: Fixed > Fix typo: indicies -> i

[jira] [Resolved] (HDFS-16316) Improve DirectoryScanner: add regular file check related block

2022-02-21 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16316. Fix Version/s: 3.4.0 Resolution: Fixed > Improve DirectoryScanner: add regular file check rela

[jira] [Resolved] (HDFS-16406) DataNode metric ReadsFromLocalClient does not count short-circuit reads

2022-02-08 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16406. Fix Version/s: 3.4.0 Resolution: Fixed > DataNode metric ReadsFromLocalClient does not count sh

[jira] [Resolved] (HDFS-16444) Show start time of JournalNode on Web

2022-01-30 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16444. Fix Version/s: 3.4.0 Resolution: Fixed > Show start time of JournalNode on

[jira] [Resolved] (HDFS-16401) Remove the worthless DatasetVolumeChecker#numAsyncDatasetChecks

2022-01-25 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16401. Fix Version/s: 3.4.0 Resolution: Fixed > Remove the worthless DatasetVolumeChec

[jira] [Resolved] (HDFS-16392) TestWebHdfsFileSystemContract#testResponseCode fails

2021-12-21 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16392. Fix Version/s: 3.4.0 Resolution: Fixed > TestWebHdfsFileSystemContract#testResponseCode fa

[jira] [Resolved] (HDFS-16168) TestHDFSFileSystemContract#testAppend fails

2021-12-20 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16168. Fix Version/s: 3.4.0 Resolution: Fixed > TestHDFSFileSystemContract#testAppend fa

[jira] [Reopened] (HDFS-16350) Datanode start time should be set after RPC server starts successfully

2021-11-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-16350: > Datanode start time should be set after RPC server starts successfu

[jira] [Resolved] (HDFS-16350) Datanode start time should be set after RPC server starts successfully

2021-11-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16350. Resolution: Fixed > Datanode start time should be set after RPC server starts successfu

[jira] [Resolved] (HDFS-16320) Datanode retrieve slownode information from NameNode

2021-11-22 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16320. Fix Version/s: 3.4.0 Resolution: Fixed > Datanode retrieve slownode information from NameN

[jira] [Resolved] (HDFS-16287) Support to make dfs.namenode.avoid.read.slow.datanode reconfigurable

2021-11-11 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16287. Fix Version/s: 3.4.0 Resolution: Fixed > Support to make dfs.namenode.avoid.read.slow.datan

[jira] [Resolved] (HDFS-16305) Record the remote NameNode address when the rolling log is triggered

2021-11-11 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16305. Fix Version/s: 3.4.0 Resolution: Fixed > Record the remote NameNode address when the rolling log

[jira] [Resolved] (HDFS-16302) RBF: RouterRpcFairnessPolicyController record requests handled by each nameservice

2021-11-07 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16302. Fix Version/s: 3.4.0 Resolution: Fixed > RBF: RouterRpcFairnessPolicyController record reque

[jira] [Resolved] (HDFS-16296) RBF: RouterRpcFairnessPolicyController add denied permits for each nameservice

2021-11-04 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16296. Fix Version/s: 3.4.0 Resolution: Fixed > RBF: RouterRpcFairnessPolicyController add denied perm

[jira] [Resolved] (HDFS-16291) Make the comment of INode#ReclaimContext more standardized

2021-11-03 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16291. Fix Version/s: 3.4.0 Resolution: Fixed > Make the comment of INode#ReclaimContext more standardi

Re: [DISCUSS] Hadoop 3.3.2 release?

2021-10-28 Thread Hui Fei
Thank you, Chao! Do you need any help? I can assist you. Chao Sun 于2021年9月8日周三 上午1:06写道: > Hi all, > > It has been almost 3 months since the 3.3.1 release and branch-3.3 has > accumulated quite a few commits (118 atm). In particular, Spark community > recently found an issue which prevents one f

[jira] [Resolved] (HDFS-16281) Fix flaky unit tests failed due to timeout

2021-10-25 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16281. Fix Version/s: 3.4.0 Resolution: Fixed > Fix flaky unit tests failed due to time

[jira] [Resolved] (HDFS-16244) Add the necessary write lock in Checkpointer#doCheckpoint()

2021-10-13 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16244. Fix Version/s: 3.4.0 Resolution: Fixed > Add the necessary write lock in Checkpointer#doCheckpo

[jira] [Resolved] (HDFS-16264) When adding block keys, the records come from the specific Block Pool

2021-10-11 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16264. Fix Version/s: 3.4.0 Resolution: Fixed > When adding block keys, the records come from the speci

[jira] [Resolved] (HDFS-16247) RBF: Fix the ProcessingAvgTime and ProxyAvgTime code comments and document metrics describe ms unit

2021-10-04 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16247. Fix Version/s: 3.4.0 Resolution: Fixed > RBF: Fix the ProcessingAvgTime and ProxyAvgTime c

[jira] [Resolved] (HDFS-16231) Fix TestDataNodeMetrics#testReceivePacketSlowMetrics

2021-09-27 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16231. Fix Version/s: 3.4.0 Resolution: Fixed > Fix TestDataNodeMetrics#testReceivePacketSlowMetr

[jira] [Resolved] (HDFS-16237) Record the BPServiceActor information that communicates with Standby

2021-09-27 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16237. Fix Version/s: 3.4.0 Resolution: Fixed > Record the BPServiceActor information that communica

[jira] [Resolved] (HDFS-16236) Example command for daemonlog is not correct

2021-09-25 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16236. Fix Version/s: 3.4.0 Resolution: Fixed > Example command for daemonlog is not corr

[jira] [Resolved] (HDFS-16235) Deadlock in LeaseRenewer for static remove method

2021-09-25 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16235. Fix Version/s: 3.4.0 Resolution: Fixed > Deadlock in LeaseRenewer for static remove met

[jira] [Resolved] (HDFS-16221) RBF: Add usage of refreshCallQueue for Router

2021-09-12 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16221. Resolution: Fixed > RBF: Add usage of refreshCallQueue for Rou

[jira] [Reopened] (HDFS-16221) RBF: Add usage of refreshCallQueue for Router

2021-09-12 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-16221: > RBF: Add usage of refreshCallQueue for Rou

[jira] [Resolved] (HDFS-16197) Simplify getting NNStorage in FSNamesystem

2021-09-12 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16197. Fix Version/s: 3.4.0 Resolution: Fixed > Simplify getting NNStorage in FSNamesys

[jira] [Resolved] (HDFS-16221) RBF: Add usage of refreshCallQueue for Router

2021-09-12 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16221. Fix Version/s: 3.4.0 Resolution: Fixed > RBF: Add usage of refreshCallQueue for Rou

[jira] [Resolved] (HDFS-16210) RBF: Add the option of refreshCallQueue to RouterAdmin

2021-09-11 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16210. Resolution: Fixed > RBF: Add the option of refreshCallQueue to RouterAd

[jira] [Reopened] (HDFS-16210) RBF: Add the option of refreshCallQueue to RouterAdmin

2021-09-10 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-16210: > RBF: Add the option of refreshCallQueue to RouterAd

[jira] [Resolved] (HDFS-16210) RBF: Add the option of refreshCallQueue to RouterAdmin

2021-09-09 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16210. Resolution: Fixed > RBF: Add the option of refreshCallQueue to RouterAd

[jira] [Resolved] (HDFS-16065) RBF: Add metrics to record Router's operations

2021-09-09 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16065. Fix Version/s: 3.4.0 Resolution: Fixed > RBF: Add metrics to record Router's op

[jira] [Reopened] (HDFS-16210) RBF: Add the option of refreshCallQueue to RouterAdmin

2021-09-08 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-16210: > RBF: Add the option of refreshCallQueue to RouterAd

[jira] [Resolved] (HDFS-16210) RBF: Add the option of refreshCallQueue to RouterAdmin

2021-09-08 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16210. Fix Version/s: 3.4.0 Resolution: Fixed > RBF: Add the option of refreshCallQueue to RouterAd

[jira] [Resolved] (HDFS-16204) Improve FSDirEncryptionZoneOp related parameter comments

2021-09-06 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16204. Fix Version/s: 3.4.0 Resolution: Fixed > Improve FSDirEncryptionZoneOp related parameter comme

[jira] [Resolved] (HDFS-15966) Empty the statistical parameters when emptying the redundant queue

2021-09-01 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-15966. Fix Version/s: 3.4.0 Resolution: Fixed > Empty the statistical parameters when emptying

[jira] [Resolved] (HDFS-16160) Improve the parameter annotation in DatanodeProtocol#sendHeartbeat

2021-08-18 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-16160. Fix Version/s: 3.4.0 Resolution: Fixed > Improve the parameter annotation in DatanodeProto

[jira] [Created] (HDFS-16170) TestFileTruncate#testTruncateWithDataNodesShutdownImmediately fails

2021-08-12 Thread Hui Fei (Jira)
Hui Fei created HDFS-16170: -- Summary: TestFileTruncate#testTruncateWithDataNodesShutdownImmediately fails Key: HDFS-16170 URL: https://issues.apache.org/jira/browse/HDFS-16170 Project: Hadoop HDFS

[jira] [Created] (HDFS-16169) TestBlockTokenWithDFSStriped#testEnd2End fails

2021-08-12 Thread Hui Fei (Jira)
Hui Fei created HDFS-16169: -- Summary: TestBlockTokenWithDFSStriped#testEnd2End fails Key: HDFS-16169 URL: https://issues.apache.org/jira/browse/HDFS-16169 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-16168) TestHDFSFileSystemContract#testAppend fails

2021-08-12 Thread Hui Fei (Jira)
Hui Fei created HDFS-16168: -- Summary: TestHDFSFileSystemContract#testAppend fails Key: HDFS-16168 URL: https://issues.apache.org/jira/browse/HDFS-16168 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-16167) TestDFSInotifyEventInputStreamKerberized#testWithKerberizedCluster fails

2021-08-12 Thread Hui Fei (Jira)
Hui Fei created HDFS-16167: -- Summary: TestDFSInotifyEventInputStreamKerberized#testWithKerberizedCluster fails Key: HDFS-16167 URL: https://issues.apache.org/jira/browse/HDFS-16167 Project: Hadoop HDFS

  1   2   >