Re: Discussion about NameNode Fine-grained locking

Thanks Yuanbo for your response. Since the snapshot、symbol link is not popular in HADOOP Actually, Snapshot and Symbol are both enabled by many companies. I don't have information if the 'reserved' feature is also used. we can try to use global lock(write lock of root inode?) I think there are

[jira] [Resolved] (HDFS-17395) [FGL] Use FSLock to protect ErasureCodingPolicy related operations

[ https://issues.apache.org/jira/browse/HDFS-17395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu resolved HDFS-17395. - Hadoop Flags: Reviewed Resolution: Fixed > [FGL] Use FSLock to protect ErasureCodingPolicy related

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

cc @Chao Sun @zhang...@apache.org @Ayush Saxena Would you mind helping to check the upstream systems(Spark, HBase, Hive) dependency with the new hadoop release version if necessary? Thanks. Best Regards, - He Xiaoqiao On Thu, Mar 7, 2024 at 10:23 AM Xiaoqiao He wrote: > Shilun, Thanks for

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

Shilun, Thanks for your great work. I am checking but not finished yet. Will confirm once done. Best Regards, - He Xiaoqiao On Thu, Mar 7, 2024 at 7:23 AM slfan1989 wrote: > @Xiaoqiao He @Ayush Saxena > @Steve > Loughran @Mukund Madhav Thakur > @Takanobu > Asanuma @Masatake Iwasaki > > Ca

Re: [VOTE] Release Apache Hadoop 3.4.0 (RC3)

@Xiaoqiao He @Ayush Saxena @Steve Loughran @Mukund Madhav Thakur @Takanobu Asanuma @Masatake Iwasaki Can you help review and vote for hadoop-3.4.0-RC3? Thank you very much! Best Regards, Shilun Fan. On Tue, Mar 5, 2024 at 6:07 AM slfan1989 wrote: > Hi folks, > > Xiaoqiao He and I have pu

[jira] [Resolved] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh Shah resolved HDFS-17299. - Fix Version/s: 3.4.1 3.5.0 Resolution: Fixed > HDFS is not rack failure

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/1520/ [Mar 5, 2024, 10:10:27 AM] (github) HADOOP-19097. S3A: Set fs.s3a.connection.establish.timeout to 30s (#6601) [Mar 5, 2024, 10:15:05 AM] (github) HADOOP-19082: S3A: Update AWS SDK V2 to 2.24.6 (#656

[jira] [Resolved] (HDFS-17390) [FGL] FSDirectory supports this fine-grained locking

[ https://issues.apache.org/jira/browse/HDFS-17390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-17390. Resolution: Fixed > [FGL] FSDirectory supports this fine-grained locking >

Re: Discussion about NameNode Fine-grained locking

Thank you for sharing the information. My colleague mentioned that Tencent Kona 11 might have various improvements and we're interested to see what it's like. We would also like to try out shenandoah gc. - Takanobu 2024年3月6日(水) 15:17 Yuanbo Liu : > I've heard zgc is better in jdk17 or above, so

[jira] [Resolved] (HDFS-16799) The dn space size is not consistent, and Balancer can not work, resulting in a very unbalanced space

[ https://issues.apache.org/jira/browse/HDFS-16799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ruiliang resolved HDFS-16799. - Resolution: Cannot Reproduce > The dn space size is not consistent, and Balancer can not work, resulting

[jira] [Resolved] (HDFS-17345) Add a metrics to record block report generating cost time

[ https://issues.apache.org/jira/browse/HDFS-17345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang resolved HDFS-17345. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Add a metrics to reco