Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/357/ No changes -1 overall The following subsystems voted -1: asflicense hadolint mvnsite pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc

[jira] [Resolved] (HDFS-16123) NameNode standby checkpoint is abnormal, because the data disk is full, even if the disk space is restored

[ https://issues.apache.org/jira/browse/HDFS-16123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-16123. --- Resolution: Invalid > NameNode standby checkpoint is abnormal, because the data disk is full, even

LinkedIn’s journey of scaling the Hadoop Distributed File System

Our friends at LinkedIn published an awesome blog post on the HDFS scalability. Check it out here: https://engineering.linkedin.com/blog/2021/the-exabyte-club--linkedin-s-journey-of-scaling-the-hadoop-distr Thanks, Wei-Chiu

Three Hadoop talks in this year's ApacheCon Asia

For your information, While drafting the upcoming quarterly report, I found there are three talks that are directly related to Hadoop in this year's ApacheCon Asia. https://apachecon.com/acasia2021/tracks/bigdata.html Bigtop 3.0: Rerising community driven Hadoop distribution

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/566/ [Jul 12, 2021 1:16:13 AM] (noreply) HADOOP-12665. Document hadoop.security.token.service.use_ip. (#3187) -1 overall The following subsystems voted -1: blanks pathlen unit xml The following

[jira] [Reopened] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reopened HDFS-15160: -- > ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl > methods should use data

[jira] [Created] (HDFS-16125) iterator for PartitionedGSet would visit the first partition twice

Xing Lin created HDFS-16125: --- Summary: iterator for PartitionedGSet would visit the first partition twice Key: HDFS-16125 URL: https://issues.apache.org/jira/browse/HDFS-16125 Project: Hadoop HDFS

[DISCUSS] Tips for improving productivity, workflow in the Hadoop project?

I work on multiple projects and learned a bunch from those projects.There are nice add-ons that help with productivity. There are things we can do to help us manage the project better. 1. Add new issue types. We can add "Epic" jira type to organize a set of related jiras. This could be easier to m

Re: [DISCUSS] Tips for improving productivity, workflow in the Hadoop project?

Here's another one: We can update the JIRA workflow and add more state. For example, Cassandra has "Review in Progress" and "Need Reviewer" states. INFRA-22049 On Tue, Jul 13, 2021 at 11:34 AM Wei-Chiu Chuang wrote: > I work on multiple projec