Re: Restrict Frequency of BlockReport To Namenode startup and failover

Hi Stephen, We are trying this on 3.1.1 We aren’t upgrading from 2.x, we are trying to increase the cluster size to go beyond 10K datanodes. In the process, we analysed that block reports from these many DN’s are quite bothersome. There are plenty of reasons why block reports bothers performance,

Apache Hadoop qbt Report: branch2.10+JDK7 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/591/ No changes -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc c

Re: Why capacity scheduler not support DRF?

Thanks @epayne for your response, actually, i wonder why do not support sort based on DRF like FairScheduler. epa...@apache.org 于2020年2月8日周六 上午5:39写道： > Hi, > > I didn't see anyone respond to your question. If you already got a > response, > please ignore this one. > > The Capacity Scheduler doe

[jira] [Created] (HADOOP-16848) add initial S3A layering + async init

Steve Loughran created HADOOP-16848: --- Summary: add initial S3A layering + async init Key: HADOOP-16848 URL: https://issues.apache.org/jira/browse/HADOOP-16848 Project: Hadoop Common Issue T

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1406/ [Feb 9, 2020 1:44:18 PM] (ayushsaxena) YARN-9624. Use switch case for ProtoUtils#convertFromProtoFormat [Feb 9, 2020 3:44:53 PM] (sunilg) YARN-10109. Allow stop and convert from leaf to parent queue in a