Re: Both NN crashes due to JN timeout (Hadoop 3)

Hi Wei Chiu, We also observed same issue when NN replays large editlogs from JN. It looks like in jetty 6 the default max idle timeout is 200 seconds. public abstract class AbstractConnector extends AbstractBuffers implements Connector { protected int _maxIdleTime=20;

Both NN crashes due to JN timeout (Hadoop 3)

Hi community, I want to share with you this observation. We received several case reports that users sometimes experience JournalNode timeout when NN requests edits from JN. The end result is (both!) NN crash after the timeout (10 seconds). It seems to only happen to Hadoop 3 users (CDH6 and HDP

Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/82/ [Dec 7, 2020 9:30:19 AM] (Ayush Saxena) HDFS-15221. Add checking of effective filesystem during initializing storage locations. Contributed by Yang Yun. [Dec 7, 2020 10:52:12 AM] (Yiqun Lin) HDFS-1566

[jira] [Resolved] (HDFS-15709) EC: Socket file descriptor leak in StripedBlockChecksumReconstructor

[ https://issues.apache.org/jira/browse/HDFS-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15709. Fix Version/s: 3.2.3 3.1.5 3.4.0 3.

[jira] [Resolved] (HDFS-15707) NNTop counts don't add up as expected

[ https://issues.apache.org/jira/browse/HDFS-15707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HDFS-15707. Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Created] (HDFS-15717) Improve fsck logging

Ahmed Hussein created HDFS-15717: Summary: Improve fsck logging Key: HDFS-15717 URL: https://issues.apache.org/jira/browse/HDFS-15717 Project: Hadoop HDFS Issue Type: Improvement Co

Hadoop Storage Online Meetup this Wednesday! We'll talk about GCS

Hello! As we move into December, some of you may start to feel like in vacation mode. I'm also looking forward to vacations! But before that, I invited Twitter's developer, Zhenzhao, to discuss Hadoop on Google Cloud Storage (GCS). Twitter's moving into GCP and has lots of experience with GCS. Zh

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/348/ No changes -1 overall The following subsystems voted -1: pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylin

[jira] [Created] (HDFS-15716) TestUpgradeDomainBlockPlacementPolicy flaky

Ahmed Hussein created HDFS-15716: Summary: TestUpgradeDomainBlockPlacementPolicy flaky Key: HDFS-15716 URL: https://issues.apache.org/jira/browse/HDFS-15716 Project: Hadoop HDFS Issue Type: S

[jira] [Created] (HDFS-15715) ReplicatorMonitor performance degradation, when the storagePolicy of many file are not match with their real datanodestorage

zhengchenyu created HDFS-15715: -- Summary: ReplicatorMonitor performance degradation, when the storagePolicy of many file are not match with their real datanodestorage Key: HDFS-15715 URL: https://issues.apache.org/j

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/139/ No changes -1 overall The following subsystems voted -1: asflicense hadolint jshint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored:

[jira] [Created] (HDFS-15714) HDFS Provided Storage Read/Write Mount Support On-the-fly

Feilong He created HDFS-15714: - Summary: HDFS Provided Storage Read/Write Mount Support On-the-fly Key: HDFS-15714 URL: https://issues.apache.org/jira/browse/HDFS-15714 Project: Hadoop HDFS Issue

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC3

Thanks Chao Sun and Akira Ajisaka for your help. If no more new block issues report. I will prepare another RC this week. Thanks All. - He Xiaoqiao On Fri, Dec 4, 2020 at 10:16 AM Akira Ajisaka wrote: > In addition, backported HDFS-13404 to fix > TestRouterWebHDFSContractAppend failure. > > On