Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

2020-07-08 Thread Masatake Iwasaki
Hi Gabor Bota, I committed the fix of YARN-10347 to branch-3.1. I think this should be blocker for 3.1.4. Could you cherry-pick it to branch-3.1.4 and cut a new RC? Thanks, Masatake Iwasaki On 2020/07/08 23:31, Masatake Iwasaki wrote: Thanks Steve and Prabhu for the information. The cause tur

[jira] [Created] (HDFS-15462) Add fs.viewfs.overload.scheme.target.ofs.impl to core-default.xml

2020-07-08 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15462: - Summary: Add fs.viewfs.overload.scheme.target.ofs.impl to core-default.xml Key: HDFS-15462 URL: https://issues.apache.org/jira/browse/HDFS-15462 Project: Hadoop HDFS

Apache Hadoop qbt Report: branch2.10+JDK7 on Linux/x86

2020-07-08 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/742/ No changes -1 overall The following subsystems voted -1: docker Powered by Apache Yetushttps://yetus.apache.org - To

[jira] [Created] (HDFS-15461) TestDFSClientRetries#testGetFileChecksum fails intermittently

2020-07-08 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-15461: Summary: TestDFSClientRetries#testGetFileChecksum fails intermittently Key: HDFS-15461 URL: https://issues.apache.org/jira/browse/HDFS-15461 Project: Hadoop HDFS

[jira] [Created] (HDFS-15459) TestBlockTokenWithDFSStriped fails intermittently

2020-07-08 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-15459: Summary: TestBlockTokenWithDFSStriped fails intermittently Key: HDFS-15459 URL: https://issues.apache.org/jira/browse/HDFS-15459 Project: Hadoop HDFS Issue T

[jira] [Created] (HDFS-15458) TestNameNodeRetryCacheMetrics fails intermittently

2020-07-08 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-15458: Summary: TestNameNodeRetryCacheMetrics fails intermittently Key: HDFS-15458 URL: https://issues.apache.org/jira/browse/HDFS-15458 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-15457) TestFsDatasetImpl fails intermittently

2020-07-08 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-15457: Summary: TestFsDatasetImpl fails intermittently Key: HDFS-15457 URL: https://issues.apache.org/jira/browse/HDFS-15457 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-15456) TestExternalStoragePolicySatisfier fails intermittently

2020-07-08 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-15456: Summary: TestExternalStoragePolicySatisfier fails intermittently Key: HDFS-15456 URL: https://issues.apache.org/jira/browse/HDFS-15456 Project: Hadoop HDFS I

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

2020-07-08 Thread Masatake Iwasaki
Thanks Steve and Prabhu for the information. The cause turned out to be locking in CapacityScheduler#reinitialize. I think the method is called after transitioning to active stat if RM-HA is enabled. I filed YARN-10347 and created PR. Masatake Iwasaki On 2020/07/08 16:33, Prabhu Joseph wro

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

2020-07-08 Thread Prabhu Joseph
Hi Masatake, The thread is waiting for a ReadLock, we need to check what the other thread holding WriteLock is blocked on. Can you get three consecutive complete jstack of ResourceManager during the issue. >> I got no issue if RM-HA is disabled. Looks RM is not able to access Zookeeper Stat