Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

+1 (binding) * Downloaded source, built from source with -Dhbase.profile=2.0. * Installed RM HA cluster integrated with ATSv2. Installed HBase-2.0-beta1 for ATSv2 back end. Scheduler is configured with 2 level queue hierarchy. * Ran sample jobs such as MR/Distributed shell and verified for ** ATS

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

Thanks Wangda for working on this! +1 (non-binding) - Downloaded the binary tarball and verified the checksum. - Started a pseudo cluster inside one docker container - Run Resource Manager with Fair Scheduler - Verified distributed shell - Verified mapreduce pi job - Sanity che

[VOTE] Release Apache Hadoop 3.1.0 (RC1)

Hi folks, Thanks to the many who helped with this release since Dec 2017 [1]. We've created RC1 for Apache Hadoop 3.1.0. The artifacts are available here: http://people.apache.org/~wangda/hadoop-3.1.0-RC1 The RC tag in git is release-3.1.0-RC1. Last git commit SHA is 16b70619a24cdcf5d3b0fcf4b58c

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/179/ [Mar 30, 2018 1:03:32 AM] (shv) HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. -1 overall The following subsystems voted -1: docker Powered by Apache Yetus 0.8.0-SNAPSH

[jira] [Created] (HDFS-13374) TestCommonConfigurationFields is broken by HADOOP-15312

Konstantin Shvachko created HDFS-13374: -- Summary: TestCommonConfigurationFields is broken by HADOOP-15312 Key: HDFS-13374 URL: https://issues.apache.org/jira/browse/HDFS-13374 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-898) Sequential generation of block ids

[ https://issues.apache.org/jira/browse/HDFS-898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-898. -- Resolution: Duplicate This was done by HDFS-4645. Resolving ... > Sequential generation

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

Arun helped me to figure this out. It was pushed to a wrong location. The correct one is: https://dist.apache.org/repos/dist/release/hadoop/common/

[jira] [Resolved] (HDFS-12165) getSnapshotDiffReport throws NegativeArraySizeException for very large snapshot diff summary

[ https://issues.apache.org/jira/browse/HDFS-12165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-12165. Resolution: Duplicate > getSnapshotDiffReport throws NegativeArraySizeException for very lar

[jira] [Created] (HDFS-13373) Handle expunge command on NN and DN

Bharat Viswanadham created HDFS-13373: - Summary: Handle expunge command on NN and DN Key: HDFS-13373 URL: https://issues.apache.org/jira/browse/HDFS-13373 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-13372) New Expunge Replica Trash Client-Namenode-Protocol

Bharat Viswanadham created HDFS-13372: - Summary: New Expunge Replica Trash Client-Namenode-Protocol Key: HDFS-13372 URL: https://issues.apache.org/jira/browse/HDFS-13372 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

Thanks Junping for reporting this, I did append my keys to https://svn.apache.org/repos/asf/hadoop/common/dist/KEYS, I'm not sure how to propagate it to https://dist.apache.org/repos/dist/release/hadoop/common/ KEYS, I couldn't find any guide about this. Could you share how you did this? - Wangda

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

Hi Wanda, Thanks for the release effort on 3.1.0. Another reminder is I tried to verify the signature of RC0 bits but found there is no known key get uploaded to https://dist.apache.org/repos/dist/release/hadoop/common/KEYS. Would you please upload it there then we can go ahead to verify the s

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

Thanks all for doing testing and reporting issues. YARN-8085 discovered by Weiwei/Tao is a blocker, we will roll an RC1 today. - Wangda On Thu, Mar 29, 2018 at 7:26 AM, Weiwei Yang wrote: > Hi Wangda > > While testing the build, we found a bug https://issues.apache.org/ > jira/browse/YARN-8085

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC0)

Hi Wangda While testing the build, we found a bug https://issues.apache.org/jira/browse/YARN-8085, it might cause NPE during RM fail-over. I think that needs to be included in 3.1.0. We have run some other tests, and they look good so far. This includes - Some basic teragen/terasort/DS jobs - V

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/735/ [Mar 28, 2018 2:33:18 AM] (sunilg) YARN-8075. DShell does not fail when we ask more GPUs than available [Mar 28, 2018 3:00:08 AM] (yqlin) HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri

[jira] [Created] (HDFS-13370) Ozone: ContainerID package name dose not correspond to the file path

DENG FEI created HDFS-13370: --- Summary: Ozone: ContainerID package name dose not correspond to the file path Key: HDFS-13370 URL: https://issues.apache.org/jira/browse/HDFS-13370 Project: Hadoop HDFS

[jira] [Created] (HDFS-13369) FSCK Report broken with RequestHedgingProxyProvider

Harshakiran Reddy created HDFS-13369: Summary: FSCK Report broken with RequestHedgingProxyProvider Key: HDFS-13369 URL: https://issues.apache.org/jira/browse/HDFS-13369 Project: Hadoop HDFS

[jira] [Created] (HDFS-13368) Ozone:TestEndPoint tests are failing consistently

Shashikant Banerjee created HDFS-13368: -- Summary: Ozone:TestEndPoint tests are failing consistently Key: HDFS-13368 URL: https://issues.apache.org/jira/browse/HDFS-13368 Project: Hadoop HDFS