Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

Thanks, Wangda! There are many more artifacts in previous votes, e.g., see http://home.apache.org/~junping_du/hadoop-2.8.3-RC0/ . Among others the site tarball is missing. On Sun, Apr 1, 2018 at 11:54 PM Sunil G wrote: > Thanks Wangda for initiating the release. > > I tested this RC built from

RE: Apache Hadoop 2.9.1 Release Plan

Hi All, Today I have created branch-2.9.1 from branch-2.9 and started creating the RC0 based on branch-2.9.1. But due to the corporate network conditions and my not full privileges on Hadoop, it will take a while for RC0 to come out. If you have anything want to commit to branch-2.9.1,

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

+1 (binding) On Mon 2 Apr, 2018, 12:24 Sunil G, wrote: > Thanks Wangda for initiating the release. > > I tested this RC built from source file. > > >- Tested MR apps (sleep, wc) and verified both new YARN UI and old RM >UI. >- Below feature sanity is done > - Application priori

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/739/ No changes -1 overall The following subsystems voted -1: findbugs unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint she

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

Hi Gera, It's my bad, I thought only src/bin tarball is enough. I just uploaded all other things under artifact/ to http://people.apache.org/~wangda/hadoop-3.1.0-RC1/ Please let me know if you have any other comments. Thanks, Wangda On Mon, Apr 2, 2018 at 12:50 AM, Gera Shegalov wrote: > Th

[jira] [Resolved] (HADOOP-14831) Über-jira: S3a phase IV: Hadoop 3.1 features

[ https://issues.apache.org/jira/browse/HADOOP-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14831. - Resolution: Fixed Assignee: Steve Loughran Fix Version/s: 3.1.0 Moving u

[jira] [Created] (HADOOP-15357) Configuration.getPropsWithPrefix no longer does variable substitution

Jim Brennan created HADOOP-15357: Summary: Configuration.getPropsWithPrefix no longer does variable substitution Key: HADOOP-15357 URL: https://issues.apache.org/jira/browse/HADOOP-15357 Project: Hado

Help getting the fix for HADOOP-13617 committed

Hi, I am hoping someone here would be able to guide me through the process of getting the fix for HADOOP-13617 committed We started using hadoop's openstack filesystem (Swift) as a storage backend for Apache Flink and ran into the problem that every few hours an error would be triggered that would

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

Thanks for putting together this RC, Wangda. The guidance from Apache is to omit MD5s, specifically: > SHOULD NOT supply a MD5 checksum file (because MD5 is too broken). https://www.apache.org/dev/release-distribution#sigs-and-sums On Apr 2, 2018, at 7:03 AM, Wangda Tan mailto:wheele...@gma

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

Hi Arpit, Thanks for pointing out this. I just removed all .md5 files from artifacts. I found md5 checksums still exist in .mds files and I didn't remove them from .mds file because it is generated by create-release script and Apache guidance is "should not" instead of "must not". Please let me k

[jira] [Resolved] (HADOOP-13500) Concurrency issues when using Configuration iterator

[ https://issues.apache.org/jira/browse/HADOOP-13500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved HADOOP-13500. -- Resolution: Duplicate Already fixed by HADOOP-13556. Closing as a dup.

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi Lei, It looks like the release artefacts have dummy shaded jars. E.g. Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar Uploaded by: lei Size: 44.47 KB Uploaded Date:Fri Mar 16 2018 15:50:42 GMT-0700 (PDT) Last Modified:F

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Hi, Arpit I followed this instruction https://wiki.apache.org/hadoop/HowToRelease It instructs to use "mvn deploy -Psign -DskipTests -DskipShade". It seems wrong, given that 3.0.0 is a shaded jar. I will do another deploy to fix it. On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal wrote: > Hi Le

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/183/ No changes -1 overall The following subsystems voted -1: docker Powered by Apache Yetus 0.8.0-SNAPSHOT http://yetus.apache.org ---

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

For more details, see https://builds.apache.org/job/hadoop-trunk-win/425/ No changes -1 overall The following subsystems voted -1: compile mvninstall unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considere

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

Thanks Arpit for reporting this and helping investigate the issue offline! I follow the same tutorial so the previously RC1 maven repo has the same issue. Just deployed jars by removing -DskipShade and shaded jars have correct sizes. Will post an update to RC1 voting thread. - Wangda On Mon, A

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

As pointed by Arpit, the previously deployed shared jars are incorrect. Just redeployed jars and staged. @Arpit, could you please check the updated Maven repo? https://repository.apache.org/content/repositories/orgapachehadoop-1092 Since the jars inside binary tarballs are correct ( http://people.

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

+1 (binding) Thanks for putting this together, Wangda. I deployed a 7-node hadoop cluster and: - ran various MR jobs - ran the same jobs with a mix of opportunistic containers via centralized scheduling - ran the jobs with opportunistic containers and distributed scheduling - ran some jobs with v