Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-04-02 Thread Konstantinos Karanasos
+1 (binding) Thanks for putting this together, Wangda. I deployed a 7-node hadoop cluster and: - ran various MR jobs - ran the same jobs with a mix of opportunistic containers via centralized scheduling - ran the jobs with opportunistic containers and distributed scheduling - ran some jobs with v

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-04-02 Thread Wangda Tan
As pointed by Arpit, the previously deployed shared jars are incorrect. Just redeployed jars and staged. @Arpit, could you please check the updated Maven repo? https://repository.apache.org/content/repositories/orgapachehadoop-1092 Since the jars inside binary tarballs are correct ( http://people.

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-04-02 Thread Wangda Tan
Thanks Arpit for reporting this and helping investigate the issue offline! I follow the same tutorial so the previously RC1 maven repo has the same issue. Just deployed jars by removing -DskipShade and shaded jars have correct sizes. Will post an update to RC1 voting thread. - Wangda On Mon, A

[jira] [Created] (HDFS-13386) RBF: wrong date information in list file(-ls) result

2018-04-02 Thread Dibyendu Karmakar (JIRA)
Dibyendu Karmakar created HDFS-13386: Summary: RBF: wrong date information in list file(-ls) result Key: HDFS-13386 URL: https://issues.apache.org/jira/browse/HDFS-13386 Project: Hadoop HDFS

[jira] [Created] (HDFS-13385) Unknown compression method

2018-04-02 Thread jifei_yang (JIRA)
jifei_yang created HDFS-13385: - Summary: Unknown compression method Key: HDFS-13385 URL: https://issues.apache.org/jira/browse/HDFS-13385 Project: Hadoop HDFS Issue Type: Improvement Co

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

2018-04-02 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-trunk-win/425/ No changes -1 overall The following subsystems voted -1: compile mvninstall unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considere

[jira] [Created] (HDFS-13384) RBF: Improve timeout RPC call mechanism

2018-04-02 Thread JIRA
Íñigo Goiri created HDFS-13384: -- Summary: RBF: Improve timeout RPC call mechanism Key: HDFS-13384 URL: https://issues.apache.org/jira/browse/HDFS-13384 Project: Hadoop HDFS Issue Type: Sub-task

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2018-04-02 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/183/ No changes -1 overall The following subsystems voted -1: docker Powered by Apache Yetus 0.8.0-SNAPSHOT http://yetus.apache.org ---

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-04-02 Thread Lei Xu
Hi, Arpit I followed this instruction https://wiki.apache.org/hadoop/HowToRelease It instructs to use "mvn deploy -Psign -DskipTests -DskipShade". It seems wrong, given that 3.0.0 is a shaded jar. I will do another deploy to fix it. On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal wrote: > Hi Le

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-04-02 Thread Arpit Agarwal
Hi Lei, It looks like the release artefacts have dummy shaded jars. E.g. Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar Uploaded by: lei Size: 44.47 KB Uploaded Date:Fri Mar 16 2018 15:50:42 GMT-0700 (PDT) Last Modified:F

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-04-02 Thread Wangda Tan
Hi Arpit, Thanks for pointing out this. I just removed all .md5 files from artifacts. I found md5 checksums still exist in .mds files and I didn't remove them from .mds file because it is generated by create-release script and Apache guidance is "should not" instead of "must not". Please let me k

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-04-02 Thread Arpit Agarwal
Thanks for putting together this RC, Wangda. The guidance from Apache is to omit MD5s, specifically: > SHOULD NOT supply a MD5 checksum file (because MD5 is too broken). https://www.apache.org/dev/release-distribution#sigs-and-sums On Apr 2, 2018, at 7:03 AM, Wangda Tan mailto:wheele...@gma

[jira] [Created] (HDFS-13383) Ozone: start-ozone.sh fail to start datanode because of incomplete classpaths

2018-04-02 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-13383: Summary: Ozone: start-ozone.sh fail to start datanode because of incomplete classpaths Key: HDFS-13383 URL: https://issues.apache.org/jira/browse/HDFS-13383 P

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-04-02 Thread Wangda Tan
Hi Gera, It's my bad, I thought only src/bin tarball is enough. I just uploaded all other things under artifact/ to http://people.apache.org/~wangda/hadoop-3.1.0-RC1/ Please let me know if you have any other comments. Thanks, Wangda On Mon, Apr 2, 2018 at 12:50 AM, Gera Shegalov wrote: > Th

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-04-02 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/739/ No changes -1 overall The following subsystems voted -1: findbugs unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint she

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-04-02 Thread Sunil G
+1 (binding) On Mon 2 Apr, 2018, 12:24 Sunil G, wrote: > Thanks Wangda for initiating the release. > > I tested this RC built from source file. > > >- Tested MR apps (sleep, wc) and verified both new YARN UI and old RM >UI. >- Below feature sanity is done > - Application priori

[jira] [Created] (HDFS-13382) Allocator does not initialize lotSize during hdfs mover process

2018-04-02 Thread Qingxin Wu (JIRA)
Qingxin Wu created HDFS-13382: - Summary: Allocator does not initialize lotSize during hdfs mover process Key: HDFS-13382 URL: https://issues.apache.org/jira/browse/HDFS-13382 Project: Hadoop HDFS

[jira] [Created] (HDFS-13381) [SPS]: Use DFSUtilClient#makePathFromFileId() to prepare satisfier file path

2018-04-02 Thread Rakesh R (JIRA)
Rakesh R created HDFS-13381: --- Summary: [SPS]: Use DFSUtilClient#makePathFromFileId() to prepare satisfier file path Key: HDFS-13381 URL: https://issues.apache.org/jira/browse/HDFS-13381 Project: Hadoop HDFS

RE: Apache Hadoop 2.9.1 Release Plan

2018-04-02 Thread Chen, Sammi
Hi All, Today I have created branch-2.9.1 from branch-2.9 and started creating the RC0 based on branch-2.9.1. But due to the corporate network conditions and my not full privileges on Hadoop, it will take a while for RC0 to come out. If you have anything want to commit to branch-2.9.1,

[jira] [Created] (HDFS-13380) RBF: mv/rm fail after the directory exceeded the quota limit

2018-04-02 Thread Weiwei Wu (JIRA)
Weiwei Wu created HDFS-13380: Summary: RBF: mv/rm fail after the directory exceeded the quota limit Key: HDFS-13380 URL: https://issues.apache.org/jira/browse/HDFS-13380 Project: Hadoop HDFS Iss

[jira] [Created] (HDFS-13379) Failure when running dfs command on a wasb url

2018-04-02 Thread Jackal Tsai (JIRA)
Jackal Tsai created HDFS-13379: -- Summary: Failure when running dfs command on a wasb url Key: HDFS-13379 URL: https://issues.apache.org/jira/browse/HDFS-13379 Project: Hadoop HDFS Issue Type: Bu

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-04-02 Thread Gera Shegalov
Thanks, Wangda! There are many more artifacts in previous votes, e.g., see http://home.apache.org/~junping_du/hadoop-2.8.3-RC0/ . Among others the site tarball is missing. On Sun, Apr 1, 2018 at 11:54 PM Sunil G wrote: > Thanks Wangda for initiating the release. > > I tested this RC built from