Re: [Continued] [Release thread] 2.8.0 release activities

2017-01-20 Thread Junping Du
Hi, I have successfully built the release bit on branch-2.8.0 by following: https://wiki.apache.org/hadoop/HowToRelease step by step. However, when try to close the "Staging Repositories" at Nexus page (https://repository.apache.org/#stagingRepositories), I found our repository - orgapacheh

[jira] [Created] (HADOOP-14005) 2.7.3 shipped without Snappy support

2017-01-20 Thread David Choppa (JIRA)
David Choppa created HADOOP-14005: - Summary: 2.7.3 shipped without Snappy support Key: HADOOP-14005 URL: https://issues.apache.org/jira/browse/HADOOP-14005 Project: Hadoop Common Issue Type:

[jira] [Created] (HADOOP-14006) dkopp;[;;[']]]]][[pplkkkkkkkkkjjjjjjhhhhgggffdyhfiot9ify6u;;d[][dlf

2017-01-20 Thread Kurt Ostfeld (JIRA)
Kurt Ostfeld created HADOOP-14006: - Summary: dkopp;[;;['][[pplkjjgggffdyhfiot9ify6u;;d[][dlf Key: HADOOP-14006 URL: https://issues.apache.org/jira/browse/HADOOP-14006 Project: Hado

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-01-20 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/292/ [Jan 19, 2017 7:38:20 AM] (lei) HDFS-11287. Storage class member storageDirs should be private to avoid [Jan 19, 2017 8:24:11 AM] (wang) HDFS-110268. Correctly reconstruct erasure coding file from FSImage.

[jira] [Created] (HADOOP-14007) cli to list info about a bucket (S3guard or not)

2017-01-20 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14007: --- Summary: cli to list info about a bucket (S3guard or not) Key: HADOOP-14007 URL: https://issues.apache.org/jira/browse/HADOOP-14007 Project: Hadoop Common

[jira] [Resolved] (HADOOP-14006) dkopp;[;;[']]]]][[pplkkkkkkkkkjjjjjjhhhhgggffdyhfiot9ify6u;;d[][dlf

2017-01-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee resolved HADOOP-14006. -- Resolution: Invalid > dkopp;[;;['][[pplkjjgggffdyhfiot9ify6u;;d[][dlf > --

[jira] [Created] (HADOOP-14008) Upgrade to Apache Yetus 0.4.0

2017-01-20 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-14008: - Summary: Upgrade to Apache Yetus 0.4.0 Key: HADOOP-14008 URL: https://issues.apache.org/jira/browse/HADOOP-14008 Project: Hadoop Common Issue Type:

[jira] [Created] (HADOOP-14009) dev-support/bin should use hadoop-functions.sh

2017-01-20 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-14009: - Summary: dev-support/bin should use hadoop-functions.sh Key: HADOOP-14009 URL: https://issues.apache.org/jira/browse/HADOOP-14009 Project: Hadoop Common

[jira] [Created] (HADOOP-14010) Fix the remaining shellcheck errors

2017-01-20 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-14010: - Summary: Fix the remaining shellcheck errors Key: HADOOP-14010 URL: https://issues.apache.org/jira/browse/HADOOP-14010 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-14011) fix the remaining shelldoc errors

2017-01-20 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-14011: - Summary: fix the remaining shelldoc errors Key: HADOOP-14011 URL: https://issues.apache.org/jira/browse/HADOOP-14011 Project: Hadoop Common Issue T

[jira] [Created] (HADOOP-14012) make sure dynamo exceptions are handled in translateException

2017-01-20 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14012: --- Summary: make sure dynamo exceptions are handled in translateException Key: HADOOP-14012 URL: https://issues.apache.org/jira/browse/HADOOP-14012 Project: Hadoop

Re: [Continued] [Release thread] 2.8.0 release activities

2017-01-20 Thread Andrew Wang
You can check the error message by clicking on it, a bunch like this: Missing Signature: '/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.8.0/hadoop-mapreduce-client-jobclient-2.8.0-tests.jar.asc' does not exist for 'hadoop-mapreduce-client-jobclient-2.8.0-tests.jar'. Did you maven deploy

Re: [Continued] [Release thread] 2.8.0 release activities

2017-01-20 Thread Junping Du
Yes. I did maven deploy in root directory before close the staging repository. If this is the only suspect, I can drop the repository and do mvn deploy again. Thanks, Junping From: Andrew Wang Sent: Friday, January 20, 2017 10:48 AM To: Junping Du Cc: common-

Re: [Continued] [Release thread] 2.8.0 release activities

2017-01-20 Thread Andrew Wang
What I meant is that you can mvn deploy the specific missing files to fix up the repo state. Though we should also figure out why the deploy plugin didn't pick up the signature files the first time. Best, Andrew On Fri, Jan 20, 2017 at 11:12 AM, Junping Du wrote: > Yes. I did maven deploy in ro

Re: [Continued] [Release thread] 2.8.0 release activities

2017-01-20 Thread Allen Wittenauer
If you ran mvn clean at any point in your repo between create-release and mvn deploy, you'll need to start at running create-release again. create-release leaves things in a state that mvn deploy should be ready to go, with no clean necessary. > On Jan 20, 2017, at 11:12 AM, Junping Du wrote

[jira] [Created] (HADOOP-14013) S3Guard: fix multi-bucket integration tests

2017-01-20 Thread Aaron Fabbri (JIRA)
Aaron Fabbri created HADOOP-14013: - Summary: S3Guard: fix multi-bucket integration tests Key: HADOOP-14013 URL: https://issues.apache.org/jira/browse/HADOOP-14013 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-14014) Shading runs on mvn deploy

2017-01-20 Thread Andrew Wang (JIRA)
Andrew Wang created HADOOP-14014: Summary: Shading runs on mvn deploy Key: HADOOP-14014 URL: https://issues.apache.org/jira/browse/HADOOP-14014 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-14015) Partitions on Remote HDFS break encryption-zone checks

2017-01-20 Thread Mithun Radhakrishnan (JIRA)
-09 19:26:14,997 ERROR [pool-4-thread-1476] server.TThreadPoolServer (TThreadPoolServer.java:run_aroundBody0(305)) - Error occurred during processing of message. java.lang.IllegalArgumentException: Wrong FS: hdfs://remote-cluster-nn1.myth.net:8020/dbs/mythdb/myth_table/dt=20170120, expected: hdfs

[VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-20 Thread Andrew Wang
Hi all, With heartfelt thanks to many contributors, the RC0 for 3.0.0-alpha2 is ready. 3.0.0-alpha2 is the second alpha in the planned 3.0.0 release line leading up to a 3.0.0 GA. It comprises 857 fixes, improvements, and new features since alpha1 was released on September 3rd, 2016. More inform

Re: [Continued] [Release thread] 2.8.0 release activities

2017-01-20 Thread Andrew Wang
After some googling, I discovered we need the sign profile to make deploy work: mvn deploy -Psign -DskipTests -DskipShading Updated HowToRelease accordingly. On Fri, Jan 20, 2017 at 11:15 AM, Andrew Wang wrote: > What I meant is that you can mvn deploy the specific missing files to fix > up th

Re: [VOTE] Release cadence and EOL

2017-01-20 Thread Sangjin Lee
Thanks for great feedback thus far. I agree with some that this is more of a guideline than a policy. I also agree to some extent that this is not very enforceable given the current practice. I do differ, though, on whether there is value in something like this if it is not completely enforceable

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-20 Thread John Zhuge
Discovered 1 missing license using the script verify-license-notice.sh. Missing LICENSE! ./../hadoop-dist/target/hadoop-3.0.0-alpha2/share/hadoop/client/hadoop-client-api-3.0.0-alpha2.jar - Verified checksums and signatures of the tarballs - Built source with Java 1.8.0_66 on Mac - Deployed a pseu

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-20 Thread Anu Engineer
Hi Andrew, Thank you for all the hard work. I am really excited to see us making progress towards a 3.0 release. +1 (Non-Binding) 1. Deployed the downloaded bits on 4 node cluster with 1 Namenode and 3 datanodes. 2. Verified all normal HDFS operations like create directory, create file , del

[jira] [Created] (HADOOP-14016) add license and notice verifaction to create-release

2017-01-20 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-14016: - Summary: add license and notice verifaction to create-release Key: HADOOP-14016 URL: https://issues.apache.org/jira/browse/HADOOP-14016 Project: Hadoop Commo