[jira] [Created] (HADOOP-13395) Enhance TestKMSAudit

2016-07-21 Thread Xiao Chen (JIRA)
Xiao Chen created HADOOP-13395: -- Summary: Enhance TestKMSAudit Key: HADOOP-13395 URL: https://issues.apache.org/jira/browse/HADOOP-13395 Project: Hadoop Common Issue Type: Test Compone

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/101/ [Jul 20, 2016 7:18:32 AM] (vvasudev) YARN-5309. Fix SSLFactory truststore reloader thread leak in [Jul 20, 2016 12:42:51 PM] (stevel) HADOOP-13212 Provide an option to set the socket buffers in [Jul 20, 20

[jira] [Created] (HADOOP-13396) Add json format audit logging to KMS

2016-07-21 Thread Xiao Chen (JIRA)
Xiao Chen created HADOOP-13396: -- Summary: Add json format audit logging to KMS Key: HADOOP-13396 URL: https://issues.apache.org/jira/browse/HADOOP-13396 Project: Hadoop Common Issue Type: New Fe

[DISCUSS] The order of classpath isolation work and updating/shading dependencies on trunk

2016-07-21 Thread Tsuyoshi Ozawa
Hi developers, I'd like to discuss how to make an advance towards dependency management in Apache Hadoop trunk code since there has been lots work about updating dependencies in parallel. Summarizing recent works and activities as follows: 0) Currently, we have merged minimum update dependencies

[jira] [Created] (HADOOP-13397) Add dockerfile for Hadoop

2016-07-21 Thread Klaus Ma (JIRA)
Klaus Ma created HADOOP-13397: - Summary: Add dockerfile for Hadoop Key: HADOOP-13397 URL: https://issues.apache.org/jira/browse/HADOOP-13397 Project: Hadoop Common Issue Type: Bug Rep

Re: [DISCUSS] Official Docker Image at release time

2016-07-21 Thread Tsuyoshi Ozawa
> Create a JIRA to trace this requirement at: > https://issues.apache.org/jira/browse/HADOOP-13397 Awesome. Thanks Klaus for filing the issue. Do you have any idea to solve the concern Roman and Sean have? In other words, could you clarify what your Docker script actually does? > I am with Sean

Re: [DISCUSS] Official Docker Image at release time

2016-07-21 Thread Tsuyoshi Ozawa
Hi Kai, Thanks for your positive feedback! > I think also providing Dockerfile in some flexible form (like template file or fetching configuration from env variables?) is useful because Docker image has fixed configuration and there is no room unless overriding with FROM. Sounds good idea. What

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2016-07-21 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/30/ [Jul 20, 2016 7:18:32 AM] (vvasudev) YARN-5309. Fix SSLFactory truststore reloader thread leak in [Jul 20, 2016 12:42:51 PM] (stevel) HADOOP-13212 Provide an option to set the socket buffers in [Jul 20, 201

[jira] [Resolved] (HADOOP-13394) Swift should have proper HttpClient dependencies

2016-07-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HADOOP-13394. - Resolution: Duplicate Close as dup of HADOOP-11614 > Swift should have proper HttpClient dependencies >

Setting JIRA fix versions for 3.0.0 releases

2016-07-21 Thread Andrew Wang
Hi all, Since we're planning to spin releases off of both branch-2 and trunk, the changelog for 3.0.0-alpha1 based on JIRA information isn't accurate. This is because historically, we've only set 2.x fix versions, and 2.8.0 and 2.9.0 and etc have not been released. So there's a whole bunch of chan

Re: 2.7.3 release plan

2016-07-21 Thread Vinod Kumar Vavilapalli
Started on the RC two days ago, but running into a nexus issue - not able to push the jars up stream for two days - the remote end is dropping the connection consistently. Trying to figure out workarounds. Thanks +Vinod > On Jul 13, 2016, at 4:09 PM, Vinod Kumar Vavilapalli > wrote: > > HAD

Re: Setting JIRA fix versions for 3.0.0 releases

2016-07-21 Thread Vinod Kumar Vavilapalli
The L & N fixes just went out, I’m working to push out 2.7.3 - running into a Nexus issue. Once that goes out, I’ll immediately do a 2.8.0. Like I requested before in one of the 3.x threads, can we just line up 3.0.0-alpha1 right behind 2.8.0? That simplifies most of this confusion, we can avoi

Re: [DISCUSS] The order of classpath isolation work and updating/shading dependencies on trunk

2016-07-21 Thread Sangjin Lee
Thanks Tsuyoshi for opening the discussion. One benefit of the dependency/classpath isolation work is that it can open up a possibility of having diverging dependencies in a safe manner so that upgrading libraries may have less impact. I'll spend some more time on HADOOP-13070 to make some progress

[jira] [Created] (HADOOP-13398) prevent user classes from loading classes in the parent classpath with ApplicationClassLoader

2016-07-21 Thread Sangjin Lee (JIRA)
Sangjin Lee created HADOOP-13398: Summary: prevent user classes from loading classes in the parent classpath with ApplicationClassLoader Key: HADOOP-13398 URL: https://issues.apache.org/jira/browse/HADOOP-13398

[jira] [Created] (HADOOP-13399) deprecate the Configuration classloader

2016-07-21 Thread Sangjin Lee (JIRA)
Sangjin Lee created HADOOP-13399: Summary: deprecate the Configuration classloader Key: HADOOP-13399 URL: https://issues.apache.org/jira/browse/HADOOP-13399 Project: Hadoop Common Issue Type:

[jira] [Created] (HADOOP-13400) update the ApplicationClassLoader implementation in line with latest Java ClassLoader implementation

2016-07-21 Thread Sangjin Lee (JIRA)
Sangjin Lee created HADOOP-13400: Summary: update the ApplicationClassLoader implementation in line with latest Java ClassLoader implementation Key: HADOOP-13400 URL: https://issues.apache.org/jira/browse/HADOOP-1

Re: [DISCUSS] The order of classpath isolation work and updating/shading dependencies on trunk

2016-07-21 Thread Sean Busbey
thanks for bringing this up! big +1 on upgrading dependencies for 3.0. I have an updated patch for HADOOP-11804 ready to post this week. I've been updating HBase's master branch to try to make use of it, but could use some other reviews. On Thu, Jul 21, 2016 at 4:30 AM, Tsuyoshi Ozawa wrote: > H

[jira] [Created] (HADOOP-13401) usability improvements of ApplicationClassLoader

2016-07-21 Thread Sangjin Lee (JIRA)
Sangjin Lee created HADOOP-13401: Summary: usability improvements of ApplicationClassLoader Key: HADOOP-13401 URL: https://issues.apache.org/jira/browse/HADOOP-13401 Project: Hadoop Common Is

Re: Setting JIRA fix versions for 3.0.0 releases

2016-07-21 Thread Andrew Wang
I really, really want a 3.0.0-alpha1 ASAP, since it's basically impossible for downstreams to test incompat changes and new features without a release artifact. I've been doing test builds, and branch-3.0.0-alpha1 is ready for an RC besides possibly this fix version issue. I'm not too worried abou

Re: [DISCUSS] Official Docker Image at release time

2016-07-21 Thread Sean Busbey
Folks might want to take a look at https://issues.apache.org/jira/browse/HBASE-12721 and its associated review board posting of aggregate work. One of hte HBase community members has been creating infra (geared towards test ATM) for spinning up clusters of docker images. from what I understand, r

Re: Setting JIRA fix versions for 3.0.0 releases

2016-07-21 Thread Sean Busbey
> Longer-term, I assume the 2.x line is not ending with 2.8. So we'd still > have the issue of things committed for 2.9.0 that will be appearing for the > first time in 3.0.0-alpha1. Assuming a script exists to fix up 2.9 JIRAs, > it's only incrementally more work to also fix up 2.8 and other unrel

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Akira Ajisaka
Hi folks, qbt for trunk+JDK8 on Linux/x86 is failing by executable '/home/jenkins/tools/maven/latest3//bin/mvn' for 'maven' does not exist. Would someone fix this? Regards, Akira On 7/21/16 00:41, Apache Jenkins Server wrote: For more details, see https://builds.apache.org/job/hadoop-qbt-

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Allen Wittenauer
I've already asked on builds and infra if it was related to some other changes they made. As usual, radio silence. On the flip side, the PPC machines are making builds and in many ways might be more valuable. e.g., pointing out that the leveldb changes in YARN have pretty much completely b

Re: Setting JIRA fix versions for 3.0.0 releases

2016-07-21 Thread Vinod Kumar Vavilapalli
> I really, really want a 3.0.0-alpha1 ASAP, since it's basically impossible > for downstreams to test incompat changes and new features without a release > artifact. I've been doing test builds, and branch-3.0.0-alpha1 is ready for > an RC besides possibly this fix version issue. Not arguing a

Re: Setting JIRA fix versions for 3.0.0 releases

2016-07-21 Thread Sean Busbey
On Thu, Jul 21, 2016 at 4:32 PM, Vinod Kumar Vavilapalli wrote: >> I really, really want a 3.0.0-alpha1 ASAP, since it's basically impossible >> for downstreams to test incompat changes and new features without a release >> artifact. I've been doing test builds, and branch-3.0.0-alpha1 is ready

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Sean Busbey
they've been puppetizing the Y! hosted machines, so it's probably related. Can someone point me to the exact jenkins job? I htink I fixed this for HBase once already. On Thu, Jul 21, 2016 at 3:31 PM, Allen Wittenauer wrote: > > I've already asked on builds and infra if it was related to some othe

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Akira Ajisaka
Failing jenkins job https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/ -Akira On 7/21/16 14:43, Sean Busbey wrote: they've been puppetizing the Y! hosted machines, so it's probably related. Can someone point me to the exact jenkins job? I htink I fixed this for HBase once already.

[jira] [Created] (HADOOP-13402) S3A should allow renaming to a pre-existing destination directory to move the source path under that directory, similar to HDFS.

2016-07-21 Thread Chris Nauroth (JIRA)
Chris Nauroth created HADOOP-13402: -- Summary: S3A should allow renaming to a pre-existing destination directory to move the source path under that directory, similar to HDFS. Key: HADOOP-13402 URL: https://issues

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/102/ [Jul 21, 2016 6:14:39 PM] (jing9) HDFS-10653. Optimize conversion from path string to components. [Jul 21, 2016 6:26:08 PM] (aajisaka) HDFS-10287. MiniDFSCluster should implement AutoCloseable. Contributed

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/103/ No changes - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.a

RE: Setting JIRA fix versions for 3.0.0 releases

2016-07-21 Thread Zheng, Kai
My humble feeling is almost the same regarding the urgent need of a 3.0 alpha release. Considering EC, shell-script rewriting and etc. are significant changes and there are interested users that want to evaluate EC storage method, an alpha 3.0 release will definitely help a lot allowing users t

Re: Setting JIRA fix versions for 3.0.0 releases

2016-07-21 Thread Andrew Wang
Thanks for the input Vinod, inline: > Similarly the list of features we are enabling in this alpha would be good > - may be update the Roadmap wiki. Things like classpath-isolation which > were part of the original 3.x roadmap are still not done. > > I already updated the website release notes at

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/104/ [Jul 21, 2016 9:43:57 PM] (mfoley) HADOOP-13382. Remove unneeded commons-httpclient dependencies from POM - To unsubscribe, e-mail: co

[jira] [Created] (HADOOP-13403) AzureNativeFileSystem rename/delete performance improvements

2016-07-21 Thread Subramanyam Pattipaka (JIRA)
Subramanyam Pattipaka created HADOOP-13403: -- Summary: AzureNativeFileSystem rename/delete performance improvements Key: HADOOP-13403 URL: https://issues.apache.org/jira/browse/HADOOP-13403 Pr

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/105/ No changes - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.a

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/106/ No changes - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.a

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/107/ No changes - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.a

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/108/ No changes ERROR: File 'out/email-report.txt' does not exist - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For addi

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Sean Busbey
Okay, I have something hacked together as of this build: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/109 It's terrible, but it will get us through when infra uses puppet across the H* hosts. I can fix it again after that. (the puppet use might also break all the precommit jobs,

Re: [DISCUSS] 2.6.x line releases

2016-07-21 Thread Chris Trezzo
Sangjin, I would be happy to help you with the work for cutting 2.6.5. Thanks! Chris Trezzo On Wed, Jul 20, 2016 at 2:44 PM, Akira AJISAKA wrote: > Hi Sangjin, > > I'm thinking it's time for 2.6.5 release. Now there are 51 fixed issues in > 2.6.5 and the number is more than 2.6.4 (47). > > > Ho

Re: [DISCUSS] 2.6.x line releases

2016-07-21 Thread Zhe Zhang
We are using 2.6 releases and would like to see 2.6.5. One related issue, pre-commit is not working for 2.6 (see comment from Allen https://issues.apache.org/jira/browse/HDFS-10653?focusedCommentId=15388621&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15388621). Sh

[jira] [Created] (HADOOP-13404) RPC call hangs when server side CPU overloaded

2016-07-21 Thread Peter Shi (JIRA)
Peter Shi created HADOOP-13404: -- Summary: RPC call hangs when server side CPU overloaded Key: HADOOP-13404 URL: https://issues.apache.org/jira/browse/HADOOP-13404 Project: Hadoop Common Issue Ty

Re: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-21 Thread Sean Busbey
Infra's going to start trying out the puppet stuff on H2 in about an hour to get a better idea of what might break when the full roll out happens. If anyone notices something amiss, just give me a ping (or try to update labels to use "yahoo-not-h2" instead of "Hadoop") On Thu, Jul 21, 2016 at 6:49

[jira] [Created] (HADOOP-13405) doc for “fs.s3a.acl.default” indicates wrong values

2016-07-21 Thread Shen Yinjie (JIRA)
Shen Yinjie created HADOOP-13405: Summary: doc for “fs.s3a.acl.default” indicates wrong values Key: HADOOP-13405 URL: https://issues.apache.org/jira/browse/HADOOP-13405 Project: Hadoop Common

Re: [DISCUSS] 2.6.x line releases

2016-07-21 Thread Sangjin Lee
Thanks Chris for stepping up! I'll work with Chris to get started on the 2.6.5 release soon. Regards, Sangjin On Thu, Jul 21, 2016 at 4:43 PM, Chris Trezzo wrote: > Sangjin, I would be happy to help you with the work for cutting 2.6.5. > > Thanks! > Chris Trezzo > > On Wed, Jul 20, 2016 at 2:44

[jira] [Created] (HADOOP-13406) S3AFileSystem: Consider reusing filestatus in delete and mkdir

2016-07-21 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created HADOOP-13406: - Summary: S3AFileSystem: Consider reusing filestatus in delete and mkdir Key: HADOOP-13406 URL: https://issues.apache.org/jira/browse/HADOOP-13406 Project: H