Build failed in Jenkins: Hadoop-Common-trunk #2740

2016-05-10 Thread Apache Jenkins Server
See Changes: [vinodkv] YARN-4842. Fixed "yarn logs" command to guess (and thus not require) the -- [...truncated 3846 lines...] Generating

[jira] [Created] (HADOOP-13124) Support weights/priority for user in Faircallqueue

2016-05-10 Thread Ravi Teja Ch N V (JIRA)
Ravi Teja Ch N V created HADOOP-13124: - Summary: Support weights/priority for user in Faircallqueue Key: HADOOP-13124 URL: https://issues.apache.org/jira/browse/HADOOP-13124 Project: Hadoop Common

Re: [DISCUSS] Merge Jersey upgrade(HADOOP-9613) to trunk

2016-05-10 Thread Allen Wittenauer
+1 agreed. > On May 9, 2016, at 2:13 PM, Akira AJISAKA wrote: > > +1 for marking HADOOP-9613 as incompatible change and upgrading the version > in trunk. > > Thanks, > Akira > > On 5/9/16 12:12, Tsuyoshi Ozawa wrote: >> Hi developers, >> >> We’ve worked on upgrading jersey(HADOOP-9613) for

[DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

2016-05-10 Thread Akira AJISAKA
Hi developers, Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. Given this is a critical change, I'm thinking we should get the consensus first. One concern I think is, when the minimum version is set to JDK8, we need to configure Jenkins to disable multi JDK test only i

[DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

2016-05-10 Thread Hitesh Shah
There have been various discussions on various JIRAs where upstream projects such as YARN apps ( Tez, Slider, etc ) are called out for using the above so-called Private APIs. A lot of YARN applications that have been built out have picked up various bits and pieces of implementation from MapRedu

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

2016-05-10 Thread Allen Wittenauer
> On May 10, 2016, at 8:32 AM, Akira AJISAKA wrote: > > Hi developers, > > Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. +1 yes please. > One concern I think is, when the minimum version is set to JDK8, we need to > configure Jenkins to disable multi JDK te

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

2016-05-10 Thread Allen Wittenauer
> On May 10, 2016, at 8:37 AM, Hitesh Shah wrote: > > There have been various discussions on various JIRAs where upstream projects > such as YARN apps ( Tez, Slider, etc ) are called out for using the above > so-called Private APIs. A lot of YARN applications that have been built out > have p

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1452

2016-05-10 Thread Apache Jenkins Server
See Changes: [epayne] MAPREDUCE-6678. Allow ShuffleHandler readahead without drop-behind. [jlowe] MAPREDUCE-6684. High contention on scanning of user directory under -- [...truncated 5

Build failed in Jenkins: Hadoop-Common-trunk #2741

2016-05-10 Thread Apache Jenkins Server
See Changes: [epayne] MAPREDUCE-6678. Allow ShuffleHandler readahead without drop-behind. [jlowe] MAPREDUCE-6684. High contention on scanning of user directory under [aajisaka] HADOOP-13118. Fix IOUtils#cleanup and IOUtils#closeSt

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

2016-05-10 Thread Tsuyoshi Ozawa
> Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. Sounds good. To do so, we need to check the blockers of 3.0.0-alpha RC, especially upgrading all dependencies which use refractions at first. Thanks, - Tsuyoshi On Tue, May 10, 2016 at 8:32 AM, Akira AJISAKA wrote: > Hi de

[jira] [Created] (HADOOP-13125) FS Contract tests don't report FS initialization errors well

2016-05-10 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13125: --- Summary: FS Contract tests don't report FS initialization errors well Key: HADOOP-13125 URL: https://issues.apache.org/jira/browse/HADOOP-13125 Project: Hadoop

[jira] [Created] (HADOOP-13126) Add Brotli compression codec

2016-05-10 Thread Ryan Blue (JIRA)
Ryan Blue created HADOOP-13126: -- Summary: Add Brotli compression codec Key: HADOOP-13126 URL: https://issues.apache.org/jira/browse/HADOOP-13126 Project: Hadoop Common Issue Type: Improvement

Re: [DISCUSS] Merge Jersey upgrade(HADOOP-9613) to trunk

2016-05-10 Thread Colin McCabe
+1 for updating this in trunk. Thanks, Tsuyoshi Ozawa. cheers, Colin On Mon, May 9, 2016, at 12:12, Tsuyoshi Ozawa wrote: > Hi developers, > > We’ve worked on upgrading jersey(HADOOP-9613) for a years. It's > essential change to support complication with JDK8. It’s almost there. > > One concer

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

2016-05-10 Thread Hitesh Shah
There seems to be some incorrect assumptions on why the application had an issue. For rolling upgrade deployments, the application bundles the client-side jars that it was compiled against and uses them in its classpath and expects to be able to communicate with upgraded servers. Given that hado

Re: 7 build nodes are down

2016-05-10 Thread Colin McCabe
Did INFRA have any information on this? best, On Fri, May 6, 2016, at 15:14, Allen Wittenauer wrote: > > Anyone know why? > > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-ma

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

2016-05-10 Thread Colin McCabe
On Tue, May 10, 2016, at 11:34, Hitesh Shah wrote: > There seems to be some incorrect assumptions on why the application had > an issue. For rolling upgrade deployments, the application bundles the > client-side jars that it was compiled against and uses them in its > classpath and expects to be ab

Jenkins build is back to normal : Hadoop-common-trunk-Java8 #1453

2016-05-10 Thread Apache Jenkins Server
See - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

2016-05-10 Thread Ravi Prakash
+1. Thanks for driving this Akira On Tue, May 10, 2016 at 10:25 AM, Tsuyoshi Ozawa wrote: > > Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. > > Sounds good. To do so, we need to check the blockers of 3.0.0-alpha > RC, especially upgrading all dependencies which use refra

Re: [DISCUSS] Merge Jersey upgrade(HADOOP-9613) to trunk

2016-05-10 Thread Ravi Prakash
+1. Awesome effort Tsuyoshi. This has been blocking compression on the wire too. On Tue, May 10, 2016 at 11:24 AM, Colin McCabe wrote: > +1 for updating this in trunk. Thanks, Tsuyoshi Ozawa. > > cheers, > Colin > > On Mon, May 9, 2016, at 12:12, Tsuyoshi Ozawa wrote: > > Hi developers, > > > >

[jira] [Reopened] (HADOOP-10980) TestActiveStandbyElector fails occasionally in trunk

2016-05-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reopened HADOOP-10980: -- Assignee: Eric Badger This test failed for me locally when I was running a separate zookeepe

Build failed in Jenkins: Hadoop-Common-trunk #2742

2016-05-10 Thread Apache Jenkins Server
See Changes: [cmccabe] HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO -- [...truncated 5157 lines...] Running org.apache.hadoop.security.TestKDiagNoKDC Running org.

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

2016-05-10 Thread Andrew Wang
+1 On Tue, May 10, 2016 at 12:36 PM, Ravi Prakash wrote: > +1. Thanks for driving this Akira > > On Tue, May 10, 2016 at 10:25 AM, Tsuyoshi Ozawa wrote: > > > > Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. > > > > Sounds good. To do so, we need to check the blockers of

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

2016-05-10 Thread Chris Nauroth
+1 for transitioning from LimitedPrivate to Public. I view this as an extension of the need for UserGroupInformation and related APIs to be Public. Regardless of the original intent behind LimitedPrivate, these are de facto public now, because there is no viable alternative for applications that

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

2016-05-10 Thread Andrew Wang
Why don't we address these on a case-by-case basis, changing the annotations on these key classes to Public? LimitedPrivate{"YARN applications"} is the same thing as Public. This way we don't need to add special exceptions to our compatibility policy. Keeps it simple. Best, Andrew On Tue, May 10

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

2016-05-10 Thread Chris Nauroth
Yes, I agree with you Andrew. Sorry, I should clarify my prior response. I didn't mean to imply a blind s/LimitedPrivate/Public/g across the whole codebase. Instead, I'm +1 for the intent of HADOOP-10776: a transition to Public for UserGroupInformation, and by extension the related parts of i

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1454

2016-05-10 Thread Apache Jenkins Server
See Changes: [stevel] HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with [stevel] HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang [epayne] YARN-4768. getAvailablePhysicalMemorySiz

Build failed in Jenkins: Hadoop-Common-trunk #2743

2016-05-10 Thread Apache Jenkins Server
See Changes: [stevel] HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with [stevel] HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang [epayne] YARN-4768. getAvailablePhysicalMemorySize can

[jira] [Resolved] (HADOOP-7738) Document incompatible API changes between 0.20.20x and 0.23.0 release

2016-05-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved HADOOP-7738. - Resolution: Won't Fix This is obviously too late to do. We keep moving th

[jira] [Created] (HADOOP-13127) Correctly cache delegation tokens in KMSClientProvider

2016-05-10 Thread Xiao Chen (JIRA)
Xiao Chen created HADOOP-13127: -- Summary: Correctly cache delegation tokens in KMSClientProvider Key: HADOOP-13127 URL: https://issues.apache.org/jira/browse/HADOOP-13127 Project: Hadoop Common

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

2016-05-10 Thread Colin McCabe
Thanks for explaining, Chris. I generally agree that UserGroupInformation should be annotated as Public rather than LimitedPrivate, although you guys have more context than I do. However, I do think it's important that we clarify that we can break public APIs across a major version transition suc

[jira] [Created] (HADOOP-13128) Manage Hadoop RPC resource usage via resource coupon

2016-05-10 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HADOOP-13128: --- Summary: Manage Hadoop RPC resource usage via resource coupon Key: HADOOP-13128 URL: https://issues.apache.org/jira/browse/HADOOP-13128 Project: Hadoop Common

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1455

2016-05-10 Thread Apache Jenkins Server
See Changes: [zhz] HDFS-10172. hdfs erasurecode command should remove the redundant -usage [cnauroth] HADOOP-12801. Suppress obsolete S3FileSystem tests. Contributed by Chris -- [...t

Build failed in Jenkins: Hadoop-Common-trunk #2744

2016-05-10 Thread Apache Jenkins Server
See Changes: [zhz] HDFS-10172. hdfs erasurecode command should remove the redundant -usage [cnauroth] HADOOP-12801. Suppress obsolete S3FileSystem tests. Contributed by Chris [ozawa] HADOOP-10694. Remove synchronized input stream

Jenkins build is back to normal : Hadoop-common-trunk-Java8 #1456

2016-05-10 Thread Apache Jenkins Server
See - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1457

2016-05-10 Thread Apache Jenkins Server
See Changes: [Arun Suresh] YARN-5073. Refactor startContainerInternal() in ContainerManager to -- [...truncated 5659 lines...] Java HotSpot(TM) 64-Bit Server VM warning: ignoring optio