RE: [RFE] Support MIT Kerberos localauth plugin API

2015-03-05 Thread Zheng, Kai
Hello Leo/Liou >> And the plugin interface can be as simple as this function (error handling >> ignored here) ... I thought it's good to have the pluggable allowing to customize the method how to perform the mapping. You could open a JIRA for this. If you'd like to work on it and need help, pl

[jira] [Created] (HADOOP-11676) Add API to NetworkTopology for getting all racks

2015-03-05 Thread Walter Su (JIRA)
Walter Su created HADOOP-11676: -- Summary: Add API to NetworkTopology for getting all racks Key: HADOOP-11676 URL: https://issues.apache.org/jira/browse/HADOOP-11676 Project: Hadoop Common Issue

Build failed in Jenkins: Hadoop-common-trunk-Java8 #125

2015-03-05 Thread Apache Jenkins Server
See Changes: [wheat9] HDFS-7879. hdfs.dll does not export functions of the public libhdfs API. Contributed by Chris Nauroth. [jlowe] YARN-3131. YarnClientImpl should check FAILED and KILLED state in submitApplication. Contri

[jira] [Created] (HADOOP-11677) Missing secure session attributed for log and static contexts

2015-03-05 Thread nijel (JIRA)
nijel created HADOOP-11677: -- Summary: Missing secure session attributed for log and static contexts Key: HADOOP-11677 URL: https://issues.apache.org/jira/browse/HADOOP-11677 Project: Hadoop Common

[jira] [Reopened] (HADOOP-11475) Utilize try-with-resource to close StopWatch

2015-03-05 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa reopened HADOOP-11475: - > Utilize try-with-resource to close StopWatch > ---

[jira] [Created] (HADOOP-11678) AvroSerializer buffers output in violation of contract for Serializer

2015-03-05 Thread Matthew Willson (JIRA)
Matthew Willson created HADOOP-11678: Summary: AvroSerializer buffers output in violation of contract for Serializer Key: HADOOP-11678 URL: https://issues.apache.org/jira/browse/HADOOP-11678 Proje

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Yongjun Zhang
Thanks all. There is an open issue HDFS-6962 (ACLs inheritance conflicts with umaskmode), for which the incompatibility appears to make it not suitable for 2.x and it's targetted 3.0, please see: https://issues.apache.org/jira/browse/HDFS-6962?focusedCommentId=14335418&page=com.atlassian.jira.plu

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Chris Douglas
On Mon, Mar 2, 2015 at 11:04 PM, Konstantin Shvachko wrote: > 2. If Hadoop 3 and 2.x are meant to exist together, we run a risk to > manifest split-brain behavior again, as we had with hadoop-1, hadoop-2 and > other versions. If that somehow beneficial for commercial vendors, which I > don't see h

[jira] [Created] (HADOOP-11679) Create build infrastructure for the native RPC client

2015-03-05 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11679: --- Summary: Create build infrastructure for the native RPC client Key: HADOOP-11679 URL: https://issues.apache.org/jira/browse/HADOOP-11679 Project: Hadoop Common

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Vinod Kumar Vavilapalli
Moving to JDK8 involves a lot of things (1) Get Hadoop apps to be able to run on JDK8 and chose JDK8 language features. This is already possible with the decoupling of apps from the platform. (2) Get the platform to run on JDK8. This can be done so that we can run Hadoop on both JDK8 and JDK7

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Vinod Kumar Vavilapalli
The 'resistance' is not so much about a new major release, more so about the content and the roadmap of the release. Other than the two specific features raised (the need for breaking compat for them is something that I am debating), I haven't seen a roadmap of branch-3 about any more features

[jira] [Created] (HADOOP-11680) Deduplicate jars in convenience binary distribution

2015-03-05 Thread Sean Busbey (JIRA)
Sean Busbey created HADOOP-11680: Summary: Deduplicate jars in convenience binary distribution Key: HADOOP-11680 URL: https://issues.apache.org/jira/browse/HADOOP-11680 Project: Hadoop Common

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Alejandro Abdelnur
IMO, if part of the community wants to take on the responsibility and work that takes to do a new major release, we should not discourage them from doing that. Having multiple major branches active is a standard practice. This time around we are not replacing the guts as we did from Hadoop 1 to H

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Jason Lowe
I'm OK with a 3.0.0 release as long as we are minimizing the pain of maintaining yet another release line and conscious of the incompatibilities going into that release line. For the former, I would really rather not see a branch-3 cut so soon.  It's yet another line onto which to cherry-pick, a

Re: 2.7 status

2015-03-05 Thread Vinod Kumar Vavilapalli
The 2.7 blocker JIRA went down and going back up again, we will need to converge. Unless I see objections, I plan to cut a branch this weekend and selectively filter stuff in after that in the interest of convergence. Thoughts welcome! Thanks, +Vinod On Mar 1, 2015, at 11:58 AM, Arun Murthy

Re: Reviving HADOOP-7435: Making Jenkins pre-commit build work with branches

2015-03-05 Thread Vinod Kumar Vavilapalli
Tx for the feedback! Let's continue on JIRA, but I'd definitely welcome as much help as is available. Thanks, +Vinod On Mar 4, 2015, at 3:30 PM, Zhijie Shen wrote: > +1. It¹s really helpful for branch development. To continue Karthik¹s > point, is it good make pre-commit testing against branch

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Steve Loughran
On 05/03/2015 13:05, "Alejandro Abdelnur" mailto:tuc...@gmail.com>> wrote: IMO, if part of the community wants to take on the responsibility and work that takes to do a new major release, we should not discourage them from doing that. Having multiple major branches active is a standard practic

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Steve Loughran
Sorry, outlook dequoted Alejandros's comments. Let me try again with his comments in italic and proofreading of mine On 05/03/2015 13:59, "Steve Loughran" mailto:ste...@hortonworks.com>> wrote: On 05/03/2015 13:05, "Alejandro Abdelnur" mailto:tuc...@gmail.com>> wrote

[jira] [Created] (HADOOP-11681) HBase gives up retries after being throttled by Azure storage

2015-03-05 Thread Duo Xu (JIRA)
Duo Xu created HADOOP-11681: --- Summary: HBase gives up retries after being throttled by Azure storage Key: HADOOP-11681 URL: https://issues.apache.org/jira/browse/HADOOP-11681 Project: Hadoop Common

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Siddharth Seth
I think it'll be useful to have a discussion about what else people would like to see in Hadoop 3.x - especially if the change is potentially incompatible. Also, what we expect the release schedule to be for major releases and what triggers them - JVM version, major features, the need for incompati

[jira] [Created] (HADOOP-11682) Move the native code for libhadoop into a dedicated directory

2015-03-05 Thread Haohui Mai (JIRA)
Haohui Mai created HADOOP-11682: --- Summary: Move the native code for libhadoop into a dedicated directory Key: HADOOP-11682 URL: https://issues.apache.org/jira/browse/HADOOP-11682 Project: Hadoop Common

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Andrew Wang
I've taken the liberty of adding a Hadoop 3 section to the Roadmap wiki page. In addition to the two things I've been pushing, I also looked through Allen's list (thanks Allen for making this) and picked out the shell script rewrite and the removal of HFTP as big changes. This would be the place to

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Allen Wittenauer
Is there going to be a general upgrade of dependencies? I'm thinking of jetty & jackson in particular. On Mar 5, 2015, at 5:24 PM, Andrew Wang wrote: > I've taken the liberty of adding a Hadoop 3 section to the Roadmap wiki > page. In addition to the two things I've been pushing, I also looke

Re: Looking to a Hadoop 3 release

2015-03-05 Thread Alejandro Abdelnur
If classloader isolation is in place, then dependency versions can freely be upgraded as won't pollute apps space (things get trickier if there is an ON/OFF switch). On Thu, Mar 5, 2015 at 9:21 PM, Allen Wittenauer wrote: > > Is there going to be a general upgrade of dependencies? I'm thinking

[jira] [Created] (HADOOP-11683) Need a plugin API to translate long principal names to local OS user names arbitrarily

2015-03-05 Thread Sunny Cheung (JIRA)
Sunny Cheung created HADOOP-11683: - Summary: Need a plugin API to translate long principal names to local OS user names arbitrarily Key: HADOOP-11683 URL: https://issues.apache.org/jira/browse/HADOOP-11683