[jira] [Created] (HADOOP-11863) Document process of deploying alternative file systems like S3 and Azure to the classpath.

2015-04-21 Thread Chris Nauroth (JIRA)
Chris Nauroth created HADOOP-11863: -- Summary: Document process of deploying alternative file systems like S3 and Azure to the classpath. Key: HADOOP-11863 URL: https://issues.apache.org/jira/browse/HADOOP-11863

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Chris Nauroth
Suppose we configure maven-compiler-plugin with set to 1.7 but set to 1.8 in trunk. I believe this would have the effect of generating JDK 8 bytecode, but enforcing that our code sticks to JDK 7 compatibility at compile time. Does that still satisfy requirements for HADOOP-11858? I'd prefer to

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Sean Busbey
A few options: * Only change the builds for master to use jdk8 * build with both jdk7 and jdk8 by copying jobs * build with both jdk7 and jdk8 using a jenkins matrix build Robert, if you'd like help with any of these please send me a ping off-list. On Tue, Apr 21, 2015 at 8:19 PM, Vinod Kumar Va

[jira] [Created] (HADOOP-11862) Add support key share across KMS instances for KMS HA

2015-04-21 Thread dengxiumao (JIRA)
dengxiumao created HADOOP-11862: --- Summary: Add support key share across KMS instances for KMS HA Key: HADOOP-11862 URL: https://issues.apache.org/jira/browse/HADOOP-11862 Project: Hadoop Common

[jira] [Resolved] (HADOOP-11829) Improve the vector size of Bloom Filter from int to long, and storage from memory to disk

2015-04-21 Thread Hongbo Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongbo Xu resolved HADOOP-11829. Resolution: Invalid > Improve the vector size of Bloom Filter from int to long, and storage from

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Vinod Kumar Vavilapalli
We don't want JDK 8 only code going into branch-2 line. Moving Jenkins to 1.8 right-away will shield such code, how do we address that? Thanks, +Vinod On Apr 21, 2015, at 5:54 PM, Robert Kanter wrote: > Sure, I'll try to change the Jenkins builds to 1.8 first. > > On Tue, Apr 21, 2015 at 3:31

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Vinod Kumar Vavilapalli
Actually I didn't see any conclusion on this, on the previous third. There were proposals and counter points, but we never made a decision. We should get consensus first. Thanks +Vinod On Apr 21, 2015, at 3:14 PM, Robert Kanter wrote: > Hi all, > > Moving forward on some of the discussions o

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Robert Kanter
Sure, I'll try to change the Jenkins builds to 1.8 first. On Tue, Apr 21, 2015 at 3:31 PM, Andrew Wang wrote: > Hey Robert, > > As a first step, could we try switching all our precommit and nightly > builds over to use 1.8? This is a prerequisite for HADOOP-11858, and safe > to do in any case si

Re: [DISCUSS] Looking to a 2.8.0 release

2015-04-21 Thread Vinod Kumar Vavilapalli
Sure, I agree it's better to have clear guidelines and scheme. Let me fork this thread about that. Re 2.7.0, I just forgot about the naming initially though I was clear in the discussion/voting. I so had to end up calling it alpha outside of the release artifact naming. Thanks +Vinod On Apr

Re: [DISCUSS] Looking to a 2.8.0 release

2015-04-21 Thread Vinod Kumar Vavilapalli
Thanks for your comment Karthik. Here's my take. Feature based release is going to put us back into the same prolonged release cycle. That is why I am proposing that we look at 2-3 months time and get whatever is ready. If we don't have even a single feature in by then, clearly we can drop the

Re: [DISCUSS] Looking to a 2.8.0 release

2015-04-21 Thread Andrew Wang
I would also like to support Karthik's proposal on the release thread about version numbering. 2.7.0 being "alpha" is pretty confusing since all of the other 2.x releases since GA have been stable. I think users would prefer a version like "2.8.0-alpha1" instead, which is very clear and similar to

[jira] [Created] (HADOOP-11861) test-patch script always fails when option "--build-native=false" is specified

2015-04-21 Thread Anu Engineer (JIRA)
Anu Engineer created HADOOP-11861: - Summary: test-patch script always fails when option "--build-native=false" is specified Key: HADOOP-11861 URL: https://issues.apache.org/jira/browse/HADOOP-11861 P

[jira] [Created] (HADOOP-11860) Enhance erasure coder allowing to read least required inputs in decoding of block group

2015-04-21 Thread Kai Zheng (JIRA)
Kai Zheng created HADOOP-11860: -- Summary: Enhance erasure coder allowing to read least required inputs in decoding of block group Key: HADOOP-11860 URL: https://issues.apache.org/jira/browse/HADOOP-11860

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Andrew Wang
Hey Robert, As a first step, could we try switching all our precommit and nightly builds over to use 1.8? This is a prerequisite for HADOOP-11858, and safe to do in any case since it'll still target 1.7. I'll note that HADOOP-10530 details the pain Steve went through switching us to JDK7. Might b

[jira] [Created] (HADOOP-11859) PseudoAuthenticationHandler fails with httpcomponents v4.4

2015-04-21 Thread Eugene Koifman (JIRA)
Eugene Koifman created HADOOP-11859: --- Summary: PseudoAuthenticationHandler fails with httpcomponents v4.4 Key: HADOOP-11859 URL: https://issues.apache.org/jira/browse/HADOOP-11859 Project: Hadoop Com

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Robert Kanter
+ yarn-dev, hdfs-dev, mapred-dev On Tue, Apr 21, 2015 at 3:14 PM, Robert Kanter wrote: > Hi all, > > Moving forward on some of the discussions on Hadoop 3, I've created > HADOOP-11858 to set the minimum version of Hadoop 3 to JDK 8. I just > wanted to let everyone know in case there's some reas

Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Robert Kanter
Hi all, Moving forward on some of the discussions on Hadoop 3, I've created HADOOP-11858 to set the minimum version of Hadoop 3 to JDK 8. I just wanted to let everyone know in case there's some reason we shouldn't go ahead with this. thanks - Robert

Re: [DISCUSS] Looking to a 2.8.0 release

2015-04-21 Thread Karthik Kambatla
The feature set here seems pretty long, even for 2 - 3 months. Can we come up with a minimum set of features (or a number of features) that justify a new minor release, and start stabilizing as soon as those are in? On Tue, Apr 21, 2015 at 2:39 PM, Vinod Kumar Vavilapalli wrote: > With 2.7.0 out

[jira] [Created] (HADOOP-11858) [JDK8] Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-11858: -- Summary: [JDK8] Set minimum version of Hadoop 3 to JDK 8 Key: HADOOP-11858 URL: https://issues.apache.org/jira/browse/HADOOP-11858 Project: Hadoop Common

Re: committing HADOOP-11746 test-patch improvements

2015-04-21 Thread Allen Wittenauer
FYI, MAPREDUCE-6324 is the first JIRA to be tested with the new code in place if someone hasn’t seen the new output. On Apr 21, 2015, at 9:06 PM, Allen Wittenauer wrote: > > > Just a heads up that I’ll be committing this to trunk and branch-2 here > in a bit. I’ll watch it over the n

[DISCUSS] Looking to a 2.8.0 release

2015-04-21 Thread Vinod Kumar Vavilapalli
With 2.7.0 out of the way, and with more maintenance releases to stabilize it, I propose we start thinking about 2.8.0. Here's my first cut of the proposal, will update the Roadmap wiki. - Support *both* JDK7 and JDK8 runtimes: HADOOP-11090 - Compatibility tools to catch backwards, forwards comp

Re: committing HADOOP-11746 test-patch improvements

2015-04-21 Thread Allen Wittenauer
Just a heads up that I’ll be committing this to trunk and branch-2 here in a bit. I’ll watch it over the next hour or two before heading off to bed. (I’m in London at the moment.) If there are any issues, revert and drop a note in HADOOP-11746 with any issues. Despite what will hope

[jira] [Created] (HADOOP-11857) Fix CommandFormat#commandFormat java doc annotation

2015-04-21 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HADOOP-11857: --- Summary: Fix CommandFormat#commandFormat java doc annotation Key: HADOOP-11857 URL: https://issues.apache.org/jira/browse/HADOOP-11857 Project: Hadoop Common I

[jira] [Created] (HADOOP-11856) ArrayIndexOutOfBoundsException in MiniDFSCluster.

2015-04-21 Thread surendra singh lilhore (JIRA)
surendra singh lilhore created HADOOP-11856: --- Summary: ArrayIndexOutOfBoundsException in MiniDFSCluster. Key: HADOOP-11856 URL: https://issues.apache.org/jira/browse/HADOOP-11856 Project: Had

[jira] [Resolved] (HADOOP-11855) Add -Djava.awt.headless=true to pom.xml entries

2015-04-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11855. --- Resolution: Duplicate > Add -Djava.awt.headless=true to pom.xml entries > --

[jira] [Reopened] (HADOOP-10290) Surefire steals focus on MacOS

2015-04-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reopened HADOOP-10290: --- JDK7 is not fixing this for me. Re-opening. > Surefire steals focus on MacOS > ---

[jira] [Created] (HADOOP-11855) Add -Djava.awt.headless=true to pom.xml entries

2015-04-21 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-11855: - Summary: Add -Djava.awt.headless=true to pom.xml entries Key: HADOOP-11855 URL: https://issues.apache.org/jira/browse/HADOOP-11855 Project: Hadoop Common

Re: Hadoop On Windows: YarnRuntimeException: Permissions incorrectly set for dir /nm-local-dir/filecache, should be rwxr-xr-x, actual value = rw-rw-rw-

2015-04-21 Thread Umesh Kant
Hi Guys, Could you please help with this issue, I guess some would have faced same issue  when running Hadoop on Windows. Thanks,Umesh Kant   From: Umesh Kant To: "common-dev@hadoop.apache.org" Sent: Wednesday, April 15, 2015 7:50 PM Subject: Hadoop On Windows: YarnRuntimeException: Perm

[jira] [Created] (HADOOP-11854) Fix Typos in all the projects

2015-04-21 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HADOOP-11854: - Summary: Fix Typos in all the projects Key: HADOOP-11854 URL: https://issues.apache.org/jira/browse/HADOOP-11854 Project: Hadoop Common Iss

Build failed in Jenkins: Hadoop-common-trunk-Java8 #172

2015-04-21 Thread Apache Jenkins Server
See Changes: [vinayakumarb] HDFS-8173. NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) [jianhe] YARN-3497. ContainerManagementProtocolProxy modifies IPC timeout