Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Xuan Gong
+1 (non-binding) downloaded the source tar ball, built, ran a number of MR jobs on a single-node cluster and checked the job history from job history server. On Wed, Feb 12, 2014 at 7:53 PM, Gera Shegalov wrote: > +1 non-binding > > - checked out the rc tag and built from source > - deployed a

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Gera Shegalov
+1 non-binding - checked out the rc tag and built from source - deployed a pseudo-distributed cluster with yarn.resourcemanager.recovery.enabled=true - ran a sleep job with multiple map waves and a long reducer -- SIGKILL'd AM at various points and verified AM restart -- SIGKILL'd RM at various po

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Aaron T. Myers
I don't think any of what you describe below is a regression in behavior from earlier releases. The fs.defaultFS has been set to file:/// for a long time, and likewise you've similarly had to set up your YARN configs. Given that, I don't think this warrants a new RC. -- Aaron T. Myers Software Eng

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Masatake Iwasaki
+1 (non-binding) I downloaded the source tarball, built it, started pseudo distrubuted cluster, run wordcount example job. > The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 Though the hadoop-2.3.0.tar.gz downloaded from above URL contains site documentation in share

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Alejandro Abdelnur
Running pseudo cluster out of the box (expanding the binary tar, or building from source) does not work, you have to go an set the MR framework to yarn, the default FS URI to hdfs://localhost:8020, and so on. While I don't see this as showstopper (for the knowledgeable user), it will make may user

[jira] [Created] (HADOOP-10342) Extend UserGroupInformation to return a UGI given a preauthenticated kerberos Subject

2014-02-12 Thread Larry McCay (JIRA)
Larry McCay created HADOOP-10342: Summary: Extend UserGroupInformation to return a UGI given a preauthenticated kerberos Subject Key: HADOOP-10342 URL: https://issues.apache.org/jira/browse/HADOOP-10342

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Zhijie Shen
+1 (non-binding) I download the source tar ball, built from it, ran a number of MR jobs on a single-node cluster, checked the job history from job history server. On Wed, Feb 12, 2014 at 2:47 PM, Jian He wrote: > +1 (non-binding) > > Built from source. Ran a few MR sample jobs on a pseudo clus

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Aaron T. Myers
+1 (binding) I downloaded the source tar ball, checked signatures, built from the source, ran a few of the sample jobs on a pseudo cluster. Everything was as expected. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy wrote: > Folks, > > I've created

[jira] [Created] (HADOOP-10341) Improvements on error handling code

2014-02-12 Thread Ding Yuan (JIRA)
Ding Yuan created HADOOP-10341: -- Summary: Improvements on error handling code Key: HADOOP-10341 URL: https://issues.apache.org/jira/browse/HADOOP-10341 Project: Hadoop Common Issue Type: Improve

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Mit Desai
+1 Non Binding Tested on: Fedora17 with JDK7 -Downloaded the tar -Successful Build with ³mvm install -DskipTests² and ³mvm install -Pnative -DskipTests² -Successfully Verified Signature and Digest -Deployed source to my single node cluster and ran multiple instances of wordcount -Web UI looks goo

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread lohit
To add to this, we saw this on pretty big cluster with multiple pool/queues and different users. At one point ResourceManager was no longer handing out containers and cluster throughput dropped to 20% utilization. Once we restarted ResourceManager things were back to normal. 2014-02-12 11:56 GMT-

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Sangjin Lee
If it's not too late, I'd like to bring your attention to YARN-1692. We get a ConcurrentModificationException with the fair scheduler when it updates demand, and we saw RM get into a pretty bad shape around the time this happened. It would be great if this could make 2.3.0. I provided a patch for

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Masatake Iwasaki
Thanks Arun for your work! The document contained in share/doc/hadoop seems to be moved to share/hadoop. Is this intentional? Regards, Masatake Iwasaki (2014/02/11 6:49), Arun C Murthy wrote:> Folks, > > I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released.

[jira] [Created] (HADOOP-10340) FileInputFormat.listStatus() including directories in its results

2014-02-12 Thread Jason Dere (JIRA)
Jason Dere created HADOOP-10340: --- Summary: FileInputFormat.listStatus() including directories in its results Key: HADOOP-10340 URL: https://issues.apache.org/jira/browse/HADOOP-10340 Project: Hadoop Com

[jira] [Created] (HADOOP-10339) Set io.sort.mb to 10 for distcp jobs

2014-02-12 Thread Siqi Li (JIRA)
Siqi Li created HADOOP-10339: Summary: Set io.sort.mb to 10 for distcp jobs Key: HADOOP-10339 URL: https://issues.apache.org/jira/browse/HADOOP-10339 Project: Hadoop Common Issue Type: Improvemen

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Stack
+1 Downloaded, deployed to small cluster, and then ran an hbase loading on top of it. Looks good. Packaging wise, is it intentional that some jars show up a few times? I can understand webapps bundling a copy but doesn't mapreduce depend on commons? share/hadoop/mapreduce/lib/hadoop-annotation

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Akira AJISAKA
+1 (non-binding) - Upgraded HDFS including snapshots from 2.2. - Ran a few sample jobs. - WebUI looks good. Thanks, Akira (2014/02/12 7:09), Karthik Kambatla wrote: +1 (non-binding) Built source. Brought up a pseudo-cluster with manual RM HA. Ran a few MR examples. On Tue, Feb 11, 2014 a

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Karthik Kambatla
+1 (non-binding) Built source. Brought up a pseudo-cluster with manual RM HA. Ran a few MR examples. On Tue, Feb 11, 2014 at 10:40 PM, Roman Shaposhnik wrote: > Very nice! I'll take it for the usual round of testing in Bigtop. > > Should take a few days, but I'll keep you guys posted! > > Than

Build failed in Jenkins: Hadoop-Common-trunk #1039

2014-02-12 Thread Apache Jenkins Server
See Changes: [sandy] Fix YARN-1697 in CHANGES.txt [shv] HDFS-4858. HDFS DataNode to NameNode RPC should timeout. Contributed by Henry Wang. [zjshen] YARN-1719. Fixed the root path related Jersey warnings produced in ATSWebServic