Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-08 Thread Tsuyoshi OZAWA
Hi Arun, I apologize for the late response. If the problems are recognized correctly, +1 for the release(non-binding). * Ran examples on pseudo distributed cluster. * Ran tests. * Built from source. Let's fix the problems at the target version(2.4.1). Thanks, - Tsuyoshi On Wed, Apr 9, 2014 at

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-08 Thread sanjay Radia
+1 binding Verified binaries, ran from binary on single node cluster. Tested some HDFS clis and wordcount. sanjay On Apr 7, 2014, at 9:52 AM, Suresh Srinivas wrote: > +1 (binding) > > Verified the signatures and hashes for both src and binary tars. Built from > the source, the binary distrib

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-08 Thread Steve Loughran
another belated +1 binding -set mvn to pull in the 2.4.0 artifacts -rebuilt my slider YARN code. Only compile failure was caused in our custom AmFilterInitializer not compiling due to YARN-1553 dropping a static isSecure() method -switched to inlining WebAppUtils.getHttpSchemePrefix(conf) to cre

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-07 Thread Jason Lowe
Here's my late +1, was just finishing up looking at the release. - Verified signatures and digests - Examined LICENSE file - Installed binary distribution, ran some sample MapReduce jobs and examined logs and job history - Built from source Jason On 04/07/2014 03:04 PM, Arun C Murthy wrote:

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-07 Thread Arun C Murthy
With 11 +1s (4 binding) and no -1s the vote passes. Thanks to everyone who tried out the release and passed their feedback along. I'll send a note out once I actually get the bits out and the site updated etc. thanks, Arun On Mar 31, 2014, at 2:22 AM, Arun C Murthy wrote: > Folks, > > I've c

RE: [VOTE] Release Apache Hadoop 2.4.0

2014-04-07 Thread Bikas Saha
07, 2014 9:55 AM To: hdfs-dev@hadoop.apache.org Cc: common-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.4.0 +1 (Binding) On Mon, Apr 7, 2014 at 11:52 AM, Suresh Srinivas wrote: > +1 (binding) > > Ver

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-07 Thread Jonathan Eagles
+1 (Binding) On Mon, Apr 7, 2014 at 11:52 AM, Suresh Srinivas wrote: > +1 (binding) > > Verified the signatures and hashes for both src and binary tars. Built from > the source, the binary distribution and the documentation. Started a single > node cluster and tested the following: > # Started H

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-07 Thread Suresh Srinivas
+1 (binding) Verified the signatures and hashes for both src and binary tars. Built from the source, the binary distribution and the documentation. Started a single node cluster and tested the following: # Started HDFS cluster, verified the hdfs CLI commands such ls, copying data back and forth, v

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-07 Thread Sanjay Radia
On Thu, Apr 3, 2014 at 4:55 PM, Tsuyoshi OZAWA wrote: > Hi, > > Ran tests and confirmed that some tests(TestSymlinkLocalFSFileSystem) > fail. The log of the test failure is as follows: > > https://gist.github.com/oza/9965197 > > Should we fix or disable the feature? > Symlinks is still not compl

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-07 Thread Arun C Murthy
Gera, Apologies for the late response, I decided to take the weekend off! *smile* Thanks for the feedback, I took a look at your list and here are some observations: On Apr 4, 2014, at 5:06 PM, Gera Shegalov wrote: > I built the release from the rc tag, enabled timeline history service and

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-04 Thread Eli Collins
+1 for another rc. There have been quite a few issues found (handful marked blocker) and this is only the first release candidate, seems like the point of having multiple release candidates is to iterate with another one that addresses the major issues found with the previous one. On Fri, Apr 4,

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-04 Thread Gera Shegalov
I built the release from the rc tag, enabled timeline history service and ran a sleep job on a pseudo-distributed cluster. I encourage another rc, for 2.4.0 (non-binding) 1) Despite the discussion on YARN-1701, timeline AHS still sets yarn.timeline-service.generic-application-history.fs-history-s

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-04 Thread Azuryy
Arun, Do you mean you will cut another RC for 2.4? Sent from my iPhone5s > On 2014年4月5日, at 3:50, "Arun C. Murthy" wrote: > > Thanks for helping Tsuyoshi. Pls mark them as Blockers and set the > fix-version to 2.4.1. > > Thanks again. > > Arun > > >> On Apr 3, 2014, at 11:38 PM, Tsuyosh

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-04 Thread Arun C. Murthy
Thanks for helping Tsuyoshi. Pls mark them as Blockers and set the fix-version to 2.4.1. Thanks again. Arun > On Apr 3, 2014, at 11:38 PM, Tsuyoshi OZAWA wrote: > > Hi, > > Updated a test result log based on the result of 2.4.0-rc0: > https://gist.github.com/oza/9965197 > > IMO, there are

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Tsuyoshi OZAWA
Hi, Updated a test result log based on the result of 2.4.0-rc0: https://gist.github.com/oza/9965197 IMO, there are some blockers to be fixed: * MAPREDUCE-5815(TestMRAppMaster failure) * YARN-1872(TestDistributedShell failure) * HDFS: TestSymlinkLocalFSFileSystem failure on Linux (I cannot find JI

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Tsuyoshi OZAWA
Hi, Ran tests and confirmed that some tests(TestSymlinkLocalFSFileSystem) fail. The log of the test failure is as follows: https://gist.github.com/oza/9965197 Should we fix or disable the feature? Thanks, - Tsuyoshi On Mon, Mar 31, 2014 at 6:22 PM, Arun C Murthy wrote: > Folks, > > I've creat

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Tsuyoshi OZAWA
Azurry, can you file the RM-failover related bug as a JIRA? I'm going to reproduce it in my local. Thanks, - Tsuyoshi On Fri, Apr 4, 2014 at 7:47 AM, Azuryy wrote: > Did you tested RM failover on Hive? There is bug. > > > Sent from my iPhone5s > >> On 2014年4月4日, at 2:12, Xuan Gong wrote: >> >>

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Haohui Mai
HDFS-6180 seems to be a blocker of 2.4. I'll post a patch later today. ~Haohui On Thu, Apr 3, 2014 at 3:47 PM, Azuryy wrote: > Did you tested RM failover on Hive? There is bug. > > > Sent from my iPhone5s > > > On 2014年4月4日, at 2:12, Xuan Gong wrote: > > > > +1 non-binding > > > > Built from

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Azuryy
Did you tested RM failover on Hive? There is bug. Sent from my iPhone5s > On 2014年4月4日, at 2:12, Xuan Gong wrote: > > +1 non-binding > > Built from source code, tested on a single node cluster. Successfully ran a > few MR sample jobs. > Tested RM failover while job is running. > > Thanks >

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-02 Thread Zhijie Shen
+1 non-binding I built from source code, and setup a single node non-secure cluster with almost the default configurations and ran a number of MR example jobs and distributedshell jobs. I verified the generic and the per-framework (DS job only) historic information has been persisted, and such inf

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-01 Thread Travis Thompson
+1 non-binding Built from git. Started with 120 node 2.3.0 cluster with security and non HA, ran upgrade (non rolling) to 2.4.0. Confirmed fsimage is OK and HDFS successfully upgraded. Also successfully ran some pig jobs and mapreduce examples. Haven't found any issues yet but will continue tes

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-03-31 Thread Zhijie Shen
Hi Sandy, Please find "TimelineServer.apt.vm". Thanks, Zhijie On Mon, Mar 31, 2014 at 11:47 AM, Sandy Ryza wrote: > Thanks Zhijie - where is that document located? > > > On Mon, Mar 31, 2014 at 11:23 AM, Zhijie Shen > wrote: > > > Hi Sandy, > > > > Application History Server (we prefer to cal

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-03-31 Thread Zhijie Shen
Hi Sandy, Application History Server (we prefer to call it Timeline Server instead now) is going to be shipped in 2.4 without security. I've already wrote a document about what it is, what's the current status, and how to config and start it. Via the document, hopefully the users are clear about t

[VOTE] Release Apache Hadoop 2.4.0

2014-03-31 Thread Arun C Murthy
Folks, I've created a release candidate (rc0) for hadoop-2.4.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.4.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.4.0-rc0 The maven artifacts are