hadoop-2.1.1-beta & hadoop-2.2.0 (GA)

Gang, I spent time looking through changes slated for hadoop-2.1.1-beta and things look fairly contained (~10 or so changes for each of Common, HDFS, YARN & MapReduce). Can I, henceforth, request committers to exercise large dollops of caution when committing to branch-2.1-beta? This way I h

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

Yep, there are quite a number of such fixes in 2.1.1 ATM, I think it will serve us better to get 2.1.0 out and then quickly turn around to make 2.1.1. My current plan is to start work on 2.1.1 right after this release gets complete… hopefully next week. thanks, Arun On Aug 16, 2013, at 4:36 PM

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

There are other such isolated and well understood bug-fixes that we pushed to 2.1.1 in the interesting of making progress with 2.1.0 and the corresponding API changes. 2.1.1 should happen soon enough after this. Thanks, +Vinod On Aug 16, 2013, at 4:22 PM, Roman Shaposhnik wrote: > What are t

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

I've changed the target version of HADOOP-9880 to 2.1.1.  Please change it back, if you feel that it needs to be in 2.1.0-beta. Kihwal From: Kihwal Lee To: Arun Murthy ; "common-...@hadoop.apache.org" Cc: "mapreduce-...@hadoop.apache.org" ; "hdfs-dev@hado

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

It's your call, Arun.  I.e. as long you believe rc2 meets the expectations and objectives of 2.1.0-beta. Kihwal From: Arun Murthy To: "common-...@hadoop.apache.org" Cc: Kihwal Lee ; "mapreduce-...@hadoop.apache.org" ; "hdfs-dev@hadoop.apache.org" ; "yarn-.

Re: mapred replication

Why should this lead to an IOException? Is it because the pruning of replicas is asynchronous and the datanodes try to access nonexistent files? If so that seems like a pretty major bug On Fri, Aug 16, 2013 at 5:21 PM, Chris Nauroth wrote: > Hi Eric, > > Yes, this is intentional. The job.xml

Re: mapred replication

Hi Eric, Yes, this is intentional. The job.xml file and the job jar file get read from every node running a map or reduce task. Because of this, using a higher than normal replication factor on these files improves locality. More than 3 task slots will have access to local replicas. These file

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

That makes sense too. On Aug 16, 2013, at 10:39 AM, Vinod Kumar Vavilapalli wrote: > > We need to make a call on what blockers will be. From my limited > understanding, this doesn't seem like a API or a compatibility issue. Can we > not fix it in subsequent bug-fix releases? > > I do see a lo

[jira] [Created] (HDFS-5107) Fix array copy error in Readdir and Readdirplus responses

Brandon Li created HDFS-5107: Summary: Fix array copy error in Readdir and Readdirplus responses Key: HDFS-5107 URL: https://issues.apache.org/jira/browse/HDFS-5107 Project: Hadoop HDFS Issue Typ

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

We need to make a call on what blockers will be. From my limited understanding, this doesn't seem like a API or a compatibility issue. Can we not fix it in subsequent bug-fix releases? I do see a lot of follow up releases to 2.1.0. Getting this release out will help downstream projects start t

Re: [ACTION NEEDED]: protoc 2.5.0 in trunk/branch-2/branch-2.1-beta/branch-2.1.0-beta

On 16 August 2013 02:50, Jun Ping Du wrote: > Hi Tsuyoshi, >I just checked Hadoop wiki on HowToContribute and it points > ProtocolBuffer things to YARN Readme which is already updated to 2.5.0 now. > > Thanks, > > Junping > > I remember spending time on that page trying to document protobuf,

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

Ok, I'll spin RC3. Can you please help get this in asap? Thanks, much appreciated! Arun On Aug 16, 2013, at 10:13 AM, Kihwal Lee wrote: > We have found HADOOP-9880, which prevents Namenode HA from running with > security. > > > > Kihwal > > > > From: Arun

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

We have found HADOOP-9880, which prevents Namenode HA from running with security. Kihwal From: Arun C Murthy To: "common-...@hadoop.apache.org" ; "hdfs-dev@hadoop.apache.org" ; "mapreduce-...@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Thurs

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

We have found HADOOP-9880, which prevents Namenode HA from running with security. Kihwal From: Arun C Murthy To: "common-...@hadoop.apache.org" ; "hdfs-dev@hadoop.apache.org" ; "mapreduce-...@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Thursda

Jenkins build is back to normal : Hadoop-Hdfs-trunk #1493

See

Is there any Technical Design Document template?

Hi, I am currently working on a solution for HDFS-2933 . Before actual coding, I would like to put my thoughts/ideas in a document. Is there any technical design document template which we use in Hadoop(HDFS) development? Or, can I use my own

Hadoop-Hdfs-0.23-Build - Build # 701 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/701/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7866 lines...] [ERROR] location: class com.google.pro

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #701

See -- [...truncated 7673 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]

Re: [ACTION NEEDED]: protoc 2.5.0 in trunk/branch-2/branch-2.1-beta/branch-2.1.0-beta

Hi Tsuyoshi, I just checked Hadoop wiki on HowToContribute and it points ProtocolBuffer things to YARN Readme which is already updated to 2.5.0 now. Thanks, Junping - Original Message - From: "Tsuyoshi OZAWA" To: hdfs-dev@hadoop.apache.org Cc: common-...@hadoop.apache.org, yarn-...@