Re: datanode ack behavior for block receive

Hi Bin, I think that your observation is correct. The act of sending a SUCCESS status ack can be avoided by intelligently looking at the seqno. However, my opinion is that returning the extra bit of information is not impacting performance/correctness at all, do you agree? thank, dhruba On Mo

Re: Jira mapred-707

Hi Dhruba Thanks for your comments, I added my remarks to the Jira. Can you answer my question? ie. where are the properties initialized? thanks -- Alan On Nov 2, 2009, at 10:17 AM, Dhruba Borthakur wrote: This patch would be helpful. Some general comments on how to contribute are h

[jira] Created: (HADOOP-6356) Add a Cache for AbstractFileSystem in the new FileContext/AbstractFileSystem framework.

Add a Cache for AbstractFileSystem in the new FileContext/AbstractFileSystem framework. --- Key: HADOOP-6356 URL: https://issues.apache.org/jira/browse/HADOOP-6356 Pr

[jira] Created: (HADOOP-6355) Make FileSystemContractBaseTest, LocalFileSystem, and FileSystem javadoc compliant

Make FileSystemContractBaseTest, LocalFileSystem, and FileSystem javadoc compliant --- Key: HADOOP-6355 URL: https://issues.apache.org/jira/browse/HADOOP-6355 Project: H

datanode ack behavior for block receive

Hi All, I observed that there are two kinds of ack'ing going on when a datanode receives a data block packet: 1. ack by sending the sequence number of the received block to upstream datanode; 2. also send operation status (e.g. SUCCESS, ERROR); The seqno is chained, that is, a node will not a

Re: Jira mapred-707

This patch would be helpful. Some general comments on how to contribute are here: http://wiki.apache.org/hadoop/HowToContribute. Your proposal sounds good, let's continue this conversation in the JIRA MAPRED-707. thanks, dhruba On Mon, Nov 2, 2009 at 9:30 AM, alan heirich wrote: > I'm a new con

[jira] Created: (HADOOP-6354) Modify ivy configuration to automatically pull down JSure tools.jar

Modify ivy configuration to automatically pull down JSure tools.jar --- Key: HADOOP-6354 URL: https://issues.apache.org/jira/browse/HADOOP-6354 Project: Hadoop Common Issue Type

[jira] Created: (HADOOP-6353) Create Apache Wiki page for JSure and FlashLight tools

Create Apache Wiki page for JSure and FlashLight tools -- Key: HADOOP-6353 URL: https://issues.apache.org/jira/browse/HADOOP-6353 Project: Hadoop Common Issue Type: Task Reporte

Jira mapred-707

I'm a new contributor, would like to get my feet wet with jira mapreduce-707. I think the right steps are: Create a new property mapred.fairscheduler.pool with default value user.name Change default value of mapred.fairscheduler.poolnameproperty to mapred.fairscheduler.pool Add a unit test

[jira] Resolved: (HADOOP-6352) Streaming with -file non-existant-file just exits without a good message

[ https://issues.apache.org/jira/browse/HADOOP-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat resolved HADOOP-6352. Resolution: Duplicate MAPREDUCE-1068 is already opened to track this. > Streaming with -file non-

[jira] Created: (HADOOP-6352) Streaming with -file non-existant-file just exits without a good message

Streaming with -file non-existant-file just exits without a good message Key: HADOOP-6352 URL: https://issues.apache.org/jira/browse/HADOOP-6352 Project: Hadoop Common