Significance of file.out.index during Shuffle Phase ?

Hi, I was trying to understand how exactly the reducers find out how to fetch the data of its own partition from Map nodes. During the executions of MapReduce, I see that *file.out* is created on Map nodes, so my question is how does a reducer know what part of file.out to fetch? Is the *file.ou

Re: org.apache.hadoop.ipc.TestRPCCompatibility

it is not expected to fail. Does not fail for me. BTW you can check for the failures for last couple of precommit builds here, to get an idea of tests that are currently failing: https://builds.apache.org/view/Hadoop/job/PreCommit-HADOOP-Build/ On Sat, Aug 18, 2012 at 5:37 PM, Vladimir Rozov wr

org.apache.hadoop.ipc.TestRPCCompatibility

Hi, I am running test against my compiled version of trunk and it fails in org.apache.hadoop.ipc.TestRPCCompatibility. Is it expected? Vlad

Re: HDFS Protocol Documentation

Please see the .proto files: RPC implementation: ./hadoop-common-project/hadoop-common/src/main/proto/hadoop_rpc.proto Protocols used in HDFS. See the corresponding java classes and javadoc for additional information. ./hadoop-hdfs-project/hadoop-hdfs/src/main/proto/ClientDatanodeProtocol.proto .

HDFS Protocol Documentation

Does any documentation exist for interacting with a Hadoop cluster from a native environment as opposed to JNI? Preferably protocol documentation.

1.1.X release

Hi, Hi, quick question - Is there a way to download 1.1.X - current beta version, 1.1 release - none of the mirrors seem to have it. Is building it the only way to get it? Thanks, Slavik

Build failed in Jenkins: Hadoop-Common-trunk #506

See Changes: [eli] HADOOP-8710. Remove ability for users to easily run the trash emptire. Contributed by Eli Collins [eli] HADOOP-8689. Make trash a server side configuration option. Contributed by Eli Collins [tgraves] HADOOP-86