[jira] [Created] (HADOOP-8084) Protobuf RPC engine can be optimized to not do copying for the RPC request/response

Protobuf RPC engine can be optimized to not do copying for the RPC request/response --- Key: HADOOP-8084 URL: https://issues.apache.org/jira/browse/HADOOP-8084 Project: H

Re: .23 compile times

A 'mvn package -DskipTests -Pdist' (developer) with no changes takes 3.35mins The biggest offenders are: [INFO] Apache Hadoop Common .. SUCCESS [43.299s] [INFO] Apache Hadoop HDFS SUCCESS [54.776s] [INFO] hadoop-yarn-api ..

Re: Trunk build failure

Could you try mvn -X compile? That should show the exact commands that are being executed which seem to be coming from hadoop-project-dist/pom.xml. On Lion the following worked me: git clone git://git.apache.org/hadoop-common.git cd hadoop-common mvn compile I had a very similar error: [ERR

Re: .23 compile times

Wow, nice! How long is a rebuild with no changes? I'd be delighted if there was a dev profile that just did the bare minimum to produce a working env. Daryn On Feb 16, 2012, at 3:25 PM, Alejandro Abdelnur wrote: > I've just done some tweaks in the POMs and I'm cutting the 8.30min full > dist

Re: .23 compile times

I've just done some tweaks in the POMs and I'm cutting the 8.30min full dist build down to 3.45min. I'm removing all javadoc stuff from the dist profile. I think we should introduce a developer profile that does this. Also, the 'mvn install -DskipTests', to get the JARs in your m2 cache is taking

FUSE compile

Hi People, the secrete recipe to compile FUSE is for Centos x86_64: I download hadoop stable: 0.20.203 compile script: #!/bin/bash export CFLAGS=-m64 export CXXFLAGS=-m64 ant \ -Dforrest.home=/home/arion/forrest/apache-forrest-0.9 \ -Djava5.home=/home/arion/java/jdk1.5.0_22 \ -Dfindbugs.home=/h

[jira] [Created] (HADOOP-8083) javadoc generation for some modules is not done under target/

javadoc generation for some modules is not done under target/ - Key: HADOOP-8083 URL: https://issues.apache.org/jira/browse/HADOOP-8083 Project: Hadoop Common Issue Type: Bug

Re: Partitioners - How to know if they are working

Hi Fabio, There are test cases in the MapReduce project releases that test setting a custom partitioner and ensuring it works as intended. But if you still wish to assert/assure self, you should be able to add a LOG statement to your custom Partitioner class's initialization methods, that may ind

Partitioners - How to know if they are working

Hello All, I wrote my own partitioner and I would like to see if it's working. By printing the return of method getPartition I could see that the partitions were different, but were they really working? To answer that I got the keys that every reducer task processed and that was what I expected.

Re: datanode to blocks mapping

Selwa, I'm glad I could help. I suggest you import the source code in an IDE (we use Eclipse) and navigate around it. The outline view in Eclipse is a lifesaver :) BlocksMap does not seem to have that API. I would try FSNamesystem on the namenode. On the client side, the DFSClient class is what o

[jira] [Created] (HADOOP-8082) add hadoop-client and hadoop-minicluster to the dependency-management section

add hadoop-client and hadoop-minicluster to the dependency-management section - Key: HADOOP-8082 URL: https://issues.apache.org/jira/browse/HADOOP-8082 Project: Hadoop Common

[jira] [Created] (HADOOP-8081) HOD Should Be Less Restrictive Over Options Passed To Resource Manager

HOD Should Be Less Restrictive Over Options Passed To Resource Manager -- Key: HADOOP-8081 URL: https://issues.apache.org/jira/browse/HADOOP-8081 Project: Hadoop Common Issu

Re: please recommend some materials of analyzing mapreduce sourcecode。

Here are some links that may fit your request: http://code.google.com/p/hadoop-clusternet/wiki/DebuggingJobsUsingEclipse http://let-them-c.blogspot.com/2011/07/configurations-of-running-hadoop.html http://www.slideshare.net/pacoid/getting-started-on-hadoop http://wiki.apache.org/hadoop/HowToDebugM

Build failed in Jenkins: Hadoop-Common-trunk #319

See Changes: [todd] MAPREDUCE-3864. Fix cluster setup docs for correct SecondaryNameNode HTTPS parameters. Contributed by Todd Lipcon. [eli] HADOOP-8074. Small bug in hadoop error message for unknown commands. Contributed by Colin

Build failed in Jenkins: Hadoop-Common-0.23-Build #165

See Changes: [todd] MAPREDUCE-3864. Fix cluster setup docs for correct SecondaryNameNode HTTPS parameters. Contributed by Todd Lipcon. [eli] HADOOP-8074. svn merge -c 1244766 from trunk [suresh] HDFS-2938. Merging change 1244