Re:Re: how to select the position of a block

2011-12-06 Thread 郭冲
isGoodTarget() in ReplicationTargetChooser.java judge if a node is a good node, it will consider the disk space , load , and the rack which it located has too much nodes or not .Thanks! At 2011-12-07 13:01:26,"Harsh J" wrote: >Moving discussion to hdfs-dev. > >DataNodes report disk usage (

Re: how to select the position of a block

2011-12-06 Thread Harsh J
Moving discussion to hdfs-dev. DataNodes report disk usage (space) and current transfer thread counts (load) periodically to the NameNode. NameNode uses this information to make a decision while building the pipeline DNs for your client request. I believe the class is called something like Repl

[jira] [Created] (HADOOP-7888) TestFailoverProxy fails intermittently on trunk

2011-12-06 Thread Jason Lowe (Created) (JIRA)
TestFailoverProxy fails intermittently on trunk --- Key: HADOOP-7888 URL: https://issues.apache.org/jira/browse/HADOOP-7888 Project: Hadoop Common Issue Type: Bug Components: test Aff

[jira] [Created] (HADOOP-7887) KerberosAuthenticatorHandler is not setting KerberosName name rules from configuration

2011-12-06 Thread Alejandro Abdelnur (Created) (JIRA)
KerberosAuthenticatorHandler is not setting KerberosName name rules from configuration -- Key: HADOOP-7887 URL: https://issues.apache.org/jira/browse/HADOOP-7887 Proj

strange SIGPIPE from "bin/ls -ld" in Shell.runCommand seen when running HBase tests

2011-12-06 Thread Mikhail Bautin
Hello, I've been running into the following issue when running HBase tests. A lot of them would fail with an exception similar to the one shown below (I added more information to the exception messages). Exit code 141 seems to correspond to SIGPIPE, but I did not find anything obvious in Shell.ja

Re: Which branch for my patch?

2011-12-06 Thread Eli Collins
On Tue, Dec 6, 2011 at 1:54 PM, Niels Basjes wrote: > I got this: > > Hadoop QA commented on HADOOP-7076: > -1 overall.  Here are the results of testing the latest attachment > > http://issues.apache.org/jira/secure/attachment/12506182/HADOOP-7076-branch-0.22.patch >  against trunk revision . > ..

Re: Which branch for my patch?

2011-12-06 Thread Niels Basjes
I got this: Hadoop QA commented on HADOOP-7076: -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12506182/HADOOP-7076-branch-0.22.patch against trunk revision . ... -1 patch. The patch command could not apply the patch. Did I d

Re: Need to know steps of installation of Hadoop 0.23

2011-12-06 Thread Roman Shaposhnik
Hi Ulhas, On Tue, Dec 6, 2011 at 12:20 AM, Ulhas Shringare wrote: > Hello, > I need to know steps to install Hadoop 0.23 , every where there are steps > to install hadoop 0.20. > And there are bit difference between them.Like conf/hadoop-env config file > is not there. > Please provide me suitabl

Need to know steps of installation of Hadoop 0.23

2011-12-06 Thread Ulhas Shringare
Hello, I need to know steps to install Hadoop 0.23 , every where there are steps to install hadoop 0.20. And there are bit difference between them.Like conf/hadoop-env config file is not there. Please provide me suitable information or link. -- Regards, Ulhas Shringare Email : ul...@gigfrix.com /

Re: Hadoop for running tests in parallel

2011-12-06 Thread Steve Loughran
On 04/12/11 22:01, Sandeep Baldawa wrote: Hi, I read few basic things on Hadoop and was interested to know the opinion of experts on few things. These questions might be bit vague, feel free to ask me questions, if the below is not clear. - Can Hadoop framework be used for running large number

Re: How to test/run Hadoop after build the code

2011-12-06 Thread Praveen Sripati
Check the single node and cluster setup documentation for Hadoop http://hadoop.apache.org/common/docs/r0.23.0/ - for the new MR engine (0.23 release) http://hadoop.apache.org/common/docs/r0.20.205.0/ - for the old MR engine (non 0.23 release) Here are some other tutorials for running 0.23 release

Re: Automatically Documenting Apache Hadoop Configuration

2011-12-06 Thread Praveen Sripati
Hi, > From my work on yarn trying to document the configs there and to standardize them, writing anything that is going to automatically detect config values through static analysis is going to be very difficult. This is because most of the configs in yarn are now built up using static string conc