Re: How HDFS decides where to put the block

2011-04-19 Thread Kai Voigt
Hi, I found http://hadoopblog.blogspot.com/2009/09/hdfs-block-replica-placement-in-your.html explains the process nicely. The first replica of each block will be stored on the client machine, if it's a datanode itself. Makes sense, as it doesn't require a network transfer. Otherwise, a random

Re: How HDFS decides where to put the block

2011-04-19 Thread real great..
In this context I would like to ask, can we actually place the data where we wish instead of allowing Hadoop's intelligence to take care of this? On Tue, Apr 19, 2011 at 10:52 AM, Kai Voigt wrote: > Hi, > > I found > http://hadoopblog.blogspot.com/2009/09/hdfs-block-replica-placement-in-your.htm

Re: How HDFS decides where to put the block

2011-04-18 Thread Nan Zhu
Yes, that's it Thanks Nan On Mon, Apr 18, 2011 at 10:16 PM, Harsh J wrote: > Hello, > > On Mon, Apr 18, 2011 at 7:16 PM, Nan Zhu wrote: > > Hi, all > > > > I'm confused by a question that "how does the HDFS decide where to put > the > > data blocks " > > > > I mean that the user invokes some

Re: How HDFS decides where to put the block

2011-04-18 Thread Harsh J
Hello, On Mon, Apr 18, 2011 at 7:16 PM, Nan Zhu wrote: > Hi, all > > I'm confused by a question that "how does the HDFS decide where to put the > data blocks " > > I mean that the user invokes some commands like "./hadoop put ***", we > assume that this  file consistes of 3 blocks, but how HDFS d

How HDFS decides where to put the block

2011-04-18 Thread Nan Zhu
Hi, all I'm confused by a question that "how does the HDFS decide where to put the data blocks " I mean that the user invokes some commands like "./hadoop put ***", we assume that this file consistes of 3 blocks, but how HDFS decides where these 3 blocks to be put? Most of the materials don't i