Re: Create a data block in a certain data node

2012-11-09 Thread Vivi Lang
Yes, I know the which block is corrupted and want to rewrite the content of the block. (asuming the replication factor of the related file is 1) On Fri, Nov 9, 2012 at 12:33 PM, Steve Loughran wrote: > On 9 November 2012 17:37, Vivi Lang wrote: > > > thxs for the replying, > &

Re: Create a data block in a certain data node

2012-11-09 Thread Vivi Lang
her, arbitrary block?) though? > > On Fri, Nov 9, 2012 at 7:19 AM, Vivi Lang > > wrote: > > Sorry, I found the previous one is full of typo and hard to understand. I > > will clarify my question: > > > > If I have got a inputstream in a datanode (and this stream contains

Re: Create a data block in a certain data node

2012-11-08 Thread Vivi Lang
this block to replace another exsiting block of one file that already stored in the HDFS), can anyone tell me which is the easiest way to do this? Thanks, On Thu, Nov 8, 2012 at 5:15 PM, Vivi Lang wrote: > Hi all, > > If I want have get a inputstream in a datanode (and this s

Re: A question about reading one block

2012-10-31 Thread Vivi Lang
Please ignore the previous email which I did not describe the problem clearly. On Wed, Oct 31, 2012 at 3:05 PM, Vivi Lang wrote: > Hi, thks for the replying. > > Is there any function can help me to create a InputStream for a certain > Block which stored in a certain datanode >

Re: A question about reading one block

2012-10-31 Thread Vivi Lang
t; opening a file for read (with FileSystem.open API, etc.) with an > offset and length set to to match that of a block, will open and read > only that block. > > On Sat, Oct 27, 2012 at 2:19 AM, Vivi Lang wrote: > > Hi guys, > > > > I am writing a program which need

Question about

2012-09-12 Thread Vivi Lang
Hi all, Is there anyone who can tell me that when we lanuch a mapreduce task, for example, wordcount, after the JobClient obtained the block locations (the related hosts/datanodes are stored in the specified split), which function/class will be called for reading those blocks from the datanode? T

Re: A question about the namenode's decision on the data placement of a new file

2012-08-24 Thread Vivi Lang
Thanks but I found that BlockPlacementPolicy only appear after 0.21.0? Is there any similar class or function appeared in 0.20. On Fri, Aug 24, 2012 at 6:03 PM, Andy Isaacson wrote: > On Fri, Aug 24, 2012 at 3:33 PM, wei xu wrote: > > I am doing some research on the data placement, but I am no