Re: persistent under-replicated blocks

2014-01-09 Thread Cooper Bethea
d). > * Look in the NN log for BlockPlacementPolicy errors. It'll help to enable > DEBUG level output here. > > Best, > Andrew > > > On Thu, Jan 9, 2014 at 10:46 AM, Cooper Bethea >wrote: > > > I have only 9 under-replicated blocks on the cluster, and it is v

Re: persistent under-replicated blocks

2014-01-09 Thread Cooper Bethea
I have only 9 under-replicated blocks on the cluster, and it is very important that I restore my cluster to a fully-replicated state. Is there a way I can manually copy these blocks to other datanodes, or perhaps new datanodes? On Thu, Jan 9, 2014 at 10:34 AM, Cooper Bethea wrote: > Ch

Re: persistent under-replicated blocks

2014-01-09 Thread Cooper Bethea
Here a link to an article about it: > > http://dataforprofit.com/?p=427 > > > > > > On Wed, Jan 8, 2014 at 9:00 PM, Cooper Bethea > > wrote: > > > > > Following on--is there a way that I can forcibly replicate these > blocks, > > > perhaps

Re: persistent under-replicated blocks

2014-01-08 Thread Cooper Bethea
Following on--is there a way that I can forcibly replicate these blocks, perhaps by rsyncing the underlying files to other datanodes? As you might imagine under-replicated data makes me very uneasy. On Wed, Jan 8, 2014 at 12:00 PM, Cooper Bethea wrote: > Hi HDFS developers, > >

persistent under-replicated blocks

2014-01-08 Thread Cooper Bethea
Hi HDFS developers, I have a worrying problem in a 2.0.0-cdh4.4.0 HDFS cluster I am running. 9 blocks in the cluster are persistently reported to be under-replicated per "hdfs fsck". I am able to fetch the files that contain these blocks, so I know that the data is there, but for some reason repl