Thanks.
0, there's also `hdfs dfsadmin -setBalancerBandwidth` which can be used
> to adjust this config property at runtime.
>
> Best,
> Andrew
>
>
> On Wed, Dec 18, 2013 at 2:40 PM, Karthiek C wrote:
>
> > Hi all,
> >
> > I am working on a research project where w
Hi all,
I am working on a research project where we are looking at algorithms to
"optimally" distribute data blocks in HDFS nodes. The definition of what is
optimal is omitted for brevity.
I want to move specific blocks of a file that is *already* in HDFS. I am
able to achieve it using data trans
r/balancer/Balancer.java
> >
> > HTH, and feel free to ask any relevant follow up questions.
> >
> > On Fri, Feb 22, 2013 at 11:43 PM, Karthiek C
> wrote:
> > > Hi,
> > >
> > > Is there any APIs to move data blocks in HDFS from one node to an
Hi,
Is there any APIs to move data blocks in HDFS from one node to another *
after* they have been added to HDFS? Also can we write some sort of
pluggable module (like scheduler) that controls how data gets placed in
hadoop cluster? I am working with hadoop-1.0.3 version and I couldn't find
any fi
build. This page details several different
> ways to accomplish that:
>
>
> http://www.mkyong.com/maven/how-to-configure-m2_repo-variable-in-eclipse-ide/
>
> -Erik
>
>
> On Fri, Feb 1, 2013 at 8:44 AM, Karthiek C wrote:
>
> > That's great! So far I tried
rds
> Amir Sanjar
>
> System Management Architect
> PowerLinux Open Source Hadoop development lead
> IBM Senior Software Engineer
> Phone# 512-286-8393
> Fax# 512-838-8858
>
> -Karthiek C wrote: -
> To: common-dev@hadoop.apache.org
> From: Karthiek C
>
That's great! So far I tried using trunk code. But 1.1.x works for me. Can
you please help me out? My purpose is to debug through hadoop's default
scheduler code and schedulers like fair share scheduler.
And thanks for the advice Harsh. I could generate eclipse project files
using the maven comman
