Re: hadoop1.2.1 speedup model

2013-09-06 Thread
>From 2 to 4, the performance increase sub-linearly, however from 4 to 8, it seems super-linear. Is it caused by some disk contention bottleneck? 2013/9/6 牛兆捷 > Hi all: > > I vary the computational nodes of cluster and get the speedup result in > attachment. > > In my

Re: hadoop1.2.1 speedup model

2013-09-07 Thread
> More nodes should process more data in the same amount of time. > > Thanks, > +Vinod > > On Sep 6, 2013, at 8:27 AM, 牛兆捷 wrote: > > > Hi all: > > > > I vary the computational nodes of cluster and get the speedup result in > attachment. > > > > I

Re: hadoop1.2.1 speedup model

2013-09-09 Thread
much skew > to your data. > > --Bobby > > On 9/7/13 3:33 AM, "牛兆捷" wrote: > > >But I still want to fine the most efficient assignment and scale both data > >and nodes as you said, for example in my result, 2 is the best, and 8 is > >better than 4. > &

Re: Video: how to commit a patch to hadoop

2014-01-03 Thread
great~ Thanks Steve 2014/1/3 Steve Loughran > For new committers and for the curious, I've just stuck up a screen capture > with commentary on how to commit a patch to the Hadoop SVN repository > > http://youtu.be/txW3m7qWdzw > > It's 27 minutes long, not just because of the commentary but bec