Saurabh,
> let me re frame my question I wanted to knowhow job tracker decides the
> assignment of input splits to task tracker based on task tracker's data
> locality. Where is this policy defined? Is it pluggable?
Sorry, I misunderstood your question then. This code is in
o.a.h.mapred.JobInPro
Hi Hemanth,
let me re frame my question I wanted to knowhow job tracker decides the
assignment of input splits to task tracker based on task tracker's data
locality. Where is this policy defined? Is it pluggable?
Saurabh Agarwal
On Fri, May 14, 2010 at 7:04 AM, Hemanth Yamijala wrote:
> Saurab
Saurabh,
> i am experimenting with hadoop. wanted to ask that is the Task distribution
> policy by job tracker pluggable if yes where in the code tree is it defined.
>
Take a look at o.a.h.mapred.TaskScheduler. That's the abstract class
that needs to be extended to define a new scheduling policy.
Hi,
i am experimenting with hadoop. wanted to ask that is the Task distribution
policy by job tracker pluggable if yes where in the code tree is it defined.
Thanks and regards
Saurabh Agarwal
