Hi Hemanth
Thank you for your kindly reply. Do you know what really the setup do? Does
it will take the data locality into account?
On Wed, Oct 13, 2010 at 11:38 PM, Hemanth Yamijala wrote:
> If you are talking about the 'Setup task' that is used to initialize
> or setup the job, yes, it can run
If you are talking about the 'Setup task' that is used to initialize
or setup the job, yes, it can run on either the map slot or reduce
slot depending on what is available.
Thanks
Hemanth
On Thu, Oct 14, 2010 at 1:54 AM, He Chen wrote:
> Hi, all
>
> I found out that if the there is no map slot,
On Oct 13, 2010, at 4:00 AM, Sujitha wrote:
>
> Hi all,
>As a part of my research i am trying to authenticate users.For
> this i created a Browser Level Kerberos authentication.
SPNEGO or something custom?
> After that
> i have identified issues related to cookies on the brows
Hi, all
I found out that if the there is no map slot, Hadoop will use reduce slot to
setup mapreduce job when I submit a series of jobs.
The first two jobs setuped themselves with a MapAttempt. However, they
occupy all the map slots. When the third job comes, I find out it uses the
ReduceAttempt
yes, I finally find the corresponding codes
it's in TaskTracker.MapOutputServelet,
doGet()->sendMapFile()->TaskTracker.MapOutputLost()
it's true that the hadoop use redo strategy to solve this problem , but for
some papers, it indicates that we can also replicate the intermediate result
to make i
Hi all,
As a part of my research i am trying to authenticate users.For
this i created a Browser Level Kerberos authentication.After that
i have identified issues related to cookies on the browser side.
So shall i move towards terminal level authentication??
Suggestions Please.
Suji
Hi, according to Hadoop The Definitive Guide , map will store the
intermediate output to a in-memory buffer first, and the spill it to local
disk which configured by mapred.local.dir, so from i knew, if the
intermediate data lost , only redo can fix it.
if i wrong, please correct me.
2010/9/27 Na
