@hive.apache.org
Subject: Re: Dose block size determine the number of map task
Thx. So that means hadoop will treat conbinehiveinput as one block if not set
split paramters, is it right?
R
On Wed, Jun 1, 2011 at 6:44 PM, Steven Wong
mailto:sw...@netflix.com>> wrote:
When using CombineHiveInput
ser@hive.apache.org
> *Subject:* Dose block size determine the number of map task
>
>
>
> I saw this in hadoop wiki:
> http://wiki.apache.org/hadoop/HowManyMapsAndReduces
>
>
>
> But in my experiment,I see the different result. When I set
> the CombineHiveInputFormat in hi
l.com]
Sent: Wednesday, June 01, 2011 12:45 AM
To: user@hive.apache.org
Subject: Dose block size determine the number of map task
I saw this in hadoop wiki: http://wiki.apache.org/hadoop/HowManyMapsAndReduces
But in my experiment,I see the different result. When I set the
CombineHiveInputForm
I saw this in hadoop wiki:
http://wiki.apache.org/hadoop/HowManyMapsAndReduces
But in my experiment,I see the different result. When I set
the CombineHiveInputFormat in hive and by the doc, the default block should
be 64M, but my input files are more than 64M, hadoop still created one map
task to
