@hive.apache.org
Subject: Re: Dose block size determine the number of map task
Thx. So that means hadoop will treat conbinehiveinput as one block if not set
split paramters, is it right?
R
On Wed, Jun 1, 2011 at 6:44 PM, Steven Wong
mailto:sw...@netflix.com>> wrote:
When using CombineHiveInput
Thx. So that means hadoop will treat conbinehiveinput as one block if not
set split paramters, is it right?
R
On Wed, Jun 1, 2011 at 6:44 PM, Steven Wong wrote:
> When using CombineHiveInputFormat, parameters such as mapred.max.split.size
> (and others) help determine how the input is split acr
When using CombineHiveInputFormat, parameters such as mapred.max.split.size
(and others) help determine how the input is split across mappers. Other
factors include whether your input files' format is a splittable format or not.
Hope this helps.
From: Junxian Yan [mailto:junxian@gmail.com]
