ill use this size to split
>>>> the input LZO files and u will get multiple mappers (and make sure the
>>>> input LZO files are indexed I.e. .LZO.INDEX files are created)
>>>>
>>>> sanjay
>>>>
>>>>
>>>> From: Edward C
;
>>>
>>> If u set this value "low" then the MR job will use this size to split
>>> the input LZO files and u will get multiple mappers (and make sure the
>>> input LZO files are indexed I.e. .LZO.INDEX files are created)
>>>
>>> sanjay
O.INDEX files are created)
>>
>> sanjay
>>
>>
>> From: Edward Capriolo
>> Reply-To: "user@hive.apache.org"
>> Date: Wednesday, August 21, 2013 10:43 AM
>> To: "user@hive.apache.org"
>> Subject: Re: only one map
ly-To: "user@hive.apache.org"
> Date: Wednesday, August 21, 2013 10:43 AM
> To: "user@hive.apache.org"
> Subject: Re: only one mapper
>
> LZO files are only splittable if you index them. Sequence files
> compresses with LZO are splittable without being index
g>"
mailto:user@hive.apache.org>>
Subject: Re: only one mapper
LZO files are only splittable if you index them. Sequence files compresses with
LZO are splittable without being indexed.
Snappy + SequenceFile is a better option then LZO.
On Wed, Aug 21, 2013 at 1:39 PM, Igor Tatarin
Hi Edward,
Could yiu please explain this?
Snappy + SequenceFile is a better option then LZO.
Thanks,
Pandeeswaran
—
Sent from Mailbox for iPad
On Wed, Aug 21, 2013 at
LZO files are only splittable if you index them. Sequence files compresses
with LZO are splittable without being indexed.
Snappy + SequenceFile is a better option then LZO.
On Wed, Aug 21, 2013 at 1:39 PM, Igor Tatarinov wrote:
> LZO files are combinable so check your max split setting.
>
> ht
LZO files are combinable so check your max split setting.
http://mail-archives.apache.org/mod_mbox/hive-user/201107.mbox/%3c4e328964.7000...@gmail.com%3E
igor
decide.com
On Wed, Aug 21, 2013 at 2:17 AM, 闫昆 wrote:
> hi all when i use hive
> hive job make only one mapper actually my file split
