held, please excuse typos.
-Original Message-
From: Chalcy Raja
Date: Tue, 19 Jun 2012 01:32:52
To: user@hive.apache.org;
'bejoy...@yahoo.com'
Reply-To: user@hive.apache.org
Subject: RE: sqoop, hive and lzo and cdh3u3 - not creating in index
automatically
I did figure out how to compre
meta data. I'll try head
command and see what is going on.
Thanks,
Chalcy
-Original Message-
From: Bejoy KS [mailto:bejoy...@yahoo.com]
Sent: Tuesday, June 19, 2012 2:59 AM
To: user@hive.apache.org
Subject: Re: sqoop, hive and lzo and cdh3u3 - not creating in index
automatically
Raja
Date: Tue, 19 Jun 2012 01:32:52
To: user@hive.apache.org;
'bejoy...@yahoo.com'
Reply-To: user@hive.apache.org
Subject: RE: sqoop, hive and lzo and cdh3u3 - not creating in index
automatically
I did figure out how to compress data from an uncomressed data in hive table.
I also
-Original Message-
From: Chalcy Raja [mailto:chalcy.r...@careerbuilder.com]
Sent: Monday, June 18, 2012 3:28 PM
To: user@hive.apache.org; 'bejoy...@yahoo.com'
Subject: RE: sqoop, hive and lzo and cdh3u3 - not creating in index
automatically
Snappy with sequence file works well for
lcy.r...@careerbuilder.com]
Sent: Monday, June 18, 2012 1:47 PM
To: user@hive.apache.org; 'bejoy...@yahoo.com'
Subject: RE: sqoop, hive and lzo and cdh3u3 - not creating in index
automatically
It is there. I have io.compression.codecs in core-site.xml. There is not
error or warn in the sqoop to hi
...@yahoo.com]
Sent: Monday, June 18, 2012 10:39 AM
To: user@hive.apache.org
Subject: Re: sqoop, hive and lzo and cdh3u3 - not creating in index
automatically
Hi Chalcy
Lzo indexing not working, Is Lzo codec class available in
'io.compression.codec' property in core-site.xml?
Sna
m handheld, please excuse typos.
-Original Message-
From: Chalcy Raja
Date: Mon, 18 Jun 2012 14:31:36
To: user@hive.apache.org;
'bejoy...@yahoo.com'
Reply-To: user@hive.apache.org
Subject: RE: sqoop, hive and lzo and cdh3u3 - not creating in index
automatically
Hi Bejoy,
bejoy...@yahoo.com]
Sent: Monday, June 18, 2012 10:04 AM
To: user@hive.apache.org
Subject: Re: sqoop, hive and lzo and cdh3u3 - not creating in index
automatically
Hi Chalcy
Did you notice any warnings related to lzo codec on your mapreduce task logs or
on sqoop logs?
It could be because LZO
:32:01
To:
Reply-To: user@hive.apache.org
Subject: Re: sqoop, hive and lzo and cdh3u3 - not creating in index
automatically
Have you considered switching to sequence files using snappy
compression (or lzo). IIRC the process of generating LZO files and
then generating an index on top of these is
Have you considered switching to sequence files using snappy
compression (or lzo). IIRC the process of generating LZO files and
then generating an index on top of these is cumbersome. When sequence
files are directly splittable.
On Mon, Jun 18, 2012 at 9:16 AM, Chalcy Raja
wrote:
> I am posting i
I am posting it here first and then may be on sqoop user group as well.
I am trying to use lzo compression.
Tested on a standalone by installing cdh3u3 and did sqoop to hive import with
lzo compression and everything works great. The data is sqooped into hdfs and
lzo index file got created and
11 matches
Mail list logo
