mailto:d...@hive.apache.org>>
Subject: Re: Review Request (wikidoc): LZO Compression in Hive
Hi guys
Any chance I could get cwiki update privileges today ?
Thanks
sanjay
From: Sanjay Subramanian
mailto:sanjay.subraman...@wizecommerce.com>>
Date: Tuesday, July 30, 2013 4:26 PM
To: &q
ve.apache.org>>
Cc: "d...@hive.apache.org<mailto:d...@hive.apache.org>"
mailto:d...@hive.apache.org>>
Subject: Review Request (wikidoc): LZO Compression in Hive
Hi
Met with Lefty this afternoon and she was kind to spend time to add my
documentation to the site - since I still don&#x
Hi
Met with Lefty this afternoon and she was kind to spend time to add my
documentation to the site - since I still don't have editing privileges :-)
Please review the new wikidoc about LZO compression in the Hive language
manual. If anything is unclear or needs more information, you can email
rosoft.com>>
Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>"
mailto:user@hive.apache.org>>
Date: Monday, June 10, 2013 6:14 AM
To: "user@hive.apache.org<mailto:user@hive.apache.org>"
mailto:user@hive.apache.org>>
Subject: RE: Compress
Unsubscribe
Sent from my BlackBerry® wireless handheld from Glo Mobile.
-Original Message-
From: Alexander Pivovarov
Date: Mon, 10 Jun 2013 11:37:30
To:
Reply-To: user@hive.apache.org
Subject: Re: Sequence file compression in Hive
Sachin, it works
SET hive.exec.compress.output=true
Sachin, it works
SET hive.exec.compress.output=true;
SET mapred.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec;
SET mapred.output.compression.type=BLOCK;
create table data1_seq STORED AS SEQUENCEFILE as select * from date1;
hadoop fs -cat /user/hive/warehouse/data1_seq/00_0
Sachin, it works
SET hive.exec.compress.output=true;
SET mapred.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec;
SET mapred.output.compression.type=BLOCK;
create table data1_seq STORED AS SEQUENCEFILE as select * from date1;
hadoop fs -cat /user/hive/warehouse/data1_seq/00_0
On Mon, Jun 10, 2013 at 12:48 AM, Sachin Sudarshana wrote:
what's the header of the first sequence file look like?
*$ dfs -cat
/user/hive/warehouse/facts_520.db/test3facts520_gzip_seq/00_0 | head
*
the data size the more the gain.
Thanks.
From: Sachin Sudarshana [mailto:sachin.had...@gmail.com]
Sent: Sunday, June 9, 2013 11:04 PM
To: user@hive.apache.org
Subject: Compression in Hive
Hi,
I have been testing the usefulness of compression in Hive. I have a general
question,
I would like to
Hi,
I have a table stored as SEQUENCEFILE in hive-0.10,* facts520_normal_seq*
Now, i wish to create another table stored as a SEQUENCEFILE itself, but
compressed using the Gzip codec.
So, i set the compression codec and type as BLOCK and then executed the
following query:
*SET hive.exec.compres
Hi,
I have been testing the usefulness of compression in Hive. I have a general
question,
I would like to know if there are any particular cases where compression in
hive can actually prove useful while running any MR jobs.
Any pointers/examples would really be useful!
Thank you,
Sachin
Hi,
I was testing Compression in Hive using different file formats.
I have a table stored as a sequence file ,* facts_normal_seq*.
Now I wish to create another table *facts_snappy_seq *by using Snappy
compression codec.
Is this the correct way to do this:
*CREATE TABLE facts_snappy_seq
Hi Abhishek -
(Redirecting to user@hive, bcc'ing common-user)
I found this blog to be particularly useful when incorporating Hive and LZO:
http://www.mrbalky.com/2011/02/24/hive-tables-partitions-and-lzo-compression/
And if you're having issues setting up LZO with Hadoop in general, check out
13 matches
Mail list logo
