Unsubscribe
Sent from my BlackBerry® wireless handheld from Glo Mobile.
-Original Message-
From: Alexander Pivovarov
Date: Mon, 10 Jun 2013 11:37:30
To:
Reply-To: user@hive.apache.org
Subject: Re: Sequence file compression in Hive
Sachin, it works
SET hive.exec.compress.output=true
Sachin, it works
SET hive.exec.compress.output=true;
SET mapred.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec;
SET mapred.output.compression.type=BLOCK;
create table data1_seq STORED AS SEQUENCEFILE as select * from date1;
hadoop fs -cat /user/hive/warehouse/data1_seq/00_0
Sachin, it works
SET hive.exec.compress.output=true;
SET mapred.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec;
SET mapred.output.compression.type=BLOCK;
create table data1_seq STORED AS SEQUENCEFILE as select * from date1;
hadoop fs -cat /user/hive/warehouse/data1_seq/00_0
On Mon, Jun 10, 2013 at 12:48 AM, Sachin Sudarshana wrote:
what's the header of the first sequence file look like?
*$ dfs -cat
/user/hive/warehouse/facts_520.db/test3facts520_gzip_seq/00_0 | head
*
Hi,
I have a table stored as SEQUENCEFILE in hive-0.10,* facts520_normal_seq*
Now, i wish to create another table stored as a SEQUENCEFILE itself, but
compressed using the Gzip codec.
So, i set the compression codec and type as BLOCK and then executed the
following query:
*SET hive.exec.compres
Anyone have an idea on this?
Anyone using compression with sequence files successfully?
The wiki and Hadoop: the definitive guide suggest that the below is
correct so I am at a loss to explain what we are seeing.
Tom
On Fri, May 6, 2011 at 5:39 PM, Tom Hall wrote:
> I have read http://wiki.a
I have read http://wiki.apache.org/hadoop/Hive/CompressedStorage and
am trying to compress some of our tables. The only difference with the
eg is that we have partitioned our tables.
SET io.seqfile.compression.type=BLOCK;
SET hive.exec.compress.output=true;
SET mapred.output.compress=true;
insert
