Re: LZO compression implementation in Hive

2013-06-18 Thread Sanjay Subramanian
needs to grant me permission From: Sanjay Subramanian mailto:sanjay.subraman...@wizecommerce.com>> Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Date: Monday, June 17, 2013 11:50 PM To: "user@hive.apache.org&l

Re: LZO compression implementation in Hive

2013-06-18 Thread Lefty Leverenz
s://cwiki.apache.org/confluence<https://cwiki.apache.org/confluence/dashboard.action> > > thanks > sanjay > > > From: Lefty Leverenz > Reply-To: "user@hive.apache.org" > Date: Monday, June 17, 2013 7:08 PM > To: "user@hive.apache.org" > Subje

Re: LZO compression implementation in Hive

2013-06-17 Thread Sanjay Subramanian
17, 2013 11:50 PM To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Subject: Re: LZO compression implementation in Hive Sure…would love to add the LZO compression in Hive Is there a specific page structure u want me to add to in conf

Re: LZO compression implementation in Hive

2013-06-17 Thread Sanjay Subramanian
ly-To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Date: Monday, June 17, 2013 7:08 PM To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Subject: Re: LZO compression implementation

Re: LZO compression implementation in Hive

2013-06-17 Thread Lefty Leverenz
Perhaps you'd like to write up your insights in the Hive wiki, and others could add their insights. Then the information would be available to all, immediately. – Lefty On Mon, Jun 17, 2013 at 4:39 PM, Ramki Palle wrote: > Hi Sanjay, > > Can you quickly give your insights on thip topic, if p

Re: LZO compression implementation in Hive

2013-06-17 Thread Ramki Palle
Hi Sanjay, Can you quickly give your insights on thip topic, if possible? Regards, Ramki. On Mon, May 20, 2013 at 2:51 PM, Sanjay Subramanian < sanjay.subraman...@wizecommerce.com> wrote: > Hi Programming Hive Book authors > > Maybe a lot of u have already successfully implemented this but o

Re: Lzo Compression

2011-07-27 Thread Ankit Jain
I have used hadoop-0.20.2 version of hadoop. On Wed, Jul 27, 2011 at 1:29 PM, Koert Kuipers wrote: > i just tried your step 10 and 11 on my setup and it works. See my earlier > message about my setup. > > > On Wed, Jul 27, 2011 at 9:37 AM, Ankit Jain wrote: > >> Hi all, >> I tried to index the l

Re: Lzo Compression

2011-07-27 Thread Koert Kuipers
i just tried your step 10 and 11 on my setup and it works. See my earlier message about my setup. On Wed, Jul 27, 2011 at 9:37 AM, Ankit Jain wrote: > Hi all, > I tried to index the lzo file but got the following error while indexing > the lzo file : > > java.lang.ClassCastException: > com.hadoo

Re: Lzo Compression

2011-07-27 Thread Ankit Jain
Hi all, I tried to index the lzo file but got the following error while indexing the lzo file : java.lang.ClassCastException: com.hadoop.compression.lzo.LzopCodec$LzopDecompressor cannot be cast to com.hadoop.compression.lzo.LzopDecompressor I have performed following steps:- 1. $sudo apt-get in

Re: Lzo Compression

2011-07-26 Thread Koert Kuipers
my installation notes for lzo-hadoop (might be wrong or incomplete): we run centos 5.6 and cdh3 yum -y install lzo git checkout https://github.com/toddlipcon/hadoop-lzo.git cd hadoop-lzo ant cd build cp hadoop-lzo-0.4.10/hadoop-lzo-0.4.10.jar /usr/lib/hadoop/lib cp -r hadoop-lzo-0.4.10/lib/native

Re: Lzo Compression

2011-07-25 Thread Alejandro Abdelnur
Vikas, You should be able to use the Snappy codec doing some minor tweaks from http://code.google.com/p/hadoop-snappy/ until a Hadoop releases with Snappy support. Thxs. Alejandro. On Mon, Jul 25, 2011 at 4:04 AM, Vikas Srivastava wrote: > Hey , > > i just want to use any compression in hadoop

Re: Lzo Compression

2011-07-25 Thread Koert Kuipers
I have LZO compression enabled by default in hadoop 0.20.2 and hive 0.7.0 and it works well so far. On Mon, Jul 25, 2011 at 7:04 AM, Vikas Srivastava < vikas.srivast...@one97.net> wrote: > Hey , > > i just want to use any compression in hadoop so i heard about lzo which is > best among all the co

RE: Lzo compression on Hive table

2011-07-07 Thread Steven Wong
When writing, set hive.exec.compress.output=true also. When reading, nothing special needs to be done. -Original Message- From: jonathan.hw...@accenture.com [mailto:jonathan.hw...@accenture.com] Sent: Thursday, July 07, 2011 6:07 PM To: user@hive.apache.org Subject: Lzo compression on H

Re: Lzo compression on Hive table

2011-07-07 Thread Aaron Sun
You can use this one STORED AS INPUTFORMAT "com.hadoop.mapred.DeprecatedLzoTextInputFormat" OUTPUTFORMAT "org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat" On Thu, Jul 7, 2011 at 6:06 PM, wrote: > Hi there, > I got my hadoop all setup writing out sequence file with LZO compression. >