These are the default, add snappy as well along <property> <name>io.compression.codecs</name> <value>org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec</value> </property>
Regards Bejoy KS Sent from remote device, Please excuse typos -----Original Message----- From: Sachin Sudarshana <sachin.had...@gmail.com> Date: Thu, 23 May 2013 20:01:17 To: <user@hive.apache.org>; <bejoy...@yahoo.com> Reply-To: user@hive.apache.org Subject: Re: io.compression.codecs not found Hi Bejoy, Thanks for the reply. I would like to know "what" are the codecs that are available by default in the Hadoop system, among which i can choose to set in the core-site.xml. For ex: LZO compression codecs are not available by default and we have to install the required libraries for it. Thank you, Sachin On Thu, May 23, 2013 at 7:55 PM, <bejoy...@yahoo.com> wrote: > ** > Go to $HADOOP_HOME/config open and edit core-site.xml > > Add a new property 'io.compression.codecs' and assign the required > compression codecs as its value. > Regards > Bejoy KS > > Sent from remote device, Please excuse typos > ------------------------------ > *From: * Sachin Sudarshana <sachin.had...@gmail.com> > *Date: *Thu, 23 May 2013 19:46:37 +0530 > *To: *<user@hive.apache.org> > *ReplyTo: * user@hive.apache.org > *Subject: *Re: io.compression.codecs not found > > Hi, > > I'm not using CM. I have installed CDH 4.2.1 using Linux packages. > > Thank you, > Sachin > > > On Thu, May 23, 2013 at 7:13 PM, Sanjay Subramanian < > sanjay.subraman...@wizecommerce.com> wrote: > >> This property needs to be set in core-site.xml. If u r using >> clouderamanager then ping me I will tell u how to set it there. Out of the >> box hive works beautifully with gzip and snappy. And if u r using lzo then >> needs some plumbing. Depends on what ur usecase is I can provide guidance. >> >> Regards >> Sanjay >> >> Sent from my iPhone >> >> On May 23, 2013, at 3:33 AM, "Sachin Sudarshana" <sachin.had...@gmail.com> >> wrote: >> >> > Hi, >> > >> > I'm trying to run some queries on compressed tables in Hive 0.10. I >> wish to know what all compression codecs are available which i can make use >> of. >> > However, when i run set io.compression.codecs in the hive CLI, it >> throws an error saying the io.compression.codecs is not found. >> > >> > I'm unable to figure out why its happening. Has it (the hiveconf >> property) been removed from 0.10? >> > >> > Any help is greatly appreciated! >> > >> > Thank you, >> > Sachin >> > >> >> CONFIDENTIALITY NOTICE >> ====================== >> This email message and any attachments are for the exclusive use of the >> intended recipient(s) and may contain confidential and privileged >> information. Any unauthorized review, use, disclosure or distribution is >> prohibited. If you are not the intended recipient, please contact the >> sender by reply email and destroy all copies of the original message along >> with any attachments, from your computer system. If you are the intended >> recipient, please be advised that the content of this message is subject to >> access, review and disclosure by the sender's Email System Administrator. >> >> >
