Loading data in Hive 0.11 - permission issue

2013-08-05 Thread Sachin Sudarshana
Hi, I'm using Hive 0.11, downloaded the tarball from Apache's website. I have a Linux user called *admin * and i invoke the hive CLI using this user. In the hive terminal I created a table as follows: *hive> create table ptest (pkey INT, skey INT, fkey INT, rkey INT, units INT) row format delim

Sequence file compression in Hive

2013-06-10 Thread Sachin Sudarshana
Hi, I have a table stored as SEQUENCEFILE in hive-0.10,* facts520_normal_seq* Now, i wish to create another table stored as a SEQUENCEFILE itself, but compressed using the Gzip codec. So, i set the compression codec and type as BLOCK and then executed the following query: *SET hive.exec.compres

Compression in Hive

2013-06-09 Thread Sachin Sudarshana
Hi, I have been testing the usefulness of compression in Hive. I have a general question, I would like to know if there are any particular cases where compression in hive can actually prove useful while running any MR jobs. Any pointers/examples would really be useful! Thank you, Sachin

Compression in Hive using different file formats

2013-06-09 Thread Sachin Sudarshana
Hi, I was testing Compression in Hive using different file formats. I have a table stored as a sequence file ,* facts_normal_seq*. Now I wish to create another table *facts_snappy_seq *by using Snappy compression codec. Is this the correct way to do this: *CREATE TABLE facts_snappy_seq ( , ..

Re: Textfile compression using Gzip codec

2013-06-06 Thread Sachin Sudarshana
east the problem is now identified. > > Now _my guess_ is that maybe your hadoop core-site.xml file might need to > list the codecs available under the property name: > "io.compression.codecs". Can you chase that up as a possibility and let us > know what you find out? > > &

Re: Textfile compression using Gzip codec

2013-06-06 Thread Sachin Sudarshana
well... the hiveException has the word "metadata" in it. maybe that's a > hint or a red-herrring. :)Let's try the following: > > 1. show create table * facts520_normal_text; > > * > *2. anything useful at this URL? ** > http://aana1.ird.com:50030/ta

Textfile compression using Gzip codec

2013-06-05 Thread Sachin Sudarshana
Hi, I have hive 0.10 + (CDH 4.2.1 patches) installed on my cluster. I have a table facts520_normal_text stored as a textfile. I'm trying to create a compressed table from this table using GZip codec. *hive> SET hive.exec.compress.output=true;* *hive> SET mapred.output.compression.codec=org.apach

Re: io.compression.codecs not found

2013-05-23 Thread Sachin Sudarshana
t; Sent from remote device, Please excuse typos > -- > *From: * Sachin Sudarshana > *Date: *Thu, 23 May 2013 19:46:37 +0530 > *To: * > *ReplyTo: * user@hive.apache.org > *Subject: *Re: io.compression.codecs not found > > Hi, > > I'm not

Re: io.compression.codecs not found

2013-05-23 Thread Sachin Sudarshana
ng me I will tell u how to set it there. Out of the > box hive works beautifully with gzip and snappy. And if u r using lzo then > needs some plumbing. Depends on what ur usecase is I can provide guidance. > > Regards > Sanjay > > Sent from my iPhone > > On May 23, 20

io.compression.codecs not found

2013-05-23 Thread Sachin Sudarshana
Hi, I'm trying to run some queries on compressed tables in Hive 0.10. I wish to know what all compression codecs are available which i can make use of. However, when i run set io.compression.codecs in the hive CLI, it throws an error saying the io.compression.codecs is not found. I'm unable to fi

Re: Finding maximum across a row

2013-03-01 Thread Sachin Sudarshana
ng > a custom UDF. > Regards > Bejoy KS > > Sent from remote device, Please excuse typos > ---------- > *From: * Sachin Sudarshana > *Date: *Fri, 1 Mar 2013 22:16:37 +0530 > *To: * > *ReplyTo: * user@hive.apache.org > *Subject: *Finding maximum across

Finding maximum across a row

2013-03-01 Thread Sachin Sudarshana
Regards, Sachin Sudarshana

Request to add me onto the list

2013-03-01 Thread Sachin Sudarshana
Hi, I request you to kindly add me onto this list. -- Thanks and Regards, Sachin Sudarshana

Re: Security for Hive

2013-02-22 Thread Sachin Sudarshana
les, grant privileges etc. Thank you. On Fri, Feb 22, 2013 at 4:19 PM, Jagat Singh wrote: > You might want to read this > > https://cwiki.apache.org/Hive/languagemanual-auth.html > > > > > On Fri, Feb 22, 2013 at 9:44 PM, Sachin Sudarshana < > sachin.sudarsh...@gmai