Attempt to archive a partition in hive fails

2014-03-19 Thread Rupinder Singh
Hi, I am trying to archive a partition in a hive table, but it keeps failing. Env: Hadoop 2.2.0, Amazon EMR, Hive 0.11.0 The sequence of commands in hive is here: hive> set hive.archive.enabled=true; hive> set hive.archive.har.parentdir.settable=true; hive> set har.partfile.size=1073741824; hive>

RE: NoClassDefFoundError when creating a custom hive UDF

2013-07-02 Thread Rupinder Singh
implemented it successfully? Thanks Rupinder From: Rupinder Singh [mailto:rsi...@care.com] Sent: Tuesday, July 02, 2013 10:40 AM To: user@hive.apache.org Subject: NoClassDefFoundError when creating a custom hive UDF Hi, I have created a custom Hive UDF that has external JAR dependencies. I have added

NoClassDefFoundError when creating a custom hive UDF

2013-07-01 Thread Rupinder Singh
Hi, I have created a custom Hive UDF that has external JAR dependencies. I have added those jars to the Hive session using 'add jar' but when I try to create my function, I get a NoClassDefFoundError on the dependency class. I am on Hive 0.81 running in Amazon EMR. This is what happens when I t

Wrong values returned for nullable columns in hbase tables when accessed via hive

2013-06-13 Thread Rupinder Singh
Hi all, I am facing an issue when selecting a nullable column twice in a hive select statement against an hbase table. For rows where that column is null, 2 different values are returned: one null (correct) and the second is the last non-null value. Has anyone seen this issue? The query: hive>

RE: Very poor read performance with composite keys in hbase

2013-04-30 Thread Rupinder Singh
out 8x slower on an average. So I went ahead with hive only option. Sent from my iPhone On Apr 30, 2013, at 11:19 PM, "Rupinder Singh" mailto:rsi...@care.com>> wrote: Hi, I have an hbase cluster where I have a table with a composite key. I map this table to a Hive external tabl

RE: Very poor read performance with composite keys in hbase

2013-04-30 Thread Rupinder Singh
To: user@hive.apache.org Cc: u...@hbase.apache.org Subject: Re: Very poor read performance with composite keys in hbase Can you show your query that is taking 700 seconds? On Tue, Apr 30, 2013 at 12:48 PM, Rupinder Singh mailto:rsi...@care.com>> wrote: Hi, I have an hbase cluster where I

Very poor read performance with composite keys in hbase

2013-04-30 Thread Rupinder Singh
Hi, I have an hbase cluster where I have a table with a composite key. I map this table to a Hive external table using which I insert/select data into/from this table: CREATE EXTERNAL TABLE event(key struct, {more columns here}) ROW FORMAT DELIMITED COLLECTION ITEMS TERMINATED BY '~' STORED BY

Select queries on hbase table with composite key return wrong number of rows

2013-03-19 Thread Rupinder Singh
I have an hbase table created as follows: create 'event', {NAME => 'm', VERSIONS => 1}, {NAME => 'e', VERSIONS => 1} I have a hive table mapped to the hbase table defined as follows: CREATE EXTERNAL TABLE h_event(key struct, dummy string, dummy2 string) ROW FORMAT DELIMITED COLLECTION ITEMS TERM