Re: does the HBase-Hive integration support using HBase index (primary key or secondary index) in the JOIN implementatoin?

2014-07-24 Thread Juan Martin Pampliega
the patch included is out of > date with trunk. Perhaps it's worth resurrecting? > > Andrew > > On 7/24/14, 4:45 PM, java8964 wrote: > > I don't think Hbase-Hive integration part is that smart, be able to > utilize the index existing in the HBase. But I think it de

Re: does the HBase-Hive integration support using HBase index (primary key or secondary index) in the JOIN implementatoin?

2014-07-24 Thread Andrew Mains
is out of date with trunk. Perhaps it's worth resurrecting? Andrew On 7/24/14, 4:45 PM, java8964 wrote: I don't think Hbase-Hive integration part is that smart, be able to utilize the index existing in the HBase. But I think it depends on the version you are using. From my experie

RE: does the HBase-Hive integration support using HBase index (primary key or secondary index) in the JOIN implementatoin?

2014-07-24 Thread java8964
I don't think Hbase-Hive integration part is that smart, be able to utilize the index existing in the HBase. But I think it depends on the version you are using. >From my experience, there are a lot of improvement space in the Hbase-hive >integration, especially "push down&q

Re: does the HBase-Hive integration support using HBase index (primary key or secondary index) in the JOIN implementatoin?

2014-07-24 Thread Yang
kind of found this http://hortonworks.com/blog/hbase-via-hive-part-1/ " >From a performance perspective, there are things Hive can do today (ie, not dependent on data types) to take advantage of HBase. There’s also the possibility of an HBase-aware Hive to make use of HBase tables as intermediate

does the HBase-Hive integration support using HBase index (primary key or secondary index) in the JOIN implementatoin?

2014-07-24 Thread Yang
if I do a join of a table based on txt file and a table based on HBase, and say the latter is very large, is HIVE smart enough to utilize the HBase table's index to do the join, instead of implementing this as a regular map reduce job, where each table is scanned fully, bucketed on join keys, and t

Re: HBase- Hive Integration

2014-03-14 Thread Nick Dimiduk
hbase-dev to bcc; adding hive-user. this is a question for the user lists, and more for Hive's than HBase, as HBaseStorageHandler is code in Hive project, not HBase. Hi Sai, You are embarking into a brave world. Because your aim is the interop across these different Apache projects, I highly reco

Re: HBase-Hive integration - fetching long values in HBase as bigint in Hive

2013-02-14 Thread Ashish Nigam
It worked... I was missing this in SERDE properties - "hbase.table.default.storage.type" = "binary" On Thu, Feb 14, 2013 at 9:02 AM, Ashish Nigam wrote: > Columns in "stats-daily" CF are dynamic in nature but all the values are > long counters. > I also tried with a table that has only one co

Re: HBase-Hive integration - fetching long values in HBase as bigint in Hive

2013-02-14 Thread Ashish Nigam
Columns in "stats-daily" CF are dynamic in nature but all the values are long counters. I also tried with a table that has only one column mapped. That also is returning NULL. So the issue does not seem to be different value types in a column family. On Thu, Feb 14, 2013 at 6:51 AM, kulkarni.swa

Re: Composite Key Handling in Hbase + Hive Integration

2012-07-24 Thread ankit kinra
composite > key are separated by a "~". After doing this, to GROUP BY any key in your > composite key, you simply run a query like: > > select * from hbase_table_2 GROUP BY key.a; > > This should give you your desired result. > > Let me know if this works for you. We

Re: Composite Key Handling in Hbase + Hive Integration

2012-07-24 Thread kulkarni.swar...@gmail.com
to GROUP BY any key in your composite key, you simply run a query like: select * from hbase_table_2 GROUP BY key.a; This should give you your desired result. Let me know if this works for you. We can then add this as a workaround on that bug. On Tue, Jul 24, 2012 at 2:14 AM, ankit kinra wrote

Re: Composite Key Handling in Hbase + Hive Integration

2012-07-24 Thread Bejoy Ks
r(key,'~')-1); Regards Bejoy KS From: ankit kinra To: user@hive.apache.org Sent: Tuesday, July 24, 2012 12:44 PM Subject: Composite Key Handling in Hbase + Hive Integration Hi, I have a use case in HBase + Hive Integration where HBase primary

Composite Key Handling in Hbase + Hive Integration

2012-07-24 Thread ankit kinra
Hi, I have a use case in HBase + Hive Integration where HBase primary key is a composite key and the keys is separated by us with a custom delimiter. So basically it is Key = A~B~C. Now, I wanted to run a query on this HBase table using Hive and group by "A" (and not the complete prima

Re: HBase-Hive integration production ready?

2011-03-30 Thread Jean-Daniel Cryans
r specific need that I'll have to redo properly it in order to submit it. J-D On Mon, Mar 28, 2011 at 8:03 PM, Otis Gospodnetic wrote: > Hi, > > We are looking at the NNN TB HBase cluster (owned by a client) and are > considering HBase-Hive integration. > > Before we go there

HBase-Hive integration production ready?

2011-03-28 Thread Otis Gospodnetic
Hi, We are looking at the NNN TB HBase cluster (owned by a client) and are considering HBase-Hive integration. Before we go there, we are wondering if this integration is successfully used by anyone in non-trivial production environment? Any feedback would be greatly appreciated. Thanks