Re: HBase- Hive Integration

2014-03-24 Thread Rayees
gt; > > > The person that says it cannot be done should not interrupt the person > > doing it. > > > > -Original Message----- > > From: Tapper, Gunnar > > Sent: Thursday, March 13, 2014 8:28 PM > > To: user@hbase.apache.org > > Subject:

Re: HBase- Hive Integration

2014-03-24 Thread Asaf Mesika
; > The person that says it cannot be done should not interrupt the person > doing it. > > -Original Message- > From: Tapper, Gunnar > Sent: Thursday, March 13, 2014 8:28 PM > To: user@hbase.apache.org > Subject: RE: HBase- Hive Integration > > 0.94 AFAIK.

RE: HBase- Hive Integration

2014-03-18 Thread Tapper, Gunnar
> From: Tapper, Gunnar > Sent: Thursday, March 13, 2014 8:28 PM > To: user@hbase.apache.org > Subject: RE: HBase- Hive Integration > > 0.94 AFAIK. I'll ask one of the people working on Trafodion to provide > more info. Stay tuned. > > Sincerely, > > Gunnar > >

Re: HBase- Hive Integration

2014-03-18 Thread Jean-Marc Spaggiari
Thursday, March 13, 2014 8:28 PM > To: user@hbase.apache.org > Subject: RE: HBase- Hive Integration > > 0.94 AFAIK. I'll ask one of the people working on Trafodion to provide > more info. Stay tuned. > > Sincerely, > > Gunnar > > “People don’t know what

RE: HBase- Hive Integration

2014-03-18 Thread Tapper, Gunnar
PM To: user@hbase.apache.org Subject: RE: HBase- Hive Integration 0.94 AFAIK. I'll ask one of the people working on Trafodion to provide more info. Stay tuned. Sincerely, Gunnar “People don’t know what they want until you show it to them… Our task is to read things that are not yet o

Re: HBase- Hive Integration

2014-03-16 Thread Sai Pavan Gadde
Hi all, Thank you for replies, Looking for more suggestions -- *THANKS & REGARDS,* G.SAI PAVAN, CCDH4 CERTIFIED, Ph: 8121914494, *www.bigdatatrendz.com * linkedin profile HYDERABAD. On Fri, Mar 14, 2014 at

Re: HBase- Hive Integration

2014-03-14 Thread Nick Dimiduk
hbase-dev to bcc; adding hive-user. this is a question for the user lists, and more for Hive's than HBase, as HBaseStorageHandler is code in Hive project, not HBase. Hi Sai, You are embarking into a brave world. Because your aim is the interop across these different Apache projects, I highly reco

Re: HBase- Hive Integration

2014-03-13 Thread Sai Pavan Gadde
Hi, Here is my document in an attached file. It contains my flow of hive-hbase integration. 1. I created a table in mysql and imported into hbase, 2. I copied a hive-handler.jar, guva.jar and zookeeper.jar file in Hadoop-2.2.0/share/mapred/lib folder 3. copied required hive(0.11.0) jars to hbase(0

RE: HBase- Hive Integration

2014-03-13 Thread Tapper, Gunnar
-Marc Spaggiari [mailto:jean-m...@spaggiari.org] Sent: Thursday, March 13, 2014 7:55 PM To: user Subject: Re: HBase- Hive Integration Oh, nice! Do you know where we can download the source? I will try to take a look at it and see with which HBase versions it works. Thanks for sharing the info. JM

Re: HBase- Hive Integration

2014-03-13 Thread Jean-Marc Spaggiari
things that are not yet on the page.” — Steve Jobs > > > > > -Original Message- > From: Jean-Marc Spaggiari [mailto:jean-m...@spaggiari.org] > Sent: Thursday, March 13, 2014 6:59 PM > To: user > Subject: Re: HBase- Hive Integration > > Is Trafodion w

RE: HBase- Hive Integration

2014-03-13 Thread Tapper, Gunnar
it to them… Our task is to read things that are not yet on the page.” — Steve Jobs -Original Message- From: Jean-Marc Spaggiari [mailto:jean-m...@spaggiari.org] Sent: Thursday, March 13, 2014 6:59 PM To: user Subject: Re: HBase- Hive Integration Is Trafodion working on top of HBase

Re: HBase- Hive Integration

2014-03-13 Thread Jean-Marc Spaggiari
; From: Jean-Marc Spaggiari [mailto:jean-m...@spaggiari.org] > Sent: Thursday, March 13, 2014 9:36 AM > To: user > Subject: Re: HBase- Hive Integration > > If you want to run SQL queries on top of HBase table, I will expect > Phoenix to do better than Hive... > > > 2014-03-13 9:42

RE: HBase- Hive Integration

2014-03-13 Thread Tapper, Gunnar
Or, try out Trafodion: http://www.hpl.hp.com/research/trafodion.htm Sincerely, Gunnar -Original Message- From: Jean-Marc Spaggiari [mailto:jean-m...@spaggiari.org] Sent: Thursday, March 13, 2014 9:36 AM To: user Subject: Re: HBase- Hive Integration If you want to run SQL queries on

Re: HBase- Hive Integration

2014-03-13 Thread Jean-Marc Spaggiari
If you want to run SQL queries on top of HBase table, I will expect Phoenix to do better than Hive... 2014-03-13 9:42 GMT-04:00 kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com>: > Hi Sai, > > If you can show us what specific exception you are seeing, we would be able > to help you out in

Re: HBase- Hive Integration

2014-03-13 Thread kulkarni.swar...@gmail.com
Hi Sai, If you can show us what specific exception you are seeing, we would be able to help you out in a better way. Thanks, On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde wrote: > Hi, > Thanks for reply... but > > I worked with hadoop-1.2.1 which is fine working, but need with real > requir

Re: HBase- Hive Integration

2014-03-13 Thread Sai Pavan Gadde
Hi, Thanks for reply... but I worked with hadoop-1.2.1 which is fine working, but need with real requirement is Hadoop-2.2.0 i.e, YARN Please show the way to get solve with apache products I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed hive-0.11.0 too, Copied hive-hbase-ha

Re: HBase- Hive Integration

2014-03-13 Thread Joshi, Rekha
Hi, We have successfully created external hive table pointing to hbase table with settings for hive, zookeeper, HBase security tokens. If it is a jar problem, then mostly the env is not set correctly.Hive should be able to recognize HBaseStorageHandler. Thanks Rekha http://hortonworks.com/blog/

HBase- Hive Integration

2014-03-12 Thread Sai Pavan Gadde
Hi, I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0 version for a project. I got a requirement such that i have to integrate hbase to hive , so that table reflection should happens. while i am doing this, i got error like TARGET INNOVOCATION EXCEPTION. This is because jar file t

Re: HBase-Hive integration performance issues

2013-08-27 Thread Hao Ren
Matt, Thank you for the lightning reply. I will try out what you have mentioned in these days, thus I could tell you some news on the issue in detail. Thank you again. Your suggestions show me the way. =) Hao Le 27/08/2013 16:13, Matt Davies a écrit : Hao, A couple thoughts here. This co

Re: HBase-Hive integration performance issues

2013-08-27 Thread Matt Davies
Hao, A couple thoughts here. This could be related to many things. 1. Did you pre-split your regions? If not, you could be hot-spotting on a single server and then waiting for the region to split. If that is the case, you could actually only be using a single server for much of your load (if not

HBase-Hive integration performance issues

2013-08-27 Thread Hao Ren
Hi, I am running Hive and HBase on Amazon EC2. By following the tutorial: https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration , I managed to create a HBase table from Hive and insert data into it. It works but with a low performance. To be specific, inserting 1.3 Gb (50 M rows,

Re: Hbase-Hive integration performance issues

2011-10-03 Thread Matthew Tovbin
ilto:apurt...@apache.org] > > Sent: Friday, September 30, 2011 09:50 > > To: d...@hbase.apache.org; HBase User > > Subject: Re: Hbase-Hive integration performance issues > > > > I believe this is the latest status: > > > > https://issues.apache.org/jira/b

RE: Hbase-Hive integration performance issues

2011-10-03 Thread Sandy Pratt
if it doesn't please let me know ;) ). Sandy > -Original Message- > From: Andrew Purtell [mailto:apurt...@apache.org] > Sent: Friday, September 30, 2011 09:50 > To: d...@hbase.apache.org; HBase User > Subject: Re: Hbase-Hive integration performance issues > > I bel

Re: Hbase-Hive integration performance issues

2011-09-30 Thread Andrew Purtell
worth by hitting back. - Piet Hein (via Tom White) > >From: Matthew Tovbin >To: HBase User >Cc: Hbase Dev >Sent: Friday, September 30, 2011 5:49 AM >Subject: Re: Hbase-Hive integration performance issues > >Hello guys, > >An

Re: Hbase-Hive integration performance issues

2011-09-30 Thread Matthew Tovbin
know if that's even planned. >> >> Sandy >> >> > -Original Message- >> > From: jdcry...@gmail.com [mailto:jdcry...@gmail.com] On Behalf Of Jean- >> > Daniel Cryans >> > Sent: Monday, September 19, 2011 09:58 >> > To: use

Re: Hbase-Hive integration performance issues

2011-09-19 Thread Matthew Tovbin
ans to particular HBase > version ranges, but I don't know if that's even planned. > > Sandy > > > -Original Message- > > From: jdcry...@gmail.com [mailto:jdcry...@gmail.com] On Behalf Of Jean- > > Daniel Cryans > > Sent: Monday, September 19, 201

RE: Hbase-Hive integration performance issues

2011-09-19 Thread Sandy Pratt
--Original Message- > From: jdcry...@gmail.com [mailto:jdcry...@gmail.com] On Behalf Of Jean- > Daniel Cryans > Sent: Monday, September 19, 2011 09:58 > To: user@hbase.apache.org > Subject: Re: Hbase-Hive integration performance issues > > (replying to user@, dev@ in BCC) &g

Re: Hbase-Hive integration performance issues

2011-09-19 Thread Jean-Daniel Cryans
(replying to user@, dev@ in BCC) AFAIK the HBase handler doesn't have the wits to understand that you are doing a prefix scan and thus limit the scan to only the required rows. There's a bunch of optimizations like that that need to be done. I'm pretty sure Pig does the same thing, but don't take

Hbase-Hive integration performance issues

2011-09-18 Thread Matthew Tovbin
Hi guys, I've got a table in Hbase let's say "tbl" and I would like to query it using Hive. Therefore I mapped a table to hive as follows: CREATE EXTERNAL TABLE tbl(id string, data map) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":

Hbase-Hive integration performance issues

2011-09-18 Thread Matthew Tovbin
Hi guys, I've got a table in Hbase let's say "tbl" and I would like to query it using Hive. Therefore I mapped a table to hive as follows: CREATE EXTERNAL TABLE tbl(id string, data map) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":