Re: Can't drop table

2014-06-10 Thread Nitin Pawar
if you have added a table with a serde definition then just keep the jar in local filesystem and then in hive console do add jar ; this should make your serde available to table and you should be able to drop the table then. I just tried above steps and it works for my json based tables. On We

Loading xml to hive and fetching unbounded tags

2014-06-10 Thread harish tangella
Hi, Request you to help. Fetching unbounded tags from the xml in hive We tried with xpath but unable to get all the unbounded tags. a sample xml file is 1 1 2 we are able to get the application code by giving [1] in appdetail. Request for help to get all the appdetail tags.

Re: How to extract multi-match in one line with regexp_extract function?

2014-06-10 Thread Andre Araujo
Unfortunately, regexp_extract only works with a single index. If the fields in your line are delimited by some specific character, just use the split function. If not, you can use a combination of regexp_replace and split, like the example below: select split(regexp_replace('World Cup 2014', '(.*

Re: Hive 0.13 Metastore => MySQL BoneCP issue

2014-06-10 Thread Soam Acharya
Hi Vaibhav, good question. We're using 0.8.0 RELEASE. Would 0.7.1 be preferable instead? Thanks! Soam On Tue, Jun 10, 2014 at 8:00 PM, Vaibhav Gumashta wrote: > Soam, > > What version of BoneCP are you using? > > Thanks, > --Vaibhav > > > On Tue, Jun 10, 2014 at 12:41 PM, Soam Acharya wrote

Can't drop table

2014-06-10 Thread Keith Wiley
I tried to create a table that would use a csv serde. There were various problems with it, primarily in that I couldn't figure out how to specify the path to the serde (whether I indicate the serde location either locally or on HDFS) there were subsequent errors about not finding the serde, eve

Re: Hive 0.13 Metastore => MySQL BoneCP issue

2014-06-10 Thread Vaibhav Gumashta
Soam, What version of BoneCP are you using? Thanks, --Vaibhav On Tue, Jun 10, 2014 at 12:41 PM, Soam Acharya wrote: > Hi folks, > > we're seeing an intermittent issue between our Hive 0.13 metastore and > mysql instance. After being idle for about 5 minutes or so, any > transactions involving

Hive 0.13 Metastore => MySQL BoneCP issue

2014-06-10 Thread Soam Acharya
Hi folks, we're seeing an intermittent issue between our Hive 0.13 metastore and mysql instance. After being idle for about 5 minutes or so, any transactions involving the metastore and mysql causes the following error to appear in the metastore log: 2014-06-09 05:13:52,066 ERROR bonecp.Connectio

RE: Efficient Equality Joins of Large Tables

2014-06-10 Thread java8964
I agree that the originally request is not very clear. >From my understanding, the reference_id is very unique in both Ad load and Ad >click tables, but both tables could contain huge amount of data. (But in >theory, click table should be much smaller than the load table, right? But >let's just

Dereferencing UNIONTYPE fields

2014-06-10 Thread Jamie Thomson - Contractor
Hi, First time poster here… I am using UNIONTYPE field in a Hive table: , Attributes UNIONTYPE, STRING> Here’s a slither of data from that column: Attributes - {0:{“relevance”:”1.1″}} {0:{“relevance”:”1.2″}} {0:{“relevance”:”1.3″}} {0:{“relevance”:”1.4″}} {0:{“relevance”:”1.5″}} How

How to extract multi-match in one line with regexp_extract function?

2014-06-10 Thread Matouk IFTISSEN
Hello, I have a table that each record is in one line (line), and I want to extract all patterns those match in each line, the actuel comportement of the udf regexp_extract returns one occurence match!! but with regexp_replace the comportement is différent (replace all pattern match in line) h

Re: Efficient Equality Joins of Large Tables

2014-06-10 Thread Furcy Pin
Hi Mark, I still don't understand if you are trying to perform your join for one specific known reference_id or for all of them? In the first case, you should apply a pre-filter on each table first with subqueries, and this would leave you with only a few rows for the join. In the second case, yo