Re: multiple users for hive access

2015-07-07 Thread Jeff Zhang
Have you tried to start hive cli using these 2 users ? What issue did you see ? On Wed, Jul 8, 2015 at 11:50 AM, Jack Yang wrote: > Thanks, mate. I have mysql run as my metadata store. > > > > What is the next step? when I start hive (0.13 version), I just type in > hive in my command line. > >

RE: multiple users for hive access

2015-07-07 Thread Jack Yang
Thanks, mate. I have mysql run as my metadata store. What is the next step? when I start hive (0.13 version), I just type in hive in my command line. Now, that is say I have two users: A and B. I would like A and B access hive tables using hive-cli. How can I do that? From: Jeff Zhang [mail

Re: Hive Tez support matrix

2015-07-07 Thread Jim Green
Thanks Vikram. That looks great. On Tue, Jul 7, 2015 at 4:27 PM, Vikram Dixit wrote: > Hi Jim, > > I just created a page with the matrix of supported releases. > > https://cwiki.apache.org/confluence/display/Hive/Hive-tez+compatibility > > Although pom is a source of truth, we also work wit

Re: Hive Tez support matrix

2015-07-07 Thread Vikram Dixit
Hi Jim, I just created a page with the matrix of supported releases. https://cwiki.apache.org/confluence/display/Hive/Hive-tez+compatibility Although pom is a source of truth, we also work with versions of tez where there have been no API changes (compared to the version in the pom). Yes, 1.2

RE: Limiting outer join

2015-07-07 Thread Bennie Leo
It went from about 60 mins to 3 mins. Hive was traversing the whole table multiple times, which is obviously inefficient! > Date: Tue, 7 Jul 2015 15:55:19 -0700 > Subject: Re: Limiting outer join > From: gop...@apache.org > To: user@hive.apache.org > > > > Never mind, I got it working with UDF

Re: Limiting outer join

2015-07-07 Thread Gopal Vijayaraghavan
> Never mind, I got it working with UDF. I just pass the file location to >my evaluate function. Thanks! :) Nice. Would be very interested in looking at performance of such a UDF, if you have numbers before/after. I suspect it will be a magnitude or more faster than the BETWEEN/JOIN clauses. Ch

RE: Hive Tez support matrix

2015-07-07 Thread Bikas Saha
I don’t think hive has documentation for that. The source of truth is probably the release pom.xml ☺ Bikas From: Jim Green [mailto:openkbi...@gmail.com] Sent: Tuesday, July 07, 2015 2:58 PM To: user@hive.apache.org Cc: u...@tez.apache.org Subject: Re: Hive Tez support matrix Do you know where i

Re: Hive Tez support matrix

2015-07-07 Thread Jim Green
Do you know where is the hive documentation about it? Or do you mean it will be added? I saw many issues are in Hive code, and fixed in Hive 1.2 version. BTW, which combination of hive/tez is the most stable one? My assumption is Hive 1.2+Tez 0.7. Am I right? On Tue, Jul 7, 2015 at 1:17 PM, Bikas

RE: Limiting outer join

2015-07-07 Thread Bennie Leo
Never mind, I got it working with UDF. I just pass the file location to my evaluate function. Thanks! :) From: tben...@hotmail.com To: user@hive.apache.org Subject: RE: Limiting outer join Date: Tue, 7 Jul 2015 09:59:22 -0700 Thanks for your replies. I see how extracting the first country

RE: Hive Tez support matrix

2015-07-07 Thread Bikas Saha
That would be in the hive documentation because it’s the dependent project and determines its compatibility with downstream projects like Tez. From: Jim Green [mailto:openkbi...@gmail.com] Sent: Tuesday, July 07, 2015 10:38 AM To: u...@tez.apache.org Cc: user@hive.apache.org Subject: Re: Hive Tez

Re: Hive Tez support matrix

2015-07-07 Thread Jim Green
Thanks Hitesh. Should we put a support matrix on Documentation?Or maybe I missed it if it is already there? On Tue, Jul 7, 2015 at 10:34 AM, Hitesh Shah wrote: > From a Tez perspective, there was a major compatibility change between Tez > 0.4 and Tez 0.5. However, Tez-0.7.x and Tez-0.6.x are c

Re: Hive Tez support matrix

2015-07-07 Thread Hitesh Shah
From a Tez perspective, there was a major compatibility change between Tez 0.4 and Tez 0.5. However, Tez-0.7.x and Tez-0.6.x are compatible with Tez-0.5.x. I believe Hive 0.13 is compatible only with Tez 0.4. For Hive 0.14 onwards ( including the Hive-1.x. releases ), they should work with any

Hive 1.1 arg!

2015-07-07 Thread Edward Capriolo
Hey all. I am using cloudera 5.4.something which uses hive 1.1 almost. I am getting bit by this error: https://issues.apache.org/jira/browse/HIVE-10437 So I am trying to update my test setup to 1.1 so I can include the annotation. @SerDeSpec(schemaProps = {serdeConstants.LIST_COLUMNS,

Hive Tez support matrix

2015-07-07 Thread Jim Green
Hi Team, Is there any Hive <-> Tez support matrix? For example, Hive 1.2 should be on Tez which version? Tez 0.5.3 only supports which versions of Hive? etc… My understanding is that it does not matter which version of Hive and which version of Tez. -- Thanks, www.openkb.info (Open KnowledgeBas

RE: Limiting outer join

2015-07-07 Thread Bennie Leo
Thanks for your replies. I see how extracting the first country would work, however I was hoping to speed up my query by stopping the search once a country has been found. Are you suggesting that I pass the whole IP table to a UDF and perform the search myself? I've only programmed simple UDF

Re: WHERE ... NOT IN (...) + NULL values = BUG

2015-07-07 Thread Furcy Pin
Thanks matshyeq, you are right, I tested it on other sql engines and the result is the same. (but I still find this confusing...) SELECT 1 IN (1,2,3,NULL) ; > true SELECT 1 IN (2,3) ; > false SELECT 1 IN (2,3,NULL) ; > NULL SELECT 1 NOT IN (1,2,3,NULL) ; > false SELECT 1 NOT IN (2,3,NULL) ; >

Re: WHERE ... NOT IN (...) + NULL values = BUG

2015-07-07 Thread Grant Overby (groverby)
"I call it my billion-dollar mistake. It was the invention of the null reference in 1965.” — Tony Hoare [http://www.cisco.com/web/europe/images/email/signature/est2014/logo_06.png?ct=1398192119726] Grant Overby Software Engineer Cisco.com grove...@cisco.com

Re: WHERE ... NOT IN (...) + NULL values = BUG

2015-07-07 Thread matshyeq
>Obviously, the expected answer is always 2. That's incorrect. It's expected behaviour, SQL standard and I would expect every other DBs behave same way. The direct comparison to NULL returns FALSE. Always. Doesn't matter if used as <> ,=, IN, NOT IN. IS (NOT) NULL is the right way to handle such

Re: array become struct<> when doing select

2015-07-07 Thread Karan Kumar
Issue is with the thrift version you are using most probably. https://issues.apache.org/jira/browse/THRIFT-2172 I used thrift-0.9.2 to generate my thrift classes which solved this kind of issue. On Tue, Jul 7, 2015 at 6:14 PM, Binglin Chang wrote: > Sorry, forgot to mention, the table is using

Re: array become struct<> when doing select

2015-07-07 Thread Binglin Chang
Sorry, forgot to mention, the table is using thrift serde, but 'show create table' shows the table is ROW FORMAT DELIMITED, which I think is a bug. When select simple text format table, the query runs fine, but when select thrift table, error occurs. original create table statement: CREATE EXTE

array become struct<> when doing select

2015-07-07 Thread Binglin Chang
Hi, I have a table with some array fields, when preview them using "select limit" at beeline, I got following errors, it seems the typeinfo string is changed from array to struct<> I am using hive-0.13.1 0: jdbc:hive2://lg-hadoop-hive01.bj:32203/> show create table xxx; +-

WHERE ... NOT IN (...) + NULL values = BUG

2015-07-07 Thread Furcy Pin
Hi folks, just to let my fellow Hive users know that we found a bug with subquery in where clauses and created a JIRA for it. https://issues.apache.org/jira/browse/HIVE-11192 The latest version seems to be affected. Regards, Furcy Pin

hbase column without prefix

2015-07-07 Thread Wojciech Indyk
Hi! I use hbase column regex matching to create map column in hive, like: "hbase.columns.mapping" = ":key,s:ap_.*" then I have values in column: {"ap_col1":"23","ap_col2":"7"} is it possible to cut the prefix ap_ to have values like below? {"col1":"23","col2":"7"} Kindly regards Wojciech Indyk