Re: [ANNOUNCE] Apache Hive 0.11.0 Released

2013-05-17 Thread Thejas Nair
Thanks to all the contributors who helped create this new release! And special thanks to the release managers Ashutosh Chauhan and Owen O'Malley - for driving this release. On Thu, May 16, 2013 at 2:19 PM, Owen O'Malley wrote: > The Apache Hive team is proud to announce the the release of Apa

Re: can hive use where clause in jdbc?

2013-07-17 Thread Thejas Nair
It is unlikely to be specifically caused by where clause. Are you able to run this query using hive cli ? Are you able to run any query that involves running a MR job through jdbc ? What do you see in the hive logs ? On Tue, Jul 16, 2013 at 1:10 AM, ch huang wrote: > here is my test output,why t

Re: regarding Hive Thrift Metastore Server

2013-07-24 Thread Thejas Nair
Without a metastore server, you would need to make access to the mysql db possible from all hive clients. This is inherently less secure, because anybody who can run hive cli can modify the mysql db, and there is not metastore server doing the authorization checks. If you don't care about security,

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Thejas Nair
s Thejas! >> >> Jarcec >> >> On Tue, Aug 20, 2013 at 03:31:48AM -0700, Carl Steinbach wrote: >> > The Apache Hive PMC has voted to make Thejas Nair a committer on the >> Apache >> > Hive project. >> > >> > Please join me in congratul

Re: ODBC driver for Excel

2013-08-22 Thread Thejas Nair
You can use the hortonworks odbc driver for free, it is available as an add-on - http://hortonworks.com/download/download-archives/ -Thejas On Thu, Aug 22, 2013 at 4:30 PM, Chad Dotzenrod wrote: > Trying to find an ODBC driver to use with Excel against my cluster that I > don't have to shell ou

Re: [ANNOUNCE] New Hive Committer - Yin Huai

2013-09-04 Thread Thejas Nair
Congrats Yin! Well deserved! Looking forward to many more contributions from you! On Tue, Sep 3, 2013 at 11:45 PM, Hari Subramaniyan wrote: > Congrats !! > > > On Tue, Sep 3, 2013 at 11:43 PM, Vaibhav Gumashta > wrote: >> >> Congrats Yin! >> >> >> On Tue, Sep 3, 2013 at 11:37 PM, Jarek Jarcec

Re: Question for ORCFileFormat

2013-09-12 Thread Thejas Nair
If you have hive metastore setup, using hcatalog is easy, you just need the jars and hive-site.xml directory in the classpath. Then you can use the hcat input/output formats in your map-reduce program - http://hive.apache.org/docs/hcat_r0.5.0/inputoutput.html On Wed, Sep 11, 2013 at 4:35 PM, Sapt

Re: User accounts to execute hive queries

2013-09-18 Thread Thejas Nair
You might find my slides on this topic useful - http://www.slideshare.net/thejasmn/hive-authorization-models Also linked from last slide - https://cwiki.apache.org/confluence/display/HCATALOG/Storage+Based+Authorization On Tue, Sep 17, 2013 at 11:46 PM, Nitin Pawar wrote: > The link I gave in p

Re: Why "<" doesn't work?

2013-09-26 Thread Thejas Nair
Can you shares some examples of what does not work ? On Thu, Sep 26, 2013 at 11:34 AM, Gary Zhao wrote: > Hello > > I found something strange. I tried a few queries, in WHERE > > 1. ">" works, returns expected results > 2. ">" and "<" doesn't work, returns 0 result > 3. "<" doesn't work, return

[RESULT] Apache Hive 0.12.0 Release Candidate 1

2013-10-14 Thread Thejas Nair
With 3 binding +1's and 2 non-binding +1s and no -1s this vote passes. Thanks to everybody who voted and gave feedback. I will start working on publishing the release. Thanks, Thejas On Sun, Oct 13, 2013 at 4:37 PM, Carl Steinbach wrote: > +1 (binding) > > >> Regarding the 3 day deadline for v

Re: Use hive on hadoop 3.0.0

2013-10-14 Thread Thejas Nair
If you are using HIVE-TEZ branch, you also need tez (git clone g...@github.com:apache/tez.git). Publish the tez artifacts locally (mvn clean install -DskipTests). In hive, change build.properties to have hadoop-0.23.version=Hadoop-3.0.0-SNAPSHOT. Specifying that using "-Dhadoop-0.23.version" in yo

Fwd: [ANNOUNCE] Apache Hive 0.12.0 Released

2013-10-15 Thread Thejas Nair
The Apache Hive team is proud to announce the the release of Apache Hive version 0.12.0. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides: * Tools to enable easy data extrac

Re: HS2 ODBC incompatibility

2013-10-21 Thread Thejas Nair
Yes, the current odbc driver source in hive is not compatible with hive server2. I am not aware of any body working on it. But you can download odbc driver add on for hive server2, for free from the hortonworks website - http://hortonworks.com/download/download-archives/ On Mon, Oct 21, 2013 at 5:

Re: In Beeline what is the syntax for ALTER TABLE ?

2013-10-21 Thread Thejas Nair
beeline does not have any query syntax of its own, it just sends the query to hive server2, which uses same code as hive-cli to run the query. ie query syntax is same as hive cli On Mon, Oct 21, 2013 at 11:41 AM, Sanjay Subramanian < sanjay.subraman...@wizecommerce.com> wrote: > Hi guys > >

Re: Hive 12 with Hadoop 2.x with ORC

2013-10-22 Thread Thejas Nair
protobuf 2.5 upgrade did not get included in hive 0.12 (HIVE-5112). You might want to apply the protobuf update patch on top of 0.12 to use it with recent versions of hadoop 2.x . (but i am certain if this is a protobuf version issue). On Tue, Oct 22, 2013 at 6:53 AM, Rajesh Balamohan wrote: > H

Re: [ANNOUNCE] New Hive Committer - Xuefu Zhang

2013-11-04 Thread Thejas Nair
Congrats Xuefu! On Sun, Nov 3, 2013 at 11:11 PM, Mohammad Islam wrote: > Congrats Xuefu! > > --Mohammad > > > On Sunday, November 3, 2013 9:07 PM, "hsubramani...@hortonworks.com" > wrote: > Congrats Xuefu! > > Thanks, > Hari > > On Nov 3, 2013, at 8:28 PM, Gunther Hagleitner > wrote: > > Congra

Re: UnitTest did not pass during compile the latest hive code

2013-11-05 Thread Thejas Nair
The new instructions for using maven are here - https://cwiki.apache.org/confluence/display/Hive/HiveDeveloperFAQ I have updated the https://cwiki.apache.org/confluence/display/Hive/DeveloperGuide with link to above document. But it still needs cleanup. On Tue, Nov 5, 2013 at 7:46 AM, Tim Chou w

Re: UnitTest did not pass during compile the latest hive code

2013-11-07 Thread Thejas Nair
'2') location '/tmp'"); >> assertEquals(0, response.getResponseCode()); >> assertNull(response.getErrorMessage()); >> >> The code is trying to read /tmp directory. But, in my /tmp directory, >> there is a file name "fcitx-socket-:0"

Re: [ANNOUNCE] New Hive Committer - Prasad Mujumdar

2013-11-10 Thread Thejas Nair
Congrats Prasad! On Sun, Nov 10, 2013 at 6:46 PM, Jarek Jarcec Cecho wrote: > Congratulations Prasad, good job! > > Jarcec > > On Sun, Nov 10, 2013 at 06:42:45PM -0800, Carl Steinbach wrote: >> The Apache Hive PMC has voted to make Prasad Mujumdar a committer on the >> Apache Hive Project. >> >>

Re: [ANNOUNCE] New Hive PMC Member - Harish Butani

2013-11-15 Thread Thejas Nair
Congrats Harish! On Fri, Nov 15, 2013 at 1:08 AM, Gunther Hagleitner wrote: > Congratulations Harish! Very cool. > > > On Thu, Nov 14, 2013 at 10:01 PM, Prasad Mujumdar wrote: > >> Congratulations !! >> >> thanks >> Prasad >> >> >> >> On Thu, Nov 14, 2013 at 5:17 PM, Carl Steinbach wrote: >

Re: Running Hive 0.12.0 with Hadoop 2.2

2013-11-15 Thread Thejas Nair
It is better to first upgrade hive 0.12 to protocol buffer 2.5 first - https://issues.apache.org/jira/browse/HIVE-5112. This will make it into hive 0.13 release. If you want a pre-built hive 0.12 that works with hadoop 2.2.x , you can download one from hortonworks website - http://docs.hortonworks.

Re: [ANNOUNCE] New Hive Committer and PMC Member - Lefty Leverenz

2013-11-17 Thread Thejas Nair
Congrats Lefty! On Sat, Nov 16, 2013 at 9:20 PM, Carl Steinbach wrote: > The Apache Hive PMC has voted to make Lefty Leverenz a committer and PMC > member on the Apache Hive Project. > > Please join me in congratulating Lefty! > > Thanks. > > Carl -- CONFIDENTIALITY NOTICE NOTICE: This message

Re: [ANNOUNCE] New Hive Committers - Jitendra Nath Pandey and Eric Hanson

2013-11-21 Thread Thejas Nair
Congrats! On Thu, Nov 21, 2013 at 3:46 PM, Shreepadma Venugopalan wrote: > Congrats guys! > > > On Thu, Nov 21, 2013 at 3:37 PM, Vinod Kumar Vavilapalli > wrote: > >> Congratulations to both! Great job and keep up the good work! >> >> Thanks, >> +Vinod >> >> On Nov 21, 2013, at 3:29 PM, Carl Ste

Re: Difference in number of row observstions from distinct and group by

2013-11-21 Thread Thejas Nair
You probably have 400 rows where col1, col2 and col3 have null values. "count(distinct col1,col2,col3) " will not count those rows. On Thu, Nov 21, 2013 at 7:13 AM, Mayank Bansal wrote: > Hi, > > > > I have a table which has 3 columns combined together to form a primary key. > If I do > > > > Se

Re: Using Hive with WebHCat

2013-12-03 Thread Thejas Nair
Can you try setting "templeton.storage.root" in webhcat-site.xml to a directory that exists ? On Mon, Dec 2, 2013 at 6:21 AM, Jonathan Hodges wrote: > Hi, > > I have setup WebHCat that is bundled with Hive 0.11.0. I am able to kick of > map reduce jobs with the REST API successfully. However

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2013-12-27 Thread Thejas Nair
The changes look good to me. Only concern I have is with the 7 days for release candidate voting. Based on my experience with releases, it often takes few cycles to get the candidate out, and people tend to vote closer to the end of the voting period. This can mean that it takes several weeks to ge

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2013-12-27 Thread Thejas Nair
happening on trunk. > > Thanks, > Ashutosh > > > On Fri, Dec 27, 2013 at 9:33 AM, Thejas Nair wrote: > >> The changes look good to me. >> Only concern I have is with the 7 days for release candidate voting. >> Based on my experience with releases, it often takes

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2013-12-29 Thread Thejas Nair
On Sun, Dec 29, 2013 at 12:06 AM, Lefty Leverenz wrote: > Let's discuss annual rotation of the PMC chair a bit more. Although I > agree with the points made in favor, I wonder about frequent loss of > expertise and needing to establish new relationships. What's the ramp-up > time? The ramp up t

Re: [ANNOUNCE] New Hive Committer - Vikram Dixit

2014-01-06 Thread Thejas Nair
Congrats Vikram! On Mon, Jan 6, 2014 at 9:01 AM, Jarek Jarcec Cecho wrote: > Congratulations Vikram! > > Jarcec > > On Mon, Jan 06, 2014 at 08:58:06AM -0800, Carl Steinbach wrote: >> The Apache Hive PMC has voted to make Vikram Dixit a committer on the >> Apache Hive Project. >> >> Please join m

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2014-01-07 Thread Thejas Nair
ours when not many other changes are in. > > > On Fri, Dec 27, 2013 at 1:03 PM, Thejas Nair wrote: >> >> I agree with Ashutosh that the 24 hour waiting period after +1 is >> cumbersome, I have also forgotten to commit patches after +1, >> resulting in patches goin

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2014-01-08 Thread Thejas Nair
'd. With the change the clock starts ticking when patch is available (ie, controlled by contributor). I think this 'small' change will improver things for better in a bigger way. On Tue, Jan 7, 2014 at 7:01 PM, Thejas Nair wrote: > After thinking some more about it, I am not

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2014-01-14 Thread Thejas Nair
. Although it could be cumbersome, it is not much worse than what > would happen now incase of a bad commit. Anyway we wait for the unit tests > to complete at the very least. > > I am +1 on Thejas' proposal. > > > On Tue, Jan 7, 2014 at 7:01 PM, Thejas Nair wrote: > >&g

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2014-01-15 Thread Thejas Nair
This wording seems fine. You could add "a" here: "Committers should wait > for [a] reasonable time" > > The guidance is good. > > +1 > > -- Lefty > > > On Tue, Jan 14, 2014 at 7:53 PM, Thejas Nair wrote: > >> I guess the silence from oth

Re: [ANNOUNCE] New Hive Committers - Sergey Shelukhin and Jason Dere

2014-01-27 Thread Thejas Nair
Congrats Jason and Sergey! Well deserved! Looking forward to your help in getting the patch available counts down (its at 225 now)! On Mon, Jan 27, 2014 at 10:55 AM, Vaibhav Gumashta wrote: > Congrats Sergey and Jason! > > --Vaibhav > > > On Mon, Jan 27, 2014 at 10:47 AM, Vikram Dixit > wrote:

Re: HIVE+MAPREDUCE

2014-01-27 Thread Thejas Nair
You can use hcatalog to write into hive tables from mapreduce. See https://cwiki.apache.org/confluence/display/Hive/HCatalog+InputOutput . Another example is in https://gist.github.com/thejasmn/7607406 On Tue, Jan 21, 2014 at 12:21 AM, Ranjini Rathinam wrote: > Hi, > > Need to load the data into

Re: [ANNOUNCE] New Hive Committer - Remus Rusanu

2014-02-26 Thread Thejas Nair
Congrats Remus! On Wed, Feb 26, 2014 at 9:08 AM, Clay McDonald < stuart.mcdon...@bateswhite.com> wrote: > Congratulations Remus! > > Clay > > -Original Message- > From: Jarek Jarcec Cecho [mailto:jar...@apache.org] > Sent: Wednesday, February 26, 2014 12:06 PM > To: user@hive.apache.org

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

2014-02-28 Thread Thejas Nair
Congrats Xuefu! On Fri, Feb 28, 2014 at 3:20 AM, Clark Yang (杨卓荦) wrote: > Congrats, Xuefu! > > Thanks, > Zhuoluo (Clark) Yang > > > 2014-02-28 19:19 GMT+08:00 Lianhui Wang : > > Congrats Xuefu! >> >> >> 2014-02-28 17:49 GMT+08:00 Jason Dere : >> >> > Congrats Xuefu! >> > >> > >> > On Feb 28, 2

Re: Hive jdbc access to HiveServer2. How to debug?

2014-04-11 Thread Thejas Nair
This hanging issue has been seen when there is a mismatch between the auth modes of HS2 server and client (usually SASL vs NOSASL). On Sun, Apr 6, 2014 at 5:40 AM, Jay Vyas wrote: > Hi hive. > > I cant run JDBC queries against HiveServer2. It appears the client is > connecting to the thrift se

Re: [ANNOUNCE] New Hive Committers - Alan Gates, Daniel Dai, and Sushanth Sowmyan

2014-04-14 Thread Thejas Nair
Congrats Alan, Daniel, Sushanth! On Mon, Apr 14, 2014 at 11:29 AM, Szehon Ho wrote: > Congratulations, guys! > > > On Mon, Apr 14, 2014 at 11:14 AM, Hari Subramaniyan > wrote: >> >> Congrats! >> >> >> On Mon, Apr 14, 2014 at 11:09 AM, Tao Li wrote: >>> >>> Congrats! >>> >>> On Apr 15, 2014 1:5

Re: [ANNOUNCE] Apache Hive 0.13.0 Released

2014-04-21 Thread Thejas Nair
Thanks to Harish for all the hard work managing and getting the release out! This is great news! This is a significant release in hive! This has more than twice the number of jiras included (see release note link), compared to 0.12, and earlier releases which were also out after a similar gap of 5

Re: What is the minimal required version of Hadoop for Hive 0.13.0?

2014-04-23 Thread Thejas Nair
There is a jira for the hadoop 1.0.x compatibility issue. https://issues.apache.org/jira/browse/HIVE-6962 I have suggested a possible workaround there. There is no patch for it yet. I am planning to propose a 0.13.1 release, primarily for the issues around use of Oracle as metastore database, and

Re: [ANNOUNCE] New Hive Committers - Prasanth J and Vaibhav Gumashta

2014-04-25 Thread Thejas Nair
Congrats Prasanth and Vaibhav! On Fri, Apr 25, 2014 at 10:16 AM, Prasanth J wrote: > Its a wonderful news. :) Thanks for your wishes guys!! > > Thanks > Prasanth > > > > On Apr 25, 2014, at 8:52 AM, Sushanth Sowmyan > wrote: > > > > Congrats, guys! :) > > > > On Fri, Apr 25, 2014 at 12:33 AM,

Re: MapReduce with HCatalog hangs

2014-05-02 Thread Thejas Nair
HcatInputFormat does not run any initial mapreduce jobs. It seems to me that the MapReduce job actually ran. You might want to do a jstack on your java program client side, to see what it is waiting on. On Fri, May 2, 2014 at 7:28 AM, Fabian Reinartz wrote: > I implemented a MapReduce job with H

Re: Hive Vs Pig: Master's thesis

2014-05-02 Thread Thejas Nair
The primary difference between hive and pig is the language. There are implementation differences that will result in performance differences, but it will be hard to figure out what aspect of implementation responsible for what improvement. I think a more interesting project would be to compare th

Re: OrcOutputFormat

2014-05-15 Thread Thejas Nair
I am not familiar with https://github.com/mayanhui/hive-orc-mr/. But is there any reason why you are not using hcatalog input/output format for this ? https://cwiki.apache.org/confluence/display/Hive/HCatalog+InputOutput. On Wed, Apr 30, 2014 at 4:25 AM, Seema Datar wrote: > Hi All, > > Does an

Re: Metastore 0.13 is not starting up.

2014-05-30 Thread Thejas Nair
Have you tried using schematool to upgrade the metastore schema ? https://cwiki.apache.org/confluence/display/Hive/Hive+Schema+Tool On Wed, May 21, 2014 at 4:29 AM, Biswajit Nayak wrote: > Hi All, > > I had metastore(0.12) running previously. But after upgrading to 0.13 it is > failing with below

CVE-2014-0228: Apache Hive Authorization vulnerability

2014-06-12 Thread Thejas Nair
that data into his table. This is possible if the user HiveServer2 runs as has permissions for that directory and its contents. Mitigation: Users who use SQL standards based authorization should upgrade to 0.13.1. Credit: This issue was discovered by Thejas Nair of Hortonworks. -BEGIN PGP

Re: Questions about hive authorization under hdfs permissions.

2014-06-16 Thread Thejas Nair
I hope you don't mind me cc'ing user-group so that this q&a is available for others as well. The grant/revoke based authorization models (including the new sql-standards based authorization in hive 0.13) does not automatically ensure that the user has necessary privileges on hdfs dirs and files. T

requesting write access to hive confluence wiki

2012-04-30 Thread Thejas Nair
Hi, I would like to update/fix some sections in the hive confluence wiki. Please grant write access. My user name is thejas. Thanks, Thejas

Re: Can't Start metastore server on secure hadoop cluster

2014-08-05 Thread Thejas Nair
Hi Atkins, I see this with Hadoop 2.5 . I have created https://issues.apache.org/jira/browse/HIVE-7620 to address this. It should not be seen with Apache Hadoop 2.4, as the related change in hadoop happened in 2.5 - See HADOOP-10451 On Sun, Jul 13, 2014 at 1:15 AM, Shih-liang, Chang wrote: > Hi,

Re: Getting Started with Hive 0.13.1 ClassNotFound

2014-09-02 Thread Thejas Nair
hcat_server is essentially same has hive metastore, it is there for historical reasons (time to remove it, in my opinion). As metastore command is more commonly used, hcat_server command might have new bugs that have gone unnoticed because of its disuse. You can start hive-metastore by using 'hiv

Re: WebHCat can't display table with number name

2014-09-26 Thread Thejas Nair
This is a bug. Would you mind opening a hive jira for this ? If you can provide a patch as well, I will be happy to review it. On Fri, Sep 26, 2014 at 3:17 AM, Charles Bonneau wrote: > > Hello, > > We are using Hive 0.12. > While using WebHCat, I stumbled upon a problem regarding the name of ta

Re: hive 0.13.0 guava issues

2014-09-29 Thread Thejas Nair
guava jar is there as part of hadoop, and hadoop uses guava 0.11 jar. As the guava versions are not fully compatible with each other, hive can't upgrade unless hadoop also upgrades or we use a good way to isolate the jar usage. See discussion in hadoop about upgrading the guava version - http://sea

Re: hive 0.13.0 guava issues

2014-09-30 Thread Thejas Nair
uava 11 as a fat-jar v/s > having it as a library dependency that can be easily removed if needed. > > Previously I had a hack to let the ClassLoader load guava that my user code > cares about the most i.e. the latest one. > > Never seen Hadoop break because of that. > > Than

Re: [ANNOUNCE] New Hive PMC Member - Alan Gates

2014-10-27 Thread Thejas Nair
Congrats Alan! On Mon, Oct 27, 2014 at 10:11 PM, Sergio Pena wrote: > Congratulations Alan!! > > On Mon, Oct 27, 2014 at 5:38 PM, Carl Steinbach wrote: > >> I am pleased to announce that Alan Gates has been elected to the Hive >> Project Management Committee. Please join me in congratulating Al

Re: hcatalog table permissions error

2014-10-28 Thread Thejas Nair
Nathan, Can you check if you have hive.metastore.execute.setugi=true in conf object used by HCatClient.create(conf) ? Thanks, Thejas On Wed, Oct 22, 2014 at 12:55 PM, Nathan Bamford wrote: > Whoops, I pasted the wrong line in for the hcat table records. Should have > been: > > > -rw-r--r-- 3 n

Re: [ANNOUNCE] Apache Hive 0.14.0 Released

2014-11-17 Thread Thejas Nair
The link to the download page is now - https://hive.apache.org/downloads.html (I have also corrected the email template in how-to-release wiki with new url). On Mon, Nov 17, 2014 at 1:59 PM, Roshan Naik wrote: > 1) fyi.. this link is broken: > > http://hive.apache.org/releases.html > > 2) Jav

Re: [ANNOUNCE] New Hive PMC Member - Prasad Mujumdar

2014-12-09 Thread Thejas Nair
Congrats Prasad! On Tue, Dec 9, 2014 at 5:03 PM, Navis류승우 wrote: > Congratulations! > > 2014-12-10 8:35 GMT+09:00 Jason Dere : >> >> Congrats! >> >> On Dec 9, 2014, at 3:02 PM, Venkat V wrote: >> >> > Congrats Prasad! >> > >> > On Tue, Dec 9, 2014 at 2:32 PM, Brock Noland wrote: >> > Congratul

Re: [ANNOUNCE] New Hive PMC Members - Szehon Ho, Vikram Dixit, Jason Dere, Owen O'Malley and Prasanth Jayachandran

2015-01-28 Thread Thejas Nair
Congrats! On Wed, Jan 28, 2015 at 2:08 PM, Prasanth Jayachandran wrote: > Thanks Shezon and everyone! Congraturlations Vikram, Jason, Shezon and Owen! > > On Jan 28, 2015, at 1:51 PM, Szehon Ho > mailto:sze...@cloudera.com>> wrote: > > Thanks and congrats to Vikram, Jason, Owen, and Prasanth ! >

Re: [ANNOUNCE] Apache Hive 1.0.0 Released

2015-02-05 Thread Thejas Nair
Congrats to all the users and contributors in the Apache Hive community! It is great that we finally move away from the 0.x versioning scheme to the 1.x versioning scheme for new releases. This is a great way of honoring the work from hive community that has made hive the defacto standard for SQL o

Re: "show databases" doesn't return all databases with Kerberos/Sentry enabled

2015-05-13 Thread Thejas Nair
Hi Liping, As Szehon said, the sentry mailing list is likely to be able to help you with this. Please note that the secur...@hive.apache.org is meant to be used to report security vulnerabilities, it is not the right place for questions on features . Thanks, Thejas On Wed, May 13, 2015 at 12:05

Re: Issue with Star schema

2016-03-15 Thread Thejas Nair
As suggested, looking at the explain plan should tell you if map-join is getting used. Using a recent version with hive-on-tez would also give you further speedup as map-joins are optimized further in it. On Tue, Mar 15, 2016 at 9:32 AM, sreebalineni . wrote: > You can think of map joins.If clus

Re: [VOTE] Bylaws change to allow some commits without review

2016-04-18 Thread Thejas Nair
?+1 From: Wei Zheng Sent: Monday, April 18, 2016 10:51 AM To: user@hive.apache.org Subject: Re: [VOTE] Bylaws change to allow some commits without review +1 Thanks, Wei From: Siddharth Seth mailto:ss...@apache.org>> Reply-To: "user@hive.apache.org

Re: use jdbc connect to hive2.0

2016-05-04 Thread Thejas Nair
The property should be named hadoop.proxyuser.dcos.groups and hadoop.proxyuser.dcos.groups if you are running HS2 as user dcos. Also, user dcos should belong to the group dcos if that setting is to work. I assume you are trying to have hive.server2.enable.doAs=true. I am not sure why you are seei

Re: Hive 2 database Entity-Relationship Diagram

2016-05-19 Thread Thejas Nair
The pdf is not upside for me, in chrome browser. However, there seems to be many tables that are not related to (or rather used by) hive, specifically DMRV_* and DMRS_* ones. Thanks, Thejas From: Mich Talebzadeh Sent: Thursday, May 19, 2016 10:53 AM To: use

Re: [ANNOUNCE] Apache Hive 2.1.0 Released

2016-06-21 Thread Thejas Nair
Thanks for your hard work and patience in driving the release Jesus! :) On Tue, Jun 21, 2016 at 10:18 AM, Jesus Camachorodriguez wrote: > The Apache Hive team is proud to announce the release of Apache Hive > version 2.1.0. > > The Apache Hive (TM) data warehouse software facilitates querying an

Re: hive will die or not?

2016-08-13 Thread Thejas Nair
In addition, there is also lot more coming with LLAP. http://www.slideshare.net/HadoopSummit/llap-subsecond-analytical-queries-in-hive There is also no fine grained access control natively in Spark. LLAP would help with that as well - http://www.slideshare.net/HadoopSummit/finegrained-security-fo

Re: javax.jdo.JDODataStoreException: Required table missing : "VERSION" in Catalog "" Schema "". DataNucleus requires this table to perform its persistence operations. Either your MetaData is incorrec

2016-08-19 Thread Thejas Nair
As the error message indicated, please use "schematool -initSchema -dbType.. " command to create the proper metadata schema in metastore. On Fri, Aug 19, 2016 at 4:53 AM, شجاع الرحمن بیگ wrote: > Hey, > > Could you please help me resolving this error? > version= hive 2.1.0 > > ERROR StatusLogge

Re: why need set hive.server2.enable.doAs=false in SQL-Standard Based Authorization

2016-08-19 Thread Thejas Nair
1 - if it set to true, you need to manager permissions in two places for users, using grant/revoke on tables, and file system permissions as well, and keep them in sync. That will be a headache. Moreover, the main intent for sql std auth is to be able to provide fine grained access control using vi

Re: SQL Standard Based Hive Authorization with CDH 5.X

2017-05-11 Thread Thejas Nair
You can also set them via hiveserver2-site.xml instead of passing them as commandline params. Let me make that more clear in the doc. On Thu, May 11, 2017 at 9:36 AM, Rob Anderson wrote: > You add the options to HiveServer2 Environment Advanced Configuration > Snippet (Safety Valve) via: > > HIV

Re: CVE-2016-3083: Apache Hive SSL vulnerability bug disclosure

2017-05-30 Thread Thejas Nair
It went in under guise of the jira - HIVE-13390. Commit - https://github.com/apache/hive/commit/3b2ea248078bdf3a8372958cf51a989dc3883bcc On Tue, May 30, 2017 at 12:35 PM, Ying Chen wrote: > Hello - > Was there a particular JIRA(s) that went into Hive 1.2.2 that fixed this > issue? > Thanks much.

Re: Proposal: Apply SQL based authorization functions in the metastore.

2018-04-28 Thread Thejas Nair
Hi Elliot, One scenario where Storage based authorization doesn't work is the case of object stores such as S3. In those scenarios, the tool/platform that is accessing the data won't have any restrictions on data access either. I am not sure how the data access would be secured in such cases, even

Re: [SECURITY] CVE-2018-1314: Hive explain query not being authorized

2018-11-09 Thread Thejas Nair
Terry, Yes this is seen with SQL stardard authorization, Ranger and I suppose Sentry based authorization as well. Hive was not passing the table objects to the authorization plugin implementations during authorization api calls. On Wed, Nov 7, 2018 at 1:49 PM Terry wrote: > > Daniel - Is this hap

Re: HIVE-20420 Provide a fallback authorizer when no other authorizer is in use

2018-11-14 Thread Thejas Nair
This was for CVE-2018-11777. You can find more details in description of CVE-2018-11777 On Wed, Nov 14, 2018 at 3:40 AM Oleksiy S wrote: > > Guys, could you help with this new feature? HIVE-20420 > > I see no docs, no use cases, just nothing. Thanks. > > -- > Oleksiy