Re: [ANNOUNCE] New Hive Committers - Jitendra Nath Pandey and Eric Hanson

2013-11-22 Thread Vaibhav Gumashta
Congrats guys! On Fri, Nov 22, 2013 at 11:54 PM, Vikram Dixit wrote: > Congrats to both of you! > > > On Fri, Nov 22, 2013 at 9:34 AM, Jason Dere wrote: > > > Congrats! > > > > On Nov 22, 2013, at 2:25 AM, Biswajit Nayak > > wrote: > > > > > Congrats to both of you.. > > > > > > > > > On Fri,

Re: How to prevent user drop table in Hive metadata?

2013-11-22 Thread Shreepadma Venugopalan
Apache Sentry is already available and made its first incubating release a couple of months back. On Fri, Nov 22, 2013 at 3:06 PM, Echo Li wrote: > Thanks all, that's all very helpful information. > > Shreepadma, when will the Apache Sentry come GA? > > > On Fri, Nov 22, 2013 at 2:36 PM, Shreep

Re: How to prevent user drop table in Hive metadata?

2013-11-22 Thread Xiu Guo
Does something like this not do the job? hive.security.authorization.createtable.user.grants user1:select;user2:create I thought tweaking hive-site.xml would be fine. On Fri, Nov 22, 2013 at 3:06 PM, Echo Li wrote: > Thanks all, that's all very helpful information. > > Shreepadma, when

Re: How to prevent user drop table in Hive metadata?

2013-11-22 Thread Echo Li
Thanks all, that's all very helpful information. Shreepadma, when will the Apache Sentry come GA? On Fri, Nov 22, 2013 at 2:36 PM, Shreepadma Venugopalan < shreepa...@apache.org> wrote: > Apache Sentry (incubating) provides fine-grained role-based authorization > for Hive among other components

Re: How to prevent user drop table in Hive metadata?

2013-11-22 Thread Shreepadma Venugopalan
Apache Sentry (incubating) provides fine-grained role-based authorization for Hive among other components of the Hadoop ecosystem. It currently supports fully secure, fine-grained, role-based authorization for Hive and can be used to prevent the scenario described earlier i.e., prevent a user from

RE: How to prevent user drop table in Hive metadata?

2013-11-22 Thread simon.2.thompson
Thanks Alan - I'll fwd the spec in the Jira to some of our security and integrity people for comment. Simon Dr. Simon Thompson From: Alan Gates [ga...@hortonworks.com] Sent: 22 November 2013 20:53 To: user@hive.apache.org Subject: Re: How to prevent

Re: How to prevent user drop table in Hive metadata?

2013-11-22 Thread Alan Gates
See https://issues.apache.org/jira/browse/HIVE-5837 for a JIRA addressing this. Also, you can use the StorageBasedAuthorizationProvider in Hive, which bases metadata security on file security. So if the user doesn't have permissions to remove the directory that stores the table data, they wo

Re: How to prevent user drop table in Hive metadata?

2013-11-22 Thread Richard Nadeau
You can use: ALTER TABLE {table_name} ENABLE NO_DROP; And it will keep a user from dropping the table - but it can be over ridden. Rick On Nov 22, 2013 12:36 PM, "Echo Li" wrote: > Good Friday! > > I was trying to apply certain level of security in our hive data > warehouse, by modifying access

Re: How to prevent user drop table in Hive metadata?

2013-11-22 Thread Nitin Pawar
So, If I get it right you are looking for role level authorizations? like what all a user can do and what it can not do? On Sat, Nov 23, 2013 at 1:15 AM, Biswajit Nayak wrote: > Hi Echo, > > I dont think there is any to prevent this. I had the same concern in > hbase, but found out that it is

RE: How to prevent user drop table in Hive metadata?

2013-11-22 Thread Biswajit Nayak
Dont think so.. On 23 Nov 2013 01:20, wrote: > Has no one raised a Jira ticket ? > > > Dr. Simon Thompson > > > From: Biswajit Nayak [biswajit.na...@inmobi.com] > Sent: 22 November 2013 19:45 > To: user@hive.apache.org > Subject: Re: How to prevent us

RE: How to prevent user drop table in Hive metadata?

2013-11-22 Thread simon.2.thompson
Has no one raised a Jira ticket ? Dr. Simon Thompson From: Biswajit Nayak [biswajit.na...@inmobi.com] Sent: 22 November 2013 19:45 To: user@hive.apache.org Subject: Re: How to prevent user drop table in Hive metadata? Hi Echo, I dont think there is

Re: How to prevent user drop table in Hive metadata?

2013-11-22 Thread Biswajit Nayak
Hi Echo, I dont think there is any to prevent this. I had the same concern in hbase, but found out that it is assumed that user using the system are very much aware of it. I am into hive from last 3 months, was looking for some kind of way here, but no luck till now.. Thanks Biswa On 23 Nov 2013

Re: TPC-H queries on Hive 0.12

2013-11-22 Thread Yin Huai
I remember that textfiles are used in those scripts. With 0.12, I think ORC should be used. Also, I think those sub-queries should be merged into a single query. With a single query, if a reduce join is converted to a map join, this map join can be merged to its child job. But, if this join is eval

How to prevent user drop table in Hive metadata?

2013-11-22 Thread Echo Li
Good Friday! I was trying to apply certain level of security in our hive data warehouse, by modifying access mode of directories and files on hdfs to 755 I think it's good enough for a new user to remove data, however the user still can drop the table definition in hive cli, seems the "revoke" doe

TPC-H queries on Hive 0.12

2013-11-22 Thread Avrilia Floratou
Hello, I'd like to run a few TPC-H queries on Hive 0.12. I've found the TPC-H scripts here: https://issues.apache.org/jira/browse/HIVE-600. but noticed that these scripts were generated a long time ago. Since Hive could not support full SQL-92 specification some queries were split into smaller s

Re: [ANNOUNCE] New Hive Committers - Jitendra Nath Pandey and Eric Hanson

2013-11-22 Thread Jason Dere
Congrats! On Nov 22, 2013, at 2:25 AM, Biswajit Nayak wrote: > Congrats to both of you.. > > > On Fri, Nov 22, 2013 at 1:26 PM, Lefty Leverenz > wrote: > Congratulations, Jitendra and Eric! The more the merrier. > > -- Lefty > > > On Thu, Nov 21, 2013 at 6:31 PM, Jarek Jarcec Cecho wro

Re: [ANNOUNCE] New Hive Committers - Jitendra Nath Pandey and Eric Hanson

2013-11-22 Thread Biswajit Nayak
Congrats to both of you.. On Fri, Nov 22, 2013 at 1:26 PM, Lefty Leverenz wrote: > Congratulations, Jitendra and Eric! The more the merrier. > > -- Lefty > > > On Thu, Nov 21, 2013 at 6:31 PM, Jarek Jarcec Cecho wrote: > >> Congratulations, good job! >> >> Jarcec >> >> On Thu, Nov 21, 2013 at 0

Re: java.lang.OutOfMemoryError: Java heap space

2013-11-22 Thread Rok Kralj
If anybody has any clue what is the cause of this, I'd be happy to hear it. On Nov 21, 2013 9:59 PM, "Rok Kralj" wrote: > What? > On Nov 21, 2013 8:24 PM, "Asher Devuyst" wrote: > >> unsubscribe >> >> >> On Wed, Nov 20, 2013 at 5:23 PM, Rok Kralj wrote: >> >>> Hello, I am getting this error (ap