Using Storage Based Authorization with Kerberos security.

2015-02-16 Thread Thomas Larsson
Hello, We are using Hive 0.11 and are using kerberos authentication for our cluster. I just tried out enabling Storage Based Authorization as described here: https://cwiki.apache.org/confluence/display/Hive/Storage+Based+Authorization+in+the+Metastore+Server Using the cli, I then created a databa

Re: Setting limits for hive users

2014-04-24 Thread Thomas Larsson
rtitioned fact table, > when only a certain subset may be needed. > > > http://my.safaribooksonline.com/book/databases/hadoop/9781449326944/10dot-tuning/strict_mode_tuning_html > On Apr 23, 2014 9:51 AM, "Thomas Larsson" > wrote: > >> Hello. >> >> W

Setting limits for hive users

2014-04-23 Thread Thomas Larsson
Hello. We recently had a user that ran an ad-hoc hive query with a JOIN clause without an ON-predicate, resulting in a huge resultset that then resulted in our hdfs storage becoming full. I am wondering what support and strategies there are to help limit the damage that ad-hoc queries like this c

Re: Cannot build hive

2014-01-27 Thread Thomas Larsson
Yes, that works. In other words RTFM! On Tue, Jan 28, 2014 at 8:48 AM, Thomas Larsson wrote: > Thanks Andrew, I'll try that. > > > On Tue, Jan 28, 2014 at 8:46 AM, Andrew Mains > wrote: > >> Hi Thomas, >> >> Check out the developer guide and FAQ: https:

Re: Cannot build hive

2014-01-27 Thread Thomas Larsson
g/confluence/display/Hive/ > HiveDeveloperFAQ . The instructions on the FAQ ought to work for the > latest code (at least, they did for me). > > Andrew > > > On 1/27/14, 11:36 PM, Thomas Larsson wrote: > >> Hello. >> >> I just checked out the hive git repo and

Cannot build hive

2014-01-27 Thread Thomas Larsson
Hello. I just checked out the hive git repo and ran "mvn clean install" from the project root. It fails in module common in which the class HiveStringUtils tries to use the classes org.apache.hadoop.fs.Path and org.apache.hadoop.fs.Text which cannot be found. Is there anything special I need to d

How to access a secure hive metastore from a mapreduce job.

2014-01-27 Thread Thomas Larsson
Hello, We have a hive metastore that is secured with kerberos. I need to access this from a mapreduce job but don't know how to authenticate. Due to our cluster setup I am currently looking at JDBC instead of HCatalog, but as far as I know, it is a bit of a hassle to do this. For example, how is t