Re: Issues with hive storage based authorization

2017-11-15 Thread Vijay Toshniwal
authenticating using a keytab can go and create > databases. > > One thing I observer was the dfs.permissions.enabled in hdfs-site.xml set > to false. After setting it to true a user with required privilege on the > warehouse dir was only able to create database. However that works without &g

Re: Issues with hive storage based authorization

2017-11-15 Thread Jörn Franke
ne thing I observer was the dfs.permissions.enabled in hdfs-site.xml set to > false. After setting it to true a user with required privilege on the > warehouse dir was only able to create database. However that works without > even enabling the hive storage based authorization. So not sure how hiv

Re: Issues with hive storage based authorization

2017-11-15 Thread Vijay Toshniwal
privilege on the warehouse dir was only able to create database. However that works without even enabling the hive storage based authorization. So not sure how hive storage base authorization will provided additional security. Definitely I am missing something. Please suggest. Thanks, Vijay On Thu

Re: Issues with hive storage based authorization

2017-11-09 Thread Jörn Franke
t;> On 9. Nov 2017, at 06:57, Vijay Toshniwal wrote: >>> >>> Hi Team, >>> >>> >>> >>> I am facing issues while configuring hive storage based authorization. I >>> followed the steps mentioned in >>> https://cwiki.apach

Re: Issues with hive storage based authorization

2017-11-09 Thread Vijay Toshniwal
No its not. Thanks, Vijay On Thu, Nov 9, 2017 at 1:09 PM, Jörn Franke wrote: > Is your Hadoop cluster kerberized? > > On 9. Nov 2017, at 06:57, Vijay Toshniwal > wrote: > > Hi Team, > > > > I am facing issues while configuring hive storage based authorization. I

Re: Issues with hive storage based authorization

2017-11-08 Thread Jörn Franke
Is your Hadoop cluster kerberized? > On 9. Nov 2017, at 06:57, Vijay Toshniwal wrote: > > Hi Team, > > > > I am facing issues while configuring hive storage based authorization. I > followed the steps mentioned in > https://cwiki.apache.org/confluence

Re:Issues with hive storage based authorization

2017-11-08 Thread 游垂凯
wmky_kk 在 2017-11-09 13:57:03,"Vijay Toshniwal" 写道: Hi Team, I am facing issues while configuring hive storage based authorization. I followed the steps mentioned in https://cwiki.apache.org/confluence/display/Hive/Storage+Based+Authorization+in+the+Metastore+Server however s

Issues with hive storage based authorization

2017-11-08 Thread Vijay Toshniwal
Hi Team, I am facing issues while configuring hive storage based authorization. I followed the steps mentioned in https://cwiki.apache.org/ confluence/display/Hive/Storage+Based+Authorization+in+the+Metastore+Server however still any user can create database in hive (using beeline and cli) at

Hive Storage Handler to replace HDFS with custom store

2015-10-13 Thread Amey Barve
Hi All, Hive by default queries onto HDFS. If I implement Hive Storage Handler for my store with 1. input format 2. output format 3. AbstractSerDe Hive queries will then store and retrieve from my store instead of HDFS, Is this understanding correct? or any other changes needed in Hive code? If

Custom Hive Storage Handler

2015-05-17 Thread Aaron McCurry
I'm currently developing a new storage handler, serde and input and output format for Apache Blur. I'm having a problem integrating hive with Blur's bulk ingestion process. The ingestion process is MR based and requires reading input files from Blur and mixing the data with new inbound data. The

Re: What is the use of compressed field in the hive storage descriptor

2013-09-26 Thread Edward Capriolo
Some table types like rc file can have internal compression. It has different meaning based on the serde used. On Thursday, September 26, 2013, KayVajj wrote: > A desc extended command results in the following > Table( > tableName:table_namet, > dbName:cybs_test, > owner:x...@abc.com, > createTim

What is the use of compressed field in the hive storage descriptor

2013-09-26 Thread KayVajj
A desc extended command results in the following Table( tableName:table_namet, dbName:cybs_test, owner:x...@abc.com, createTime:1380232668, lastAccessTime:0, retention:0, sd:StorageDescriptor( cols:[ FieldSchema(name:a, type:string, comment:null), FieldSchema(name:b, type:string, comment:nul

Re: Hive Storage

2013-07-11 Thread Nitin Pawar
I think you may need to read more about how HDFS stores data. here is the basic definition http://hadoop.apache.org/docs/stable/hdfs_design.html#NameNode+and+DataNodes by definition hdfs never stores and files (your data) on the namenode. It stores the files etc on hdfs and the metadata related t

Hive Storage

2013-07-11 Thread Manickam P
Hi experts, In hive While we load files into tables will it be stored in master node only? or will it use data nodes also for HDFS storage? Please clarify. Thanks, Manickam P

RE: Need Help in Hive storage format

2012-10-12 Thread yogesh dhari
Thanks All :-) Its working now :-) Regards Yogesh Kumar > CC: user@hive.apache.org > From: abhishek.dod...@gmail.com > Subject: Re: Need Help in Hive storage format > Date: Fri, 12 Oct 2012 08:47:41 -0400 > To: user@hive.apache.org > > Hi Yogesh, > > T

Re: Need Help in Hive storage format

2012-10-12 Thread Abhishek
m, ignore, ignorecase, activat); >> >> What should be in the delimiter into PigStorage( )? >> I have tried PigStorage('/001') but its showing errors. >> What delimiter should we use. >> >> Please help and Suggest. >> >> >> Thanks &

Re: Need Help in Hive storage format

2012-10-12 Thread MiaoMiao
t; Please help and Suggest. > > > Thanks & Regards > Yogesh Kumar > > > > > > > Subject: Re: Need Help in Hive storage format > To: user@hive.apache.org > From: bejoy...@yahoo.com > Date: Thu, 11 Oct 2012 17:53:12 + > > &

RE: Need Help in Hive storage format

2012-10-12 Thread yogesh dhari
showing errors. What delimiter should we use. Please help and Suggest. Thanks & Regards Yogesh Kumar Subject: Re: Need Help in Hive storage format To: user@hive.apache.org From: bejoy...@yahoo.com Date: Thu, 11 Oct 2012 17:53:12 + Hi Yogesh. It should be a simple delimited file

Re: Need Help in Hive storage format

2012-10-11 Thread Bejoy KS
Help in Hive storage format Hi all, If we run this query insert overwrite local directory '/home/yogesh/Downloads/demoyy' select * from NYSE_LOCAL; { ( describe NYSE_LOCAL ; exchangestring symbolstring ddatestring openfloat highfloat lo

Need Help in Hive storage format

2012-10-11 Thread yogesh dhari
Hi all, If we run this query insert overwrite local directory '/home/yogesh/Downloads/demoyy' select * from NYSE_LOCAL; { ( describe NYSE_LOCAL ; exchangestring symbolstring ddatestring openfloat highfloat lowfloat ) } ls /home/yogesh/Downloa