Re: Hive directory permissions

[Himanish Kushary]

We usually start the shell thru sudo,otherwise we get a "Permission denied"
while creating Hive tables.

But this is a good point, any suggestions/best practices from the user
community ?

Thanks

On Thu, Aug 16, 2012 at 9:37 AM, Connell, Chuck <chuck.conn...@nuance.com>wrote:

>  I have run into similar problems. Thanks for the suggestions. One
> concern… Isn’t hdfs a highly privileged user within the Hadoop cluster? So
> do we really want it to be standard practice for all Hive users to su to
> hdfs?****
>
> ** **
>
> Chuck Connell****
>
> Nuance R&D Data Team****
>
> Burlington, MA****
>
> ** **
>
> *From:* Himanish Kushary [mailto:himan...@gmail.com]
> *Sent:* Thursday, August 16, 2012 9:30 AM
> *To:* user@hive.apache.org
> *Subject:* Re: Hive directory permissions****
>
> ** **
>
> Hi Sean,****
>
> ** **
>
> From the Hive language manual - "Moreover, we strongly advise users to
> create the HDFS directories /tmp and /user/hive/warehouse
> (aka hive.metastore.warehouse.dir) and set them chmod g+w before tables
> are created in Hive"****
>
> ** **
>
> My warehouse directory has the following permissions:****
>
> ** **
>
> *Name*****
>
> *Type*****
>
> *Size*****
>
> *Replication*****
>
> *Block Size*****
>
> *Modification Time*****
>
> *Permission*****
>
> *Owner*****
>
> *Group*****
>
> *warehouse<http://h-node02:50075/browseDirectory.jsp?dir=%2Fuser%2Fhive%2Fwarehouse&namenodeInfoPort=50070&nnaddr=hdfs01:8020>
> *****
>
> *dir*****
>
> *2012-08-15 15:51*****
>
> *rwxrwxr-x*****
>
> *hdfs*****
>
> *supergroup*****
>
>
> Also I make sure that I run the hive CLI as 'hdfs' user.****
>
> ** **
>
> Hope this helps****
>
> ** **
>
> Thanks****
>
> Himanish****
>
> On Thu, Aug 16, 2012 at 1:50 AM, Sean Bigdatafun <
> sean.bigdata...@gmail.com> wrote:****
>
> I ran the following command trying to setup my hive directory, but got the
> following error.  ****
>
> ** **
>
> root@cdh-client:/# hadoop fs -mkdir       /user/hive/warehouse****
>
> mkdir: org.apache.hadoop.security.AccessControlException: Permission
> denied: user=root, access=WRITE, inode="/user":hdfs:hadoop:drwxr-xr-x****
>
> ** **
>
> Can someone tell me what is the "correct" ownership for hive directories?
> My "/user" directory is with the following ownership: ****
>
> user<http://cdh-slave2-16g.hwhadoop.com:50075/browseDirectory.jsp?dir=%2Fuser&namenodeInfoPort=50070>
> ****
>
> dir****
>
> 2012-08-14 16:51****
>
> rwxr-xr-x****
>
> hdfs****
>
> hadoop****
>
> ** **
>
> Should I create a sub-directory under user with the following permission?*
> ***
>
> h<http://cdh-slave2-16g.hwhadoop.com:50075/browseDirectory.jsp?dir=%2Fuser&namenodeInfoPort=50070>
> ive****
>
> dir****
>
> 2012-08-14 16:51****
>
> rwxr-xr-x****
>
> hive****
>
> hadoop****
>
>
> Thanks,****
>
> Sean****
>
>  ****
>
> ** **
>
> ** **
>
>
>
> ****
>
> ** **
>
> --
> Thanks & Regards
> Himanish****
>



-- 
Thanks & Regards
Himanish