I have no doubt that works, but surely a Hive user should not need sudo privileges! I am also looking for best practices, since we have run into the same.
From: Himanish Kushary [mailto:himan...@gmail.com] Sent: Thursday, August 16, 2012 9:51 AM To: user@hive.apache.org Subject: Re: Hive directory permissions We usually start the shell thru sudo,otherwise we get a "Permission denied" while creating Hive tables. But this is a good point, any suggestions/best practices from the user community ? Thanks On Thu, Aug 16, 2012 at 9:37 AM, Connell, Chuck <chuck.conn...@nuance.com<mailto:chuck.conn...@nuance.com>> wrote: I have run into similar problems. Thanks for the suggestions. One concern... Isn't hdfs a highly privileged user within the Hadoop cluster? So do we really want it to be standard practice for all Hive users to su to hdfs? Chuck Connell Nuance R&D Data Team Burlington, MA From: Himanish Kushary [mailto:himan...@gmail.com<mailto:himan...@gmail.com>] Sent: Thursday, August 16, 2012 9:30 AM To: user@hive.apache.org<mailto:user@hive.apache.org> Subject: Re: Hive directory permissions Hi Sean, >From the Hive language manual - "Moreover, we strongly advise users to create >the HDFS directories /tmp and /user/hive/warehouse (aka hive.metastore.warehouse.dir) and set them chmod g+w before tables are created in Hive" My warehouse directory has the following permissions: Name Type Size Replication Block Size Modification Time Permission Owner Group warehouse<http://h-node02:50075/browseDirectory.jsp?dir=%2Fuser%2Fhive%2Fwarehouse&namenodeInfoPort=50070&nnaddr=hdfs01:8020> dir 2012-08-15 15:51 rwxrwxr-x hdfs supergroup Also I make sure that I run the hive CLI as 'hdfs' user. Hope this helps Thanks Himanish On Thu, Aug 16, 2012 at 1:50 AM, Sean Bigdatafun <sean.bigdata...@gmail.com<mailto:sean.bigdata...@gmail.com>> wrote: I ran the following command trying to setup my hive directory, but got the following error. root@cdh-client:/# hadoop fs -mkdir /user/hive/warehouse mkdir: org.apache.hadoop.security.AccessControlException: Permission denied: user=root, access=WRITE, inode="/user":hdfs:hadoop:drwxr-xr-x Can someone tell me what is the "correct" ownership for hive directories? My "/user" directory is with the following ownership: user<http://cdh-slave2-16g.hwhadoop.com:50075/browseDirectory.jsp?dir=%2Fuser&namenodeInfoPort=50070> dir 2012-08-14 16:51 rwxr-xr-x hdfs hadoop Should I create a sub-directory under user with the following permission? h<http://cdh-slave2-16g.hwhadoop.com:50075/browseDirectory.jsp?dir=%2Fuser&namenodeInfoPort=50070>ive dir 2012-08-14 16:51 rwxr-xr-x hive hadoop Thanks, Sean -- Thanks & Regards Himanish -- Thanks & Regards Himanish
