P.S. I found StorageDelegationAuthorizationProvider mentioned in the Known Issues section of the HCatalog authorization doc: "A different authorization provider (StorageDelegationAuthorizationProvider) needs to be used for working with HBase tables as well. But that is not well tested."
-- Lefty On Sat, Oct 5, 2013 at 2:44 AM, Lefty Leverenz <leftylever...@gmail.com>wrote: > I'm out of my depth, but based on existing documentation I'll make some > suggestions you could try while waiting for replies from people who > actually know about installation. > > Following Mikhail's lead, since this is an HCatalog security problem > you should start by seeing if HCatalog is installed. Then you could try > changing the value of hive.security.authorization.manager -- I found it > documented in two places: > > - Hive Configuration > Properties<https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Authentication%2FAuthorization> > - HCatalog Storage Based > Authorization<https://cwiki.apache.org/confluence/display/Hive/HCatalog+Authorization#HCatalogAuthorization-ConfiguringStorageSystemBasedAuthorization> > > The HCatalog authorization doc says you need to add the HCatalog jar to > the Hive classpath (add "export HIVE_AUX_JARS_PATH=<*path to hcatalog jar* > >" to hive-env.sh), but I'm not sure if that's needed now that HCatalog > has been integrated with Hive. > > Try changing hive.security.authorization.manager to its default value, > either the one listed in the Hive doc or the one in the HCatalog doc: > > - > > org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider > - org.apache.hcatalog.security.HdfsAuthorizationProvider > > Or you could turn off hive.security.authorization.enabled by setting it to > false (see the HCatalog authorization doc). There's more information about > this property in the Hive Authorization doc's > Prerequisites<https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Authorization#LanguageManualAuthorization-Prerequisites>section. > > Changing configuration property values is documented in Getting Started > (Configuration > management > overview<https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-Configurationmanagementoverview>) > as well as Configuring > Hive<https://cwiki.apache.org/confluence/display/Hive/AdminManual+Configuration#AdminManualConfiguration-ConfiguringHive> > . > > Agreed, the documentation is confusing. We're trying to improve it. > > -- Lefty > > > On Sat, Oct 5, 2013 at 12:53 AM, Baahu <bahub...@gmail.com> wrote: > >> Lefty, >> Can the install instructions given at >> https://cwiki.apache.org/confluence/display/Hive/GettingStarted be >> followed as is? >> I see instructions to build from source code just after "Installing Hive >> from a Stable Release" section, which is kinda confusing.I bump in to the >> error mentioned above while I execute the instructions in "Running Hive" >> section. >> >> Thanks, >> Baahu >> >> >> >> >> On Sat, Oct 5, 2013 at 1:17 PM, Lefty Leverenz >> <leftylever...@gmail.com>wrote: >> >>> Do you have any suggestions for improving the Hive wiki instructions? >>> >>> -- Lefty >>> >>> >>> On Fri, Oct 4, 2013 at 7:30 PM, Baahu <bahub...@gmail.com> wrote: >>> >>>> Apache hive. >>>> On Oct 5, 2013 1:06 AM, "Mikhail Antonov" <olorinb...@gmail.com> wrote: >>>> >>>>> Are you using apache hive or one from cloudera/Horton works? >>>>> >>>>> On Oct 4, 2013, at 11:52, Baahu <bahub...@gmail.com> wrote: >>>>> >>>>> Hi Mikhail, >>>>> I followed the steps mentioned in the Apache hive website, found the >>>>> instructions not so helpful... Is there any good link which provides >>>>> proper >>>>> installation steps. >>>>> >>>>> Thanks >>>>> On Oct 5, 2013 12:07 AM, "Mikhail Antonov" <olorinb...@gmail.com> >>>>> wrote: >>>>> >>>>>> Looks like you have StorageDelegationAuthorizationProvider enabled >>>>>> in hive-site.xml (like below), but hcatalog isn't installed somehow? >>>>>> >>>>>> <property> >>>>>> <name>hive.security.authorization.manager</name> >>>>>> >>>>>> <value>org.apache.hcatalog.security.StorageDelegationAuthorizationProvider</value> >>>>>> <description>the hive client authorization manager class name. >>>>>> The user defined authorization class should implement interface >>>>>> org.apache.hadoop.hive.ql.security.authorization.HiveAuthorizationProvider. >>>>>> HCatalog uses a model, where authorization checks are delegated to the >>>>>> storage layer (hdfs, hbase, ...). >>>>>> </description> >>>>>> </property> >>>>>> >>>>>> >>>>>> >>>>>> 2013/10/4 Baahu <bahub...@gmail.com> >>>>>> >>>>>>> Hi, >>>>>>> Have installed Hive 0.11 in centos.I see the below error when I >>>>>>> execute hive.Can you please help me resolving this. >>>>>>> >>>>>>> [root@centosvm bin]# hive >>>>>>> 13/10/04 09:05:35 WARN conf.HiveConf: DEPRECATED: Configuration >>>>>>> property hive.metastore.local no longer has any effect. Make sure to >>>>>>> provide a valid value for hive.metastore.uris if you are connecting to a >>>>>>> remote metastore. >>>>>>> >>>>>>> Logging initialized using configuration in >>>>>>> jar:file:/opt/hive-0.11.0-bin/lib/hive-common-0.11.0.jar!/hive-log4j.properties >>>>>>> Hive history >>>>>>> file=/tmp/root/hive_job_log_root_8553@centosvm_201310040905_1657489660.txt >>>>>>> Exception in thread "main" java.lang.RuntimeException: >>>>>>> org.apache.hadoop.hive.ql.metadata.HiveException: >>>>>>> java.lang.ClassNotFoundException: >>>>>>> org.apache.hcatalog.security.StorageDelegationAuthorizationProvider >>>>>>> at >>>>>>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:278) >>>>>>> at >>>>>>> org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:670) >>>>>>> at >>>>>>> org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614) >>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native >>>>>>> Method) >>>>>>> at >>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>>>>>> at >>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>>>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>>>>> at org.apache.hadoop.util.RunJar.main(RunJar.java:160) >>>>>>> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: >>>>>>> java.lang.ClassNotFoundException: >>>>>>> org.apache.hcatalog.security.StorageDelegationAuthorizationProvider >>>>>>> at >>>>>>> org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:342) >>>>>>> at >>>>>>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:272) >>>>>>> ... 7 more >>>>>>> Caused by: java.lang.ClassNotFoundException: >>>>>>> org.apache.hcatalog.security.StorageDelegationAuthorizationProvider >>>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:366) >>>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:355) >>>>>>> at java.security.AccessController.doPrivileged(Native Method) >>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:354) >>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424) >>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357) >>>>>>> at java.lang.Class.forName0(Native Method) >>>>>>> at java.lang.Class.forName(Class.java:270) >>>>>>> at >>>>>>> org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:335) >>>>>>> ... 8 more >>>>>>> >>>>>>> Thanks. >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Thanks, >>>>>> Michael Antonov >>>>>> >>>>> >>> >> >> >> -- >> Twitter:http://twitter.com/Baahu >> >> >
