Thank you. There's only one hive-site.xml.But I found a workaround to solve this issue.
I noticed that in the UI "System->Server Environment " the CLASSPATH value doesn't include the hive/conf folder, even though its detected by the "find-hive-dependenct.sh" script. So , I created a symbolic link to my "hive-site.xml" in "KYLIN_HOME/conf" folder (which is in the CLASSPATH entry list) and now I can see my hive databases/tables. On Tue, Sep 13, 2016 at 10:21 AM, ShaoFeng Shi <[email protected]> wrote: > Your analysis is correct; When it failed to locate the proper > hive-site.xml, it will use default values which is an embeded metadata > store. > > Please search more widely to see whether there is another hive-site.xml on > the classpath. It may hide in hbase's folder or other place. > > 2016-09-12 14:25 GMT+08:00 udana pathirana <[email protected]>: > >> More infomation: >> >> I have a valid 'hive-site.xml" and the folder is added into the "hive >> _dependency" by the "find-hive-dependency.sh" script. >> "hive-site.xml" contains valid "hive.metastore.uris" : >> thrift://hdp-hive01.hadoop.local:9083,thrift://hdp-hive02. >> hadoop.local:9083 >> >> I can see all the databases/tables using hive/beeline client. >> I found that HiveMetaStoreClient look for the hite-site.xml in the class >> path and if its not found, it will fallback to default settings, which is >> DerbDB . but it seems "find-hive-dependency.sh" add the correct folder >> to the class path but still why it doesnt work ? >> >> >> On Mon, Sep 12, 2016 at 11:58 AM, udana pathirana < >> [email protected]> wrote: >> >>> After lots of trial-and-error I managed to start Kylin Web application >>> without any exceptions. >>> >>> Here's the summary in short >>> >>> * We are running HDP 2.4.2 >>> * HBase server 1.1.2 on Slider >>> * Kylin installed on an edge node outside the cluster (Kerebros keytab >>> files are configured on the edge node) >>> - Kylin node have hbase-client-1.1.2.2.3.4.7-4.jar >>> - from Kylin node ,I can access hive,hbase CLIs sucessfully >>> >>> >>> I merged "1.5.x-HBase1.x" into "master" branch and built the binary >>> package.Managed to solve previous errors related to Spring >>> initialization/library mismatch..etc >>> >>> >>> Now I can login to the Kylin UI.However,I cannot see the hive database >>> list in the UI, When I give the table name manually , it throws the error >>> "NoSuchObjectException" even though I can see this database/table using >>> "hive" CLI. >>> >>> ---------------------- >>> java.io.IOException: NoSuchObjectException(message:default.test01 >>> table not found) >>> at org.apache.kylin.source.hive.HiveSourceTableLoader.extractHi >>> veTables(HiveSourceTableLoader.java:102) >>> at org.apache.kylin.source.hive.HiveSourceTableLoader.reloadHiv >>> eTables(HiveSourceTableLoader.java:74) >>> at org.apache.kylin.rest.service.CubeService.reloadHiveTable(Cu >>> beService.java:553) >>> at org.apache.kylin.rest.service.CubeService$$FastClassBySpring >>> CGLIB$$17a07c0e.invoke(<generated>) >>> at org.springframework.cglib.proxy.MethodProxy.invoke(MethodPro >>> xy.java:204) >>> >>> ------------------------------ >>> I see following logs as well : >>> 2016-09-12 02:37:30,263 INFO [http-bio-7070-exec-9] >>> metastore.HiveMetaStore:756 : 2: get_table : db=default tbl=test01 >>> 2016-09-12 02:37:30,264 INFO [http-bio-7070-exec-9] >>> HiveMetaStore.audit:367 : ugi=udana/ins-kylin102.hadoop. >>> [email protected] ip=unknown-ip-addr cmd=get_table : db=default >>> tbl=test01 >>> 2016-09-12 02:37:30,264 INFO [http-bio-7070-exec-9] >>> metastore.HiveMetaStore:599 : 2: Opening raw store with implemenation >>> class:org.apache.hadoop.hive.metastore.ObjectStore >>> 2016-09-12 02:37:30,265 INFO [http-bio-7070-exec-9] >>> metastore.ObjectStore:294 : ObjectStore, initialize called >>> 2016-09-12 02:37:30,268 INFO [http-bio-7070-exec-9] >>> DataNucleus.Query:77 : Reading in results for query >>> "org.datanucleus.store.rdbms.query.SQLQuery@0" since the connection >>> used is closing >>> 2016-09-12 02:37:30,268 INFO [http-bio-7070-exec-9] >>> metastore.MetaStoreDirectSql:140 : Using direct SQL, underlying DB is >>> DERBY >>> 2016-09-12 02:37:30,268 INFO [http-bio-7070-exec-9] >>> metastore.ObjectStore:277 : Initialized ObjectStore >>> >>> >>> >>> 1) Why Kylin cannot retrieve Hive databases/tables? >>> 2) Do I have to configure the Kerebros keytab file with Kylin? >>> >> >> > > > -- > Best regards, > > Shaofeng Shi > >
