After lots of trial-and-error I managed to start Kylin Web application
without any exceptions.
Here's the summary in short
* We are running HDP 2.4.2
* HBase server 1.1.2 on Slider
* Kylin installed on an edge node outside the cluster (Kerebros keytab
files are configured on the edge node)
- Kylin node have hbase-client-1.1.2.2.3.4.7-4.jar
- from Kylin node ,I can access hive,hbase CLIs sucessfully
I merged "1.5.x-HBase1.x" into "master" branch and built the binary
package.Managed to solve previous errors related to Spring
initialization/library mismatch..etc
Now I can login to the Kylin UI.However,I cannot see the hive database
list in the UI, When I give the table name manually , it throws the error
"NoSuchObjectException" even though I can see this database/table using
"hive" CLI.
----------------------
java.io.IOException: NoSuchObjectException(message:default.test01 table
not found)
at
org.apache.kylin.source.hive.HiveSourceTableLoader.extractHiveTables(HiveSourceTableLoader.java:102)
at
org.apache.kylin.source.hive.HiveSourceTableLoader.reloadHiveTables(HiveSourceTableLoader.java:74)
at
org.apache.kylin.rest.service.CubeService.reloadHiveTable(CubeService.java:553)
at
org.apache.kylin.rest.service.CubeService$$FastClassBySpringCGLIB$$17a07c0e.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
------------------------------
I see following logs as well :
2016-09-12 02:37:30,263 INFO [http-bio-7070-exec-9]
metastore.HiveMetaStore:756 : 2: get_table : db=default tbl=test01
2016-09-12 02:37:30,264 INFO [http-bio-7070-exec-9]
HiveMetaStore.audit:367 : ugi=udana/[email protected]
ip=unknown-ip-addr cmd=get_table : db=default tbl=test01
2016-09-12 02:37:30,264 INFO [http-bio-7070-exec-9]
metastore.HiveMetaStore:599 : 2: Opening raw store with implemenation
class:org.apache.hadoop.hive.metastore.ObjectStore
2016-09-12 02:37:30,265 INFO [http-bio-7070-exec-9]
metastore.ObjectStore:294 : ObjectStore, initialize called
2016-09-12 02:37:30,268 INFO [http-bio-7070-exec-9] DataNucleus.Query:77 :
Reading in results for query "org.datanucleus.store.rdbms.query.SQLQuery@0"
since the connection used is closing
2016-09-12 02:37:30,268 INFO [http-bio-7070-exec-9]
metastore.MetaStoreDirectSql:140 : Using direct SQL, underlying DB is DERBY
2016-09-12 02:37:30,268 INFO [http-bio-7070-exec-9]
metastore.ObjectStore:277 : Initialized ObjectStore
1) Why Kylin cannot retrieve Hive databases/tables?
2) Do I have to configure the Kerebros keytab file with Kylin?
