What’s the Kylin Version? Is the same version between the Kylin you build cube and the Kylin you run the query?
Thanks, Dong Original Message Sender:Phillip [email protected] Recipient:[email protected] Date:Tuesday, May 3, 2016 04:02 Subject:Re: NullPointerException in .CubeHBaseEndpointRPC$1.run Another view of that error message, but more focused this time: 2016-05-03 05:01:21,430 DEBUG [http-bio-7070-exec-6] enumerator.OLAPEnumerator:107 : query storage... 2016-05-03 05:01:21,448 INFO [http-bio-7070-exec-6] v2.CubeStorageQuery:251 : exactAggregation is true 2016-05-03 05:01:21,453 INFO [http-bio-7070-exec-6] v2.CubeStorageQuery:357 : Memory budget is set to: 3109290 2016-05-03 05:01:21,467 INFO [http-bio-7070-exec-6] dict.DictionaryManager:385 : DictionaryManager(293972208) loading DictionaryInfo( loadDictObj:true) at /dict/DEFAULT.KYLIN_CAL_DT/CAL_DT/1e616ceb-1028-4268-a743-38a79c2d09ae.dict 2016-05-03 05:01:21,506 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:256 : New scanner for current segment kylin_sales_cube[20 120101000000_20160501000000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-05-03 05:01:21,524 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:291 : Serialized scanRequestBytes 321 bytes, rawScanBytes String 46 bytes 2016-05-03 05:01:21,524 INFO [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:294 : The scan(s) info for current segment is as below, s hard part of start/end key is set to 0 2016-05-03 05:01:21,526 INFO [http-bio-7070-exec-6] v2.CubeHBaseRPC:309 : Visiting hbase table KYLIN_JFVKIFVB8S: cuboid exact match, from 64 to 64 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00) Stop: \ x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00@\xFF\xFF\xFF\x00), No Fuzzy Key 2016-05-03 05:01:21,527 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:300 : Submitting rpc to 1 shards starting from shard 0, s can requests count 1 2016-05-03 05:01:21,613 INFO [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:125 : Timeout for ExpectedSizeIterator is 60000 2016-05-03 05:01:21,625 DEBUG [http-bio-7070-exec-6] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-05-03 05:01:21,630 ERROR [pool-3-thread-1] v2.CubeHBaseEndpointRPC:98 : Execution exception when running task in pool-3-thread-1 2016-05-03 05:01:21,632 ERROR [pool-3-thread-1] v2.CubeHBaseEndpointRPC:108 : Caught exception in thread pool-3-thread-1: java.lang.NullPointerException at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$1.run(CubeHBaseEndpointRPC.java:326) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Thanks, Phil On Mon, May 2, 2016 at 3:51 PM, Phillip Rhodes [email protected] wrote: Kylin crew: I'm still trying to get Kylin working on MapR Hadoop, and now I'm seeing the following error when trying to run a query through the Kylin web interface. Building the cube seems to work OK, but this happens at query time. Any ideas? --------------------------------------------------- 2016-05-03 04:34:25,036 DEBUG [http-bio-7070-exec-8] service.CacheService:149 : The new temp olap json is :{ "version": "1.0", "defaultSchema": "DEFAULT", "schemas": [ { "type": "custom", "name": "DEFAULT", "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory", "operand": { "project": "LEARN_KYLIN" }, "functions": [ { name: 'MASSIN', className: 'org.apache.kylin.query.udf.MassInUDF' } ] } ] } 2016-05-03 04:34:25,055 DEBUG [http-bio-7070-exec-8] service.QueryService:289 : getting table metas 2016-05-03 04:34:25,056 DEBUG [http-bio-7070-exec-8] service.QueryService:307 : getting column metas 2016-05-03 04:34:25,068 DEBUG [http-bio-7070-exec-8] service.QueryService:321 : done column metas 2016-05-03 04:34:30,695 INFO [http-bio-7070-exec-3] controller.QueryController:174 : Using project: learn_kylin 2016-05-03 04:34:30,696 INFO [http-bio-7070-exec-3] controller.QueryController:175 : The original query: select part_dt, sum(price) as total_selled, count(distinct seller_id) as sellers from kylin_sales group by part_dt order by part_dt 2016-05-03 04:34:30,697 INFO [http-bio-7070-exec-3] service.QueryService:265 : The corrected query: select part_dt, sum(price) as tot al_selled, count(distinct seller_id) as sellers from kylin_sales group by part_dt order by part_dt LIMIT 50000 2016-05-03 04:34:31,218 INFO [http-bio-7070-exec-3] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.meta data.project.ProjectManager@5c4a45fc 2016-05-03 04:34:31,219 INFO [http-bio-7070-exec-3] routing.QueryRouter:60 : Find candidates by table DEFAULT.KYLIN_SALES and project =LEARN_KYLIN : org.apache.kylin.query.routing.Candidate@408561ee 2016-05-03 04:34:31,222 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rule s.RemoveUncapableRealizationsRule, realizations before: [kylin_sales_cube(CUBE)], realizations after: [kylin_sales_cube(CUBE)] 2016-05-03 04:34:31,222 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rule s.RealizationSortRule, realizations before: [kylin_sales_cube(CUBE)], realizations after: [kylin_sales_cube(CUBE)] 2016-05-03 04:34:31,222 INFO [http-bio-7070-exec-3] routing.QueryRouter:72 : The realizations remaining: [kylin_sales_cube(CUBE)] And the final chosen one is the first one 2016-05-03 04:34:31,513 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:107 : query storage... 2016-05-03 04:34:31,522 INFO [http-bio-7070-exec-3] v2.CubeStorageQuery:251 : exactAggregation is true 2016-05-03 04:34:31,522 INFO [http-bio-7070-exec-3] v2.CubeStorageQuery:357 : Memory budget is set to: 3109290 2016-05-03 04:34:31,550 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:256 : New scanner for current segment kylin_sales_cube[20 120101000000_20160501000000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-05-03 04:34:31,562 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:291 : Serialized scanRequestBytes 321 bytes, rawScanBytes String 46 bytes 2016-05-03 04:34:31,562 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:294 : The scan(s) info for current segment is as below, s hard part of start/end key is set to 0 2016-05-03 04:34:31,562 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:309 : Visiting hbase table KYLIN_JFVKIFVB8S: cuboid exact match, from 64 to 64 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00) Stop: \ x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00@\xFF\xFF\xFF\x00), No Fuzzy Key 2016-05-03 04:34:31,563 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:300 : Submitting rpc to 1 shards starting from shard 0, s can requests count 1 2016-05-03 04:34:31,582 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:125 : Timeout for ExpectedSizeIterator is 60000 2016-05-03 04:34:31,588 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-05-03 04:34:31,592 ERROR [pool-9-thread-1] v2.CubeHBaseEndpointRPC:98 : Execution exception when running task in pool-9-thread-1 2016-05-03 04:34:31,592 ERROR [pool-9-thread-1] v2.CubeHBaseEndpointRPC:108 : Caught exception in thread pool-9-thread-1: java.lang.NullPointerException at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$1.run(CubeHBaseEndpointRPC.java:326) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2016-05-03 04:35:05,120 INFO [pool-1-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 2 others 2016-05-03 04:35:31,589 ERROR [http-bio-7070-exec-3] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select part_dt, sum(price) as total_selled, count(distinct seller_id) as sellers fro m kylin_sales group by part_dt order by part_dt LIMIT 50000": Timeout visiting cube! at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:356) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:272) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:118) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke(generated) at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$c9bef1fc.query(generated) at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandler Method.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandle rAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdap ter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:1 13) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequ estFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilt er.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProce ssingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:195) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: Timeout visiting cube! at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$ExpectedSizeIterator.next(CubeHBaseEndpointRPC.java:142) at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$ExpectedSizeIterator.next(CubeHBaseEndpointRPC.java:113) at com.google.common.collect.TransformedIterator.next(TransformedIterator.java:48) at com.google.common.collect.Iterators$6.hasNext(Iterators.java:583) at org.apache.kylin.storage.hbase.cube.v2.SequentialCubeTupleIterator.hasNext(SequentialCubeTupleIterator.java:96) at org.apache.kylin.query.enumerator.OLAPEnumerator.moveNext(OLAPEnumerator.java:74) at Baz$1$1.moveNext(Unknown Source) at org.apache.calcite.linq4j.EnumerableDefaults.groupBy_(EnumerableDefaults.java:819) at org.apache.calcite.linq4j.EnumerableDefaults.groupBy(EnumerableDefaults.java:754) at org.apache.calcite.linq4j.DefaultEnumerable.groupBy(DefaultEnumerable.java:302) at Baz.bind(Unknown Source) at org.apache.calcite.jdbc.CalcitePrepare$CalciteSignature.enumerable(CalcitePrepare.java:326) at org.apache.calcite.jdbc.CalciteConnectionImpl.enumerable(CalciteConnectionImpl.java:281) at org.apache.calcite.jdbc.CalciteMetaImpl._createIterable(CalciteMetaImpl.java:545) at org.apache.calcite.jdbc.CalciteMetaImpl.createIterable(CalciteMetaImpl.java:536) at org.apache.calcite.avatica.AvaticaResultSet.execute(AvaticaResultSet.java:187) at org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:65) at org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:44) at org.apache.calcite.avatica.AvaticaConnection$1.execute(AvaticaConnection.java:566) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:578) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 80 more 2016-05-03 04:35:31,591 INFO [http-bio-7070-exec-3] service.QueryService:249 : ==========================[QUERY]=============================== SQL: select part_dt, sum(price) as total_selled, count(distinct seller_id) as sellers from kylin_sales group by part_dt order by part_ dt User: ADMIN Success: false Duration: 0.0 Project: learn_kylin Realization Names: [kylin_sales_cube] Cuboid Ids: [64] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Error while executing SQL "select part_dt, sum(price) as total_selled, count(distinct seller_id) as sellers from kylin_sales group by part_dt order by part_dt LIMIT 50000": Timeout visiting cube! ==========================[QUERY]=============================== 2016-05-03 04:35:31,592 ERROR [http-bio-7070-exec-3] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Error while executing SQL "select part_dt, sum(price) as total_selled, count(d istinct seller_id) as sellers from kylin_sales group by part_dt order by part_dt LIMIT 50000": Timeout visiting cube! at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandler Method.java:96) ------------------- Thanks, Phil
