Hello Lea,
>From the log trace, we can see it is a guava version conflict issue. There
are multiple guava jar appeared on Kylin's classpath, and one is
incompatible with the Hadoop version, causing this issue. As we don't
have the environment, so we couldn't determine what's the problem. You may
need to locate it and try to exclude it from the classpath.
java.lang.NoSuchMethodError:
com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
at
org.apache.hadoop.conf.Configuration.set(Configuration.java:1380)
~[hadoop-common-3.1.1.7.1.7.0-551.jar:?]
at
org.apache.hadoop.conf.Configuration.set(Configuration.java:1361)
~[hadoop-common-3.1.1.7.1.7.0-551.jar:?]
Best regards,
Shaofeng Shi 史少锋
Apache Kylin PMC,
Apache Incubator PMC,
Email: shaofeng...@apache.org
Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscr...@kylin.apache.org
Join Kylin dev mail group: dev-subscr...@kylin.apache.org
Chu, Lea <lea....@garmin.com.invalid> 于2023年3月27日周一 15:26写道：
> Hi Shaofeng, Xiaoxiang,
>
> Thanks for your kind reminder.
> The attached file is the zip folder including snapshot of Kylin web and
> log file. The content of error log also shows below.
> I'm looking forward to your reply. Thank you.
>
>
> Regards,
> Lea
> Mail: lea....@garmin.com
>
>
>
> 2023-03-27T14:38:05,237 ERROR [http-bio-7070-exec-5]
> controller.CubeController:419 :
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
> java.lang.NoSuchMethodError:
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
> at
> org.apache.hadoop.conf.Configuration.set(Configuration.java:1380)
> ~[hadoop-common-3.1.1.7.1.7.0-551.jar:?]
> at
> org.apache.hadoop.conf.Configuration.set(Configuration.java:1361)
> ~[hadoop-common-3.1.1.7.1.7.0-551.jar:?]
> at
> org.apache.kylin.common.util.HadoopUtil.healSickConfig(HadoopUtil.java:88)
> ~[kylin-core-common-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.common.util.HadoopUtil.getCurrentConfiguration(HadoopUtil.java:74)
> ~[kylin-core-common-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.common.KylinConfigBase.getHdfsWorkingDirectory(KylinConfigBase.java:310)
> ~[kylin-core-common-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.common.KylinConfigBase.getJobTmpDir(KylinConfigBase.java:2774)
> ~[kylin-core-common-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.common.KylinConfigBase.getJobTmpMetaStoreUrl(KylinConfigBase.java:2752)
> ~[kylin-core-common-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.engine.spark.job.JobStepFactory.addStep(JobStepFactory.java:67)
> ~[kylin-spark-engine-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.engine.spark.job.NSparkCubingJob.create(NSparkCubingJob.java:104)
> ~[kylin-spark-engine-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.engine.spark.job.NSparkCubingJob.create(NSparkCubingJob.java:58)
> ~[kylin-spark-engine-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.engine.spark.SparkBatchCubingEngineParquet.createBatchCubingJob(SparkBatchCubingEngineParquet.java:44)
> ~[kylin-spark-engine-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.engine.EngineFactory.createBatchCubingJob(EngineFactory.java:61)
> ~[kylin-core-job-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.rest.service.JobService.submitJobInternal(JobService.java:262)
> ~[kylin-server-base-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.rest.service.JobService.submitJob(JobService.java:223)
> ~[kylin-server-base-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:416)
> [kylin-server-base-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:386)
> [kylin-server-base-4.0.0.jar:4.0.0]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:1.8.0_151]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_151]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_151]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_151]
> at
> org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
> [spring-web-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
> [spring-web-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:854)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:765)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.FrameworkServlet.doPut(FrameworkServlet.java:883)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
> [servlet-api.jar:?]
> at
> org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
> [servlet-api.jar:?]
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> [catalina.jar:7.0.100]
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> [catalina.jar:7.0.100]
> at
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> [tomcat7-websocket.jar:7.0.100]
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> [catalina.jar:7.0.100]
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> [catalina.jar:7.0.100]
>
> 2023-03-27T14:38:05,242 ERROR [http-bio-7070-exec-5]
> controller.BasicController:65 :
> org.apache.kylin.rest.exception.InternalErrorException:
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
> at
> org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:420)
> ~[kylin-server-base-4.0.0.jar:4.0.0]
> at
> org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:386)
> ~[kylin-server-base-4.0.0.jar:4.0.0]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:1.8.0_151]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_151]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_151]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_151]
> at
> org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
> ~[spring-web-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
> ~[spring-web-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
> ~[spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:854)
> ~[spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:765)
> ~[spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
> ~[spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at
> org.springframework.web.servlet.FrameworkServlet.doPut(FrameworkServlet.java:883)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
> [servlet-api.jar:?]
> at
> org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
> [spring-webmvc-4.3.26.RELEASE.jar:4.3.26.RELEASE]
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
> [servlet-api.jar:?]
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> [catalina.jar:7.0.100]
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> [catalina.jar:7.0.100]
> at
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> [tomcat7-websocket.jar:7.0.100]
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> [catalina.jar:7.0.100]
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> [catalina.jar:7.0.100]
>
>
>
> -----Original Message-----
> From: ShaoFeng Shi <shaofeng...@apache.org>
> Sent: Thursday, March 23, 2023 9:55 AM
> To: dev@kylin.apache.org
> Cc: Hsu, Joe <joe....@garmin.com>; Fan, Garrick <garrick....@garmin.com>
> Subject: Re: Question about install Kylin in CDH7.1.7
>
> CAUTION - EXTERNAL EMAIL: Do not click any links or open any attachments
> unless you trust the sender and know the content is safe.
>
>
> Hello Lea,
>
> The two screenshots you provided wasn't able to show up (they appear as
> blank); If you can copy the error log in text, that would be great. I guess
> it is a Hadoop version issue, but not sure until see the error message.
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC,
> Apache Incubator PMC,
> Email: shaofeng...@apache.org
>
> Apache Kylin FAQ:
> https://urldefense.com/v3/__https://kylin.apache.org/docs/gettingstarted/faq.html__;!!EJc4YC3iFmQ!XlI1cfp1xPuQFwg4tMH6bLKgR5rtk1YgHu92WX7Jqru7moCMh1wtxHWCjWnMjveULWoGEZcHXCXKqmPhAeo6$
> Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin
> dev mail group: dev-subscr...@kylin.apache.org
>
>
>
>
> Chu, Lea <lea....@garmin.com.invalid> 于2023年3月20日周一 17:47写道：
>
> > Hi Developers from Kylin,
> >
> >
> >
> > Greeting from Lea, data engineer in Garmin Taiwan.
> >
> > I saw that the newest CDH version passed installation tests is CDH
> > 6.3.2 in Kylin official website. But our Hadoop cluster installs in
> > Cloudera private cloud version 7.1.7. I still try to install Kylin
> > 4.0.0 binary package on the master node in CDH7.1.7 environment.
> > Unfortunately, the error messages occurred when I tried to build a
> > cube, which show below. It seems that the jar “hadoop-common” only
> > supports up to 3.0.0, rather than 3.1.1.
> >
> > Did any developers face this situation before or can give me some
> > advice about this?
> >
> > I’m looking forward to your replies. Thank you.
> >
> >
> >
> >
> >
> > Regards,
> >
> > Lea Chu
> >
> > Mail: lea....@garmin.com
> >
> >
> >
> >
> >
> >
>
