Dear:

Wechat group "Apache Linkis community Development group "chat records are as 
follows:  微信群"Apache Linkis 社区开发群"的聊天记录如下:

 

—————  2022-10-12  —————

reactor 14:05




Everyone, has anyone used linkis-1.2.0 jdbc engine? There is a problem at 
present, please consult







reactor 14:05




The error stack information is as follows:




寻找大海的鱼.reactor  14:05

各位大佬,有人使用过linkis-1.2.0版本的jdbc引擎吗? 目前遇到一个问题,请教一下




寻找大海的鱼.reactor  14:05

报错堆栈信息如下: 

 2022-10-11 16:18:06.631 [INFO ] [ConcurrentEngineConnThreadPool1         ] 
o.a.l.m.e.j.e.JDBCEngineConnExecutor (94) [$anonfun$executeLine$3] - The jdbc 
connection has created successfully!

2022-10-11 16:18:06.640 [INFO ] [ConcurrentEngineConnThreadPool1         ] 
o.a.l.m.e.j.e.JDBCEngineConnExecutor (106) [executeLine] - create statement is: 
 com.mysql.cj.jdbc.StatementImpl@3a137d10

2022-10-11 16:18:06.661 [INFO ] [ConcurrentEngineConnThreadPool1         ] 
o.a.l.m.e.j.e.JDBCEngineConnExecutor (109) [executeLine] - Is ResultSet 
available ? : true

2022-10-11 16:18:06.661 [INFO ] [ConcurrentEngineConnThreadPool1         ] 
o.a.l.m.e.j.e.JDBCEngineConnExecutor (112) [executeLine] - ResultSet is 
available

2022-10-11 16:18:06.907 [ERROR] [ConcurrentEngineConnThreadPool1         ] 
o.a.l.m.e.j.e.JDBCEngineConnExecutor (131) [executeLine] - Cannot run show 
tables java.lang.NoClassDefFoundError: 
org/apache/hadoop/tracing/SpanReceiverHost

at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634) 
~[hadoop-hdfs-2.7.2.jar:?]

at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619) 
~[hadoop-hdfs-2.7.2.jar:?]

at 
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
 ~[hadoop-hdfs-2.7.2.jar:?]

at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3303) 
~[hadoop-common-3.2.1.jar:?]

at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124) 
~[hadoop-common-3.2.1.jar:?]

at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3352) 
~[hadoop-common-3.2.1.jar:?]

at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3320) 
~[hadoop-common-3.2.1.jar:?]

at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:479) 
~[hadoop-common-3.2.1.jar:?]

at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:227) 
~[hadoop-common-3.2.1.jar:?]

at 
org.apache.linkis.hadoop.common.utils.HDFSUtils$$anon$2.run(HDFSUtils.scala:126)
 ~[linkis-hadoop-common-1.2.0.jar:1.2.0]

at org.apache.linkis.hadoop.common.utils.HDFSUtils$$anon$2.run(HDFSUti

reactor 14:06


If you look at the situation, it's


[linkis - hadoop - common - 1.2.0. Jar: 1.2.0]


Dependent on [hadoop - common - 3.2.1. Jar:?]


Dependent on [hadoop - HDFS - 2.7.2. Jar:?] , using the kind of org. Apache. 
Hadoop. Tracing. SpanReceiverHost




Class 1, org. Apache. Hadoop. Tracing. SpanReceiverHost belongs to the hadoop - 
common - XXX. Jars, and hadoop - common - 3.2.1. Jar version there is no such, 
This class is included in the lower version of hadoop-common-2.7.2.jar;






2, plan to upgrade the version of hadoop-hdfs, found that hadoop-HDFS-3.x.jar 
and hadoop-HDFS-2.8.5. jar and the version of hadoop-HDFS-2.7.2. jar, many 
classes are missing




Mr Flash 14:10


This is not a reactor. Do you have a hadoop version of 2.7.2?




This is not a reactor 14:11


We use hadoop at 3.2.1




Mr Flash 14:12


About hadoop 3, there seems to be a description on the official website, please 
check




Fish in the sea.reactor 14:13


Thank you. Do you refer to linkis' official website?




Mr. Flash 14:13


Wait a moment




Mr Flash 14:17


https://linkis.apache.org/zh-CN/docs/latest/development/linkis-compile-and-package




This is not a reactor 14:18


Thank you very much, boss. Let me take a look




reactor 14:26 (Reactor 14:26


This place, when we compile, has been changed to hadoop-hdfs-client [facepface]




reactor 14:50 (Reactor 14:50


Is there somewhere else in the project that indirectly references the 
hadoop-hdfs package




Mr. Flash 14:50


2.7.1 It does seem that it shouldn't




Mr Flash 14:52


Look hbase - server


None of the dependencies under the slider-core are quite right




reactor 14:56 (Reactor 14:56


Well, hadoop-hdfs-2.x and hadoop-hdfs-client-3.x have many classes with the 
same name

寻找大海的鱼.reactor  14:06

情况分析下来,就是

[linkis-hadoop-common-1.2.0.jar:1.2.0]

依赖于[hadoop-common-3.2.1.jar:?]

依赖于[hadoop-hdfs-2.7.2.jar:?],使用到了类org.apache.hadoop.tracing.SpanReceiverHost




1,类org.apache.hadoop.tracing.SpanReceiverHost 
属于hadoop-common-xxx.jar包,而hadoop-common-3.2.1.jar版本里面没有此类,低版本的hadoop-common-2.7.2.jar中包含此类;





2,打算升级hadoop-hdfs的版本,发现hadoop-hdfs-3.x.jar和hadoop-hdfs-2.8.5.jar等高版本,与hadoop-hdfs-2.7.2.jar这个版本差距甚大,很多类都没有了




闪电先生  14:10

@寻找大海的鱼.reactor 你本身hadoop是什么版本 是2.7.2吗?




寻找大海的鱼.reactor  14:11

我们使用hadoop是3.2.1




闪电先生  14:12

关于hadoop 3,好像官网有一段描述,你找找看




寻找大海的鱼.reactor  14:13

谢谢,你指的官网,是指linkis的吗?




闪电先生  14:13

稍等




闪电先生  14:17

https://linkis.apache.org/zh-CN/docs/latest/development/linkis-compile-and-package




寻找大海的鱼.reactor  14:18

非常感谢大佬,我先看看




寻找大海的鱼.reactor  14:26

这个地方,我们编译的时候,已经修改成hadoop-hdfs-client了[捂脸]




寻找大海的鱼.reactor  14:50

是不是项目里面还有其它地方间接地引用了hadoop-hdfs包




闪电先生  14:50

2.7.1确实好像不应该啊




闪电先生  14:52

看起来hbase-server

slider-core下面的依赖都不太对




寻找大海的鱼.reactor  14:56

嗯,hadoop-hdfs-2.x和hadoop-hdfs-client-3.x好多重名的class



















--

Best Regards
------
康悦 ritakang 
GitHub:Ritakang0451
E-mail:rita0...@163.com

Reply via email to