Dear:

Wechat group "Apache Linkis community Development group "chat records are as 
follows:  微信群"Apache Linkis 社区开发群"的聊天记录如下:

 

—————  2022-10-11  —————

flow node setup and reuse problems ————— 2022-10-11 —————

Zosimer  21:17

sqoop executes fine in Exchange is, workflow is always killed

 

Zosimer  21:17

What is the reason for this

 

peacewong@WDS  21:55

Did you see where the kill was initiated

 

Li Meng 22:08

The dss node is executed by kill. See the log file of the dss node. Workflow 
that

 

Zosimer  22:17

Little jar

 

Zosimer  22:18

@ Dlimeng_ Li Meng @ peacewong @ WDS

 

Zosimer  22:20

This is the appconn engine

 

Li Meng lift up

Oh oh

 

Zosimer  22:20

This seems to be different from hive

 

Li Meng lift up

Not the same

 

Zosimer  22:22

this

 

Zosimer  22:25

Meng Ge

 

Zosimer  22:25

Why is there no sqoop jar in this engine

 

Zosimer  22:30

Now report unzip error

 

Mr. Lightning 22:33

Install the default appconn

 

Zosimer  22:36

This is engine's appconn

 

Zosimer  22:36

How do you install it?

 

Zosimer  22:36

@utopianet_ Silver Credit card _ Joaquin

 

Li Meng passed

There is no

 

Zosimer  22:38

This is not the appconn of dss

 

Mr. Lightning 22:38

You misreported the eventcheck as

 

Zosimer  22:39

Where did he generate this zip

 

Zosimer  22:39

dss is good

 

Mr. Lightning 22:39

Installation package Yes

 

Li Meng yea

@Zosimer

 

Li Meng when

It's an engine. We have to throw it in the linkis ec

 

Zosimer  22:40

He now appears to be corrupted while generating this zip

 

Zosimer  22:40

Decompression fails

 

Li Meng"

Oh, oh, reset it. Let's reload it

 

Zosimer  22:55

Mengge, found a problem, is I re-upload a zip, start sh engineConnExec.sh, the 
compressed package will become 0k

 

Li Meng 23:04

Oh, there it is. This one has to track the parameters of the link. This one is 
appconn. That execute script? The same thing happens when you send a request 
from the web, right?

 

Zosimer  23:05

appcoon's engine will do just that

 

Zosimer  23:10

Sounds like there's a bug in this method

 

Li Meng signify

Server unzip command is available

 

Li Meng ephron;

?

 

Zosimer  23:26

I really need to see it

 

Zosimer  23:27

There are

 

Zosimer  23:28

Debug the code = 9

 

Zosimer  23:30

If I unzip it manually, I get no error

 

Zosimer  23:31

Then execute the sh script

 

-- -- -- 2022-10-12 -- -- -- -

Mr. Flash 07:20

zip unzip Both commands are required

 

Zosimer  07:22

I found the reason. Before decompressing, I will go to hdfs to download the 
package again. However, I do not know what happened to the package on hdfs

Zosimer  21:17

sqoop在exchangis里面执行没问题,工作流里面老是被kill

 

Zosimer  21:17

这是什么原因

 

peacewong@WDS  21:55

有看哪里发起的kill吗

 

李孟  22:08

这两个地方执行链路不一样,这dss node 执行被kill 看下dss 那个node执行日志传参看下。workflow那个

 

Zosimer  22:17

少了jar

 

Zosimer  22:18

@Dlimeng_李孟 @peacewong@WDS 

 

Zosimer  22:20

这个是appconn引擎

 

李孟  22:20

哦哦

 

Zosimer  22:20

这个好像跟hive还不一样

 

李孟  22:20

不一样的

 

Zosimer  22:22

这个

 

Zosimer  22:25

孟哥

 

Zosimer  22:25

这个引擎里面为什么没有sqoop的jar

 

Zosimer  22:30

现在报解压错误

 

闪电先生  22:33

要安装一下默认的appconn

 

Zosimer  22:36

这个是engine的appconn

 

Zosimer  22:36

怎么安装啊

 

Zosimer  22:36

@utopianet_广银信用卡_张华金 

 

李孟  22:36

没有

 

Zosimer  22:38

他这个不是dss的appconn

 

闪电先生  22:38

你报错这个eventcheck是

 

Zosimer  22:39

他这个zip哪里生成的

 

Zosimer  22:39

dss里面的好的

 

闪电先生  22:39

安装包有的

 

李孟  22:39

@Zosimer

 

李孟  22:40

这是个引擎,得扔linkis ec 里面

 

Zosimer  22:40

他现在是生成这个zip的时候好像损坏了

 

Zosimer  22:40

导致解压失败

 

李孟  22:42

哦哦,重置一下,重新加载下

 

Zosimer  22:55

孟哥,发现一个问题,就是我重新上传一个zip,启动sh engineConnExec.sh,这个压缩包就会变成0k

 

李孟  23:04

哦哦看到效果了,这个还得追踪下链路的参数,这个是appconn 那个执行脚本?从web端发请求也会这样?

 

Zosimer  23:05

就appcoon的引擎会这样

 

Zosimer  23:10

感觉像这个方法有bug啊

 

李孟  23:15

服务器 unzip 命令是有的吧

 

李孟  23:16

?

 

Zosimer  23:26

还真要看看

 

Zosimer  23:27

有

 

Zosimer  23:28

debug 这个code=9

 

Zosimer  23:30

我手动解压就不报错

 

Zosimer  23:31

然后再执行sh 脚本就正常了

 

—————  2022-10-12  —————

闪电先生  07:20

zip unzip二个命令都需要

 

Zosimer  07:22

找到原因了,是解压前,都会去hdfs重新下载,然而hdfs上的不知道什么情况,是损坏的压缩包

 

Reply via email to