[DISCUSS]Schedulis is integrated with dss

Fang Jin Ask A question, if schedulis and dss are installed on different machines, dss stand-alone version is installed on machine A (including hadoop\hive\spark), and schedulis is installed on machine B, then when configuring azkaban.properties of schedulis, hadoop.home= hadoop.conf.dir= hive.h

[DISCUSS]Mysql conn error

Fang Jin The mysql connection I configured in schedulis-exec/web with azkaban.properties is as follows database.type=mysql mysql.port=3306 mysql.host=my_ip mysql.database=schedulis mysql.user=root mysql.password=pwd mysql.numconnections=100 And command line execution # mysql -uroot -ppwd -hmy_ip .

[DISCUSS]Upload engine conn to bml problem

Jie @Youth passes upload engine conn to bml Was the problem solved later? I saw that some people on git said there was a problem with scala2.12 version, but I used 2.12 for clustering. If 2.11 version appeared, other services would not be able to get up. Youth passes I'm using 2.12, the gate

[DISCUSS] Unable to create new scripts and new directories

Unnecessary The /tmp/linkis folder now exists, but the system tells me that the local root directory does not exist, so I cannot create a new script and create a new directory Zhang Huajin Are there any files in this directory What user did you log in with Unnecessary I just looked at em

[DISCUSS]Constructor threw exception

Youth passes Constructor threw exception; nested exception is java.lang.NoClassDefFoundError: org/apache/linkis/common/utils/Logging$class @Jie Is this error encountered Jie Seems to have encountered NoClassDefFoundError: org/apache/linkis/common/utils/Logging$class Delete linkis-gateway-

[DISCUSS] Qualitis indicator association

Pluto Guys, the qualitis indicator is not correlated with the rule did it happen? I can't pick a rule in the index piece. There's no rule @Zhang Huajin @GZCB Have I encountered this problem Zhang Huajin Index association rule? I'm afraid it's not backwards It should be a rule association

[DISCUSS]linkis-cg-engineplugin configuration

Dumbness Guys, where is the linkis-cg-engineplugin configured for this I reported an error while executing the dispatch Looks like it's not booting up because it's looking for the configuration center Zhang Huajin Add the following parameter to the two PRO files added to linkis dss

[DISCUSS]Qualitis failed to initiate the assignment

Star qualitis performed a task and the task initialization failed. An error on top. Why Qingyi sell drunk dust See only this one, configure the mysql connection address Zhang Huajin Look at the configuration file and look for hive.meta Star @Zhang Huajin @GZCB, do you know the general rea

[DISCUSS]DSS integrates visualis

Fang Jin Is the workflow interface of DSS a page integrated with visualis? Zhang Huajin https://www.bilibili.com/video/BV1xY4y1t7Ma/?buvid=Y54F115DE49BDC1E4893934DDBF024C1CF56&is_story_h5=false&mid=HbSPY7IrFHktyJUZi%2BLvQQ%3D%3D&p=1&share_from=ugc&share_medium=iphone&share_plat=ios&share_session

[DISCUSS]Set YARN URL parameters

Fang Jin I feel that sql component execution is called yarn ResourceManagerRest.html#Cluster_New_Application_API, if so, Why the YARN_RESTFUL_URL must be fixed in dss-links/conf/config.sh, and isn't it better to add the yarn_restful_url parameter to the sql component Zhang Huajin The Settings

[DISCUSS]Linkis ExternalOperationFailedException

Pluto request to DolphinScheduler failed. Caused by: create process definition. com.webank.wedatasphere.dss.standard.common.exception.operation.ExternalOperationFailedException: errCode: 90051 ,desc: request to DolphinScheduler failed. Caused by: create process definition ,ip: dss-service ,port:

[DISCUSS]Linkis Front-end login error occurs after the deployment is complete

Jie After the deployment of linkis, the front-end login error was reported. It is because the service is abnormal or the configuration is wrong. Zhang Huajin @Jie can look at the section of the official website about troubleshooting and optimization and try to find the specific error log for f

[DISCUSS]The management desk reports insufficient resources

Dumbness The management console reports that CPU resources in the cluster queue are insufficient. Contact the group personnel to release resources. How should I deal with this, brother @Zhang Huajin Zhang Huajin Increase resources Dumbness Admin add configuration or what, hardware or change

[DISCUSS]DSS database table and Linki database table relationship

Dumbness Big guy, what is the relationship between DSS database table and Linki database table Zhang Huajin Look at the official website has the command to compile the image Dumbness Is the data of DSS the same as that of linkis Zhang Huajin It's usually a database Dumbness DSS can be

[DISCUSS]qualitis configuration

Star Does the boss know the configuration for Qualitis Zhang Huajin This one doesn't need to be touched Star Yeah, that's not in the documentation Zhang Huajin It doesn't say why it's moving Star I made an error. I traced the source code to this Zhang Huajin This data source service?

[DISCUSS]Qualitis configuration problem

Star @Zhang Huajin @GZCB big man, please ask me a question, qualitis selection data source is empty, do you know where I configured the problem Zhang Huajin This is not enabled Star The Add data source menu on the left is not enabled, right Zhang Huajin Data sources are not currently supp

[DISCUSS]linkis1.3 Connects hive2.1.1

Qingyi sell drunk dust There is no big linkis1.3 connected to hive2.1.1-cdh6.3.2 Zhang Huajin This shouldn't be too hard. No questions Qingyi sell drunk dust Throw MysqlSyntaxErrorException It seems that the linkis library was read while reading the hive metadata Zhang Huajin This is a

[DISCUSS]A discussion of sql component submission tasks

Fang Jin The Yarn resource management address is stored in the config field of linkis_cg_rm_external_resource_provider in the Linkis database table. The field is in json format, and the rmWebAddress value is the Yarn resource management address. Multiple addresses can be separated by semicolons.

Re: Hive on Tez

Hello, thanks for using apache linkis. Linkis supports hive 2.33 by default. If you want to use hive of other versions, see Engine Connector plug-in. Link address: https://linkis.apache.org/docs/latest/engine-usage/hive/ - Original Message - From: arjun s To: dev@linkis.apache.org Subjec

[DISCUSS]Workflow publishing error

Fang jin Click "Publish" Times error on workflow interface, 2023-01-14 01:36:13.856 It is found by looking at the code PublishServiceImpl.java // Just to find out if you need to publish all OrCs, you can just take the first AppInstance. AppInstance appInstance = schedulerAppConn.getAppDesc(

[DISCUSS]Linkis compiles the Flink engine connector plugin

pluto Have you guys compiled linkis flink engine yet? If I change to 1.13.0 flink engine, do I just need to change the configuration here? Zhang Huajin @pluto Check the flink engine description on the official website. It says how do you support version 13 pluto The default flink engine wri

[DISCUSS]Hadoop configuration file directory

Star Sun I would like to ask you a question from @Zhang Huajin @GZCB. I reconfigured HADOOP_CONF_DIR in profile. Does this error need to be configured in linkis Zhang Huajin .bashprofile Star Sun Ok Star Sun The configuration file is simple. Check it out https://github.com/apache/incub

[DISCUSS]Flink compilation problem

pluto Big guys, I can't compile 2.11 and 2.12 either. How's that Zhang Huajin I mean compile the Flink software, not the Flink engine Jian Duoduo Did you install JDK pluto I already installed it Zhang Huajin The engine I compiled was fine, 2.11 pluto There are only three changes I h

[DISCUSS]LinkisManager failed to compile errors

Star @Zhang Huajin @GZCB Big man, I encountered the error that LinkisManager compilation failed, please help me to answer it. I had compiled the plug-in and put it in the linkis/lib/linkis-engineconn-plugins directory, linkis also restarted, and executed exchangis task to report this error Zh

[DISCUSS]Sqoop engine compilation problem

Star @Zhang Huajin @GZCB Big guy, I compiled the Sqoop engine myself, I looked at the table and there was no data The DSS and linkis versions are 1.1.1 Zhang Huajin When the ecp starts, the engine directory is scanned and uploaded to the hdfs View ecp logs Star OK. Star @Zhang Huaji

[DISCUSS]DSS package size issues discussed

Zhang Huajin Has anyone deployed dss 1.1.1? Is the front end only 7.45MB packaged? Star I have this 101m @Star Is the DSS 1.1.1 front-end compiled separately? Star No Assert I front-end pack 28M Zhang Huajin DSS 1.1.1 front-end? Something's wrong. I'm only 7.5M Burd It was in th

[DISCUSS]DSS uses multiple data sources

Fang Jin Can DSS use databases other than mysql underneath? Execution in the DSS workflow interface was fine, but after publishing to the schedulis, execution failed in the schedulis Zhang Huajin See schedulis/schedulis_0. 7.0 _exec/plugins/jobtypeslinkis/plugin. The properties of the confi

[DISCUSS]Synchronous use of datax for exchangis

Zhang Wei Have a big boss used exchangis datax synchronization, I now operate down, here reported null pointer, for help Zhang Huajin Is this the development version Zhang Wei No, just version 1.0.0 Zhang Huajin This version is not supported Zhang Wei Both data sources have been publis

[DISCUSS] Linkis 1.3.0 compile error

Cow Hello, jacktao007, I would like to ask Linkis1.3.0 compilation times error, how to solve this casion https://github.com/apache/linkis/issues/1991#issuecomment-1102361240 I think that's the question Cow Yes, thank you very much 牛 @jacktao007 你好，请问Linkis1.3.0编译时报错，这个怎么解决 casion h

[DISCUSS]The jobtype.lib.dir configuration

The God of gods If my linkis version is 1.2.0, which directory should I configure for jobtype.lib.dir in the previous image? Is there a god who knows? Zhang Huajin This is from the scheduling software We can find different paths The God of gods Is that so? Ok, I'll try. Thank you. @Zhang

[DISCUSS]Multi datasource call

Aaron Does anyone here debug code for too many data sources Why this argument over here is empty Zhang Huajin This parameter should not be used Aaron I made a mistake in the last step The log looks like authentication failed Zhang Huajin This has nothing to do with that parameter

[DISCUSS]A discussion of generating historical tasks

The chat history of the wechat group "Apache Linkis Community Development Group "is as follows The tree The big boys. In this way, the task submitted by OnceEngineConn does not generate historical tasks and only the task submitted through the execute interface generates a job? peacewong@WDS

[DISCUSS]Add profile modification

fly-cutter 16:00 After packaging several times just now, the hadoop version of this shade module may also be defined in the shade package, and the version variable cannot be changed into other versions, otherwise the package of shade will contain hadoop of two client versions. It is not clear wh

[DISCUSS]Change profile name

Xu Ling 10:03 The profile name can be changed, for example, spark-2.4-on-hadoop3. Is this feasible? fly-cutter Do we need to add a spark3 profile if we add spark 2.x? spark seems to have some version dependencies related to scala Xu Ling https://github.com/jackxu2011/linkis/blob/feature-p

[DISCUSS]Specify the hadoop version and shared dependency

Xu Ling 09:42Is it possible to add a spark-2.4 profile to the spark-plugin to specify the hadoop version and shared dependency? Because this shared doesn't seem to be useful for hadoop3 with normally supported versions My spark is 3.2 not 2.4 fly-cutterThis is OK. If users repackage spar

Re: [VOTE] Release Apache Linkis 1.3.1-RC2

+1 (non-binding) I checked: 1. All download links are valid. 2. Checksum and signature are OK. 3. LICENSE and NOTICE are exist. 4. Build successfully on Windows. - Original Message - From: 朱辉 To: dev@linkis.apache.org Subject: [VOTE] Release Apache Linkis 1.3.1-RC2 Date: 20

Re: [VOTE] Release Apache Linkis 1.3.1-RC1

+1 (non-binding) Checked: 1. All download links are valid 2. Checksum and signature are OK 3. LICENSE and NOTICE exist 4. Build successfully on Windows - Original Message - From: 朱辉 To: dev@linkis.apache.org Subject: [VOTE] Release Apache Linkis 1.3.1-RC1 Date: 2023-01-05 2

Re: [VOTE] Graduate Apache Linkis (Incubating) as a TLP

+1 Since using Apache Linkis, we have saved a lot of resources and greatly improved efficiency. I support Linkis to graduate from the Apache incubator and become a top-level Apache project. - Original Message - From: Shuai Di To: dev@linkis.apache.org Subject: [VOTE] Graduate Apache Link

Re: [DISCUSS] Invite external collaborators with the triage role on GitHub

Thanks for the invitation. I'd like to be a collaborator. My gitHub Id is aiceflower. - Original Message - From: Chen Xia To: dev Subject: [DISCUSS] Invite external collaborators with the triage role on GitHub Date: 2022-11-11 20:24 Hi all: We can assign external collaborators with the

回复：[DISCUSS] Graduate Apache Linkis (Incubating) as a TLP

+1 Since I joined the linkis project, I have seen our project became more active and diverse. I think we are ready to graduate. Best regards kinghao - 原始邮件 - 发件人：Shuai Di 收件人：dev@linkis.apache.org 主题：[DISCUSS] Graduate Apache Linkis (Incubating) as a TLP 日期：2022年11月01日 21点59分 Hi Linkis

回复：[VOTE] Release Apache Linkis (Incubating) 1.3.0-RC2

+1 (non-binding) I checked: 1. All download links are valid 2. Checksum and signature are OK 3. LICENSE and NOTICE are exist 4. Build successfully on Windows 5. ASF license RAT check is correct - 原始邮件 - 发件人：legendtkl 收件人：dev@linkis.apache.org 主题：[VOTE] Release Apache

2022-09-07 Minutes of the bi-weekly meeting of Apache

2022-09-07 Minutes of the bi-weekly meeting of Apache Linkis(incubating) 1. Apache Linkis incubation & version progress synchronization. (1) No progress has been made in the VPN IP address change(2) Code formatting 58 modules, 45 have been merged, and PR has been proposed to merge 12(3) There are

Apache Linkis(incubating) bi-weekly meeting 2022-09-07

Conference Theme：Apache Linkis(incubating) bi-weekly meetingMeeting Time：2022/09/07 19:30-21:00 (GMT+08:00) China Standard Time - BeijingClick the link to join the meeting, or add to the meeting list：https://meeting.tencent.com/dm/cE6SdQIoSDEJ#Tencent Conference：396-220-298Meeting Host：JinfuHao

回复：Re: Re: [VOTE] Release Apache Linkis (Incubating) 1.2.0-RC1

Yes - 原始邮件 - 发件人：Sherlock Homles 收件人：dev@linkis.apache.org 主题：Re: Re: [VOTE] Release Apache Linkis (Incubating) 1.2.0-RC1 日期：2022年08月23日 23点49分 +1 approve(binding) [YES] Download links are valid. [YES] Checksums and PGP signatures are valid. [YES] Source code distributions have correct na

回复：回复：Re: [VOTE] Release Apache Linkis (Incubating) 1.2.0-RC1

yes - 原始邮件 - 发件人： 收件人："" 主题：回复：Re: [VOTE] Release Apache Linkis (Incubating) 1.2.0-RC1 日期：2022年08月23日 21点18分 yes - 原始邮件 - 发件人："cas...@apache.org" 收件人：dev 主题：Re: [VOTE] Release Apache Linkis (Incubating) 1.2.0-RC1 日期：2022年08月23日 17点58分 +1 (non-binding) I checked - The checksums a

回复：Re: [VOTE] Release Apache Linkis (Incubating) 1.2.0-RC1

yes - 原始邮件 - 发件人："cas...@apache.org" 收件人：dev 主题：Re: [VOTE] Release Apache Linkis (Incubating) 1.2.0-RC1 日期：2022年08月23日 17点58分 +1 (non-binding) I checked - The checksums and signatures are validate. - LICENSE and NOTICE file look good to me. - There is DISCLAIMER - No unlicensed compiled