[Discuss] Switch the development branch to Master

2023-06-20 Thread peacewong
Now there are two problems based on dev branch development: 1. The activity of Github statistics is based on Master, which will lead to low activity 2. It is inconvenient for new contributors to submit PR, and there is a communication cost It is recommended to switch the development branch to Mast

[Discuss] Linkis 1.5.0 version feature discussion

2023-05-25 Thread peacewong
Core features: 1. Entrance supports task HA (running task support is taken over) 2. Support task submission to the K8S cluster 3. Support Nacos 4. Entrance supports Orchestrator pluggable 5. The once-mode task supports recording information through the entrance 6. The data source module supports da

[DISCUSS]Support Gaussdb dataSources

2023-05-06 Thread king hao
Hi,all Support Gaussdb dataSources Best Regards, kinghao

[DISCUSS]optimize serialize-write resource and fair schedule child queue logic

2023-05-06 Thread king hao
Hi,all 1、we should use resource constructor with paramters,instand of default empty resource constructor 2、optimize fair schedule child queue logic to make it reasonable . Best Regards, kinghao

[DISCUSS]Unable to start embedded Jetty server

2023-05-06 Thread king hao
Hi,all An error occurred when submitting a job using linkis-cli-sqoop. The ecm log prompts org. springframework.boot.web.server.WebServerException: Unable to start embedded Jetty server Best Regards, kinghao

[DISCUSS]EC onProgressUpdate should to send ResponseTaskRunningInfo

2023-05-06 Thread king hao
Hi,all 1. JDBC、Presto、Trino EC will to pushProgress org.apache.linkis.engineconn.computation.executor.execute.EngineExecutionContext#pushProgress 2. org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl#onTaskStatusChanged send error protocol, s

[DISCUSS]Reduce mixed language module linkismange

2023-05-04 Thread king hao
Hi,all Reduce mixlanguage module linkismange. Translate linkis-application-manager and linkis-manager-common module from Scala to Java. Best Regards, kinghao

[DISCuSS]remove unused code

2023-05-04 Thread king hao
Hi,all remove unused code and optimize code to avoid possible risk. Best Regards, kinghao

[DISCUSS]How to adapt to Huawei cluster MRS?

2023-05-02 Thread king hao
Hi,all I tried to configure the Yarn of Huawei cluster to run SparkSQL, but it was not successful. I checked the source code and found that Huawei Yarn uses the Superior Scheduler and does not provide the/ws/v1/cluster/scheduler interface, which resulted in a resource request failure. Do i need to

[DISCUSS]Linkis configuration error

2023-05-02 Thread king hao
Hi,all The EXTERNAL_RESOURCE_REFRESH_TIME parameters of providerCache are incorrectly configured Best Regards, kinghao

[DISCUSS]FsPathTest should skip windows

2023-05-02 Thread king hao
Hi,all for windows mvn clean install [ERROR] Failures: [ERROR] FsPathTest.testGetSchemaPath:40 expected: but was: Best Regards, kinghao

[DISCUSS]remove unused code

2023-05-02 Thread king hao
Hi,all Remove unused code and optimize code to avoid possible risk. Best Regards, kinghao

[DISCUSS]No plugin found spark-2.4.8

2023-04-27 Thread king hao
- Hi,all - Excuse me, I am under the one-click installation deployment package deployment. - No plugin found spark-2.4.8 after installation. Best Regards, kinghao

[DISCUSS]publish docker and publish snapshot actions run error

2023-04-18 Thread king hao
Hi all, publish docker and publish snapshot actions run error Best Regards, kinghao

[DISCUSS] executeUser may no permission to access engineConnExec.sh

2023-04-18 Thread king hao
Steps to reproduce 1. make any parent path of ENGINECONN_ROOT_DIR to no execute permission for others. For example, ENGINECONN_ROOT_DIR is /home/hadoop/linkis/tmp, and /home/hadoop permission is rwx-- (In fact, default permission of user home is exactly this in centos) 2. use non-hadoop user as

[DISCUSS]inconsistent property name in linkis-manager

2023-04-11 Thread king hao
Hi all, Change wds.linkis.engineConn.dist.load.enable value on file linkis/conf/linkis-cg-linkismanager.properties to false, the refreshAll() function was still triggered.. Best Regards, kinghao

[DISCUSS]convert scala modules to java

2023-04-11 Thread king hao
Hi all, Linkis uses a lot of scala code, which is not friendly to many developers. Consider converting scala code to java code. Best Regards, kinghao

[DISCUSS]Rectification of permissions of linkis

2023-03-29 Thread 康悦Rita
scriptis does not support the configuration of a task, and is unreasonable. There are also frequent problems with communication between dss systems A: Linkis should be done independently rather than relying on dss. It is proposed to discuss public services: metadata services are currently too weak

[DISCUSS]Scripts navigation bar display issues

2023-03-29 Thread 康悦Rita
hi all, This is a question discussed by the WeChat group. Q: "After installing schedules and appconn, how to display them on the right side of the navigation bar scripts on the Dss homepage? Do you need any configuration?" A: Authorization Best Regards -- 康悦 ritakang GitHub:Ritakang045

[DISCUSS]Control all engines

2023-03-29 Thread 康悦Rita
hi all, This is a question discussed by the WeChat group. Q: Excuse me, is there any way to control the total number of all engines (regardless of type)? A: See if you can change the code to remove this restriction. You can try it Best Regards -- 康悦 ritakang GitHub:Ritakang0451 E-mail:

[DISCUSS]Configure the permissions of Hadoop management users

2023-03-29 Thread 康悦Rita
hi all, This is a question discussed by the WeChat group. Q: "The root user I installed previously, but now configure the Hadoop management user to grant all permissions, only reinstalling Dss+linkis, Spark, and the like." A: No need to reinstall. Chown and change the configuration file; Hd

[DISCUSS]Troubleshooting MySQL data import failure to hive

2023-03-28 Thread 康悦Rita
Hi all, This is a question discussed by the WeChat group. Q: "I failed to import MySQL data to hive using sqoop, and I did not see the error log. How do I troubleshoot it?" tail -f /opt/dss_ linkis/linkis1.3.1/LinkisInstall/logs/*.log /opt/dss_ linkis/dss/logs/*.log A: Save, exit, a

[DISCUSS]Hadoop, hive deployment

2023-03-28 Thread 康悦Rita
Hi all, This is a question discussed by the WeChat group. Q: "Not on the same machine, do you want to deploy on the same machine as Hadoop and hive?" A: Just install the client Best Regards -- 康悦 ritakang GitHub:Ritakang0451 E-mail:rita0...@163.com

[DISCUSS] ARM Deployment

2023-03-28 Thread 康悦Rita
Hi all, This is a question discussed by the WeChat group. Q: Can linkis 1.3.1 and dss 1.1.1 be deployed directly on ARM? A: It is possible for other students in the community to have tested it. Best Regards -- 康悦 ritakang GitHub:Ritakang0451 E-mail:rita0...@163.com

[DISCUSS]Remote debugging

2023-03-28 Thread 康悦Rita
Hi all, This is a question discussed by the WeChat group. Q: Did you encounter this error with the dss-workflow-server-dev service during remote debugging? A: Should be missing appconn Best Regards -- 康悦 ritakang GitHub:Ritakang0451 E-mail:rita0...@163.com

[DISCUSS]the exchange of Oracle data to MySQL

2023-03-27 Thread 康悦Rita
Hi all, This is a question discussed by the WeChat group. Q: Can I complete the exchange of Oracle data to MySQL? A: Datax can Best Regards -- 康悦 ritakang GitHub:Ritakang0451 E-mail:rita0...@163.com

[DISCUSS] Elasticsearch data source

2023-03-27 Thread 康悦Rita
hi all, This is a question discussed by the WeChat group. Q: Is it necessary to have an account name and password for the Elasticsearch data source? A: Change the database, linkis_ ps_ dm_ datasource_ type_ key data_ source_ type_ id=2 key=username or key=password require=0 UP

[DISCUSS]How to authorize

2023-03-27 Thread 康悦Rita
hi all, This is a question discussed by the WeChat group. Q: How to authorize? A: Workspace Management Permission Information Edit Related Components Best Regards -- 康悦 ritakang GitHub:Ritakang0451 E-mail:rita0...@163.com

[DISCUSS]Log output to the management console to perform historical tasks

2023-03-27 Thread 康悦Rita
dear all, Q: "To output the logs of certain packages to the task log of the management console's execution history, which configuration file should be modified?" A: The corresponding engine plug-in should be modified in log4j2.xml. You can refer to Best Regards -- 康悦 ritakang GitHub:R

[DISCUSS]Added this copilot for pr

2023-03-27 Thread 康悦Rita
dear all , https://githubnext.com/projects/copilot-for-pull-requests/ By @ Dlimeng_ Li Meng recommended that he apply to join this pilot for pr on the waitlist for various projects under Linkis repo under Apache and WeDataSphere under WeBankFintech. Best Regards -- 康悦 ritakang GitHub:R

[DISCUSS]The result set of Linkis should support direct push

2023-03-23 Thread peacewong
Hi all, The result set of Linkis should support direct push, to further optimize the performance of Linkis. Best Regards, Peace Wong

[DISCUSS]The number of modules of Linkis needs to be optimized

2023-03-23 Thread peacewong
Hi all, The number of modules of Linkis needs to be optimized, the number of modules should be reduced as much as possible, and multiple modules should be merged into one. Best Regards, Peace Wong

[DISCUSS]The task ID of Linkis should be passed to the underlying engine

2023-03-23 Thread peacewong
Hi all, The task ID of Linkis should be passed to the underlying engine to facilitate the application analysis and blood relationship analysis of the underlying engine Best Regards, Peace Wong

[DISCUSS]

2023-03-22 Thread peacewong
Hi all, The judgment of the task log path should be asynchronously placed when the log is written. [1] https://github.com/WeDataSphere/linkis/pull Best Regards, Peace Wong

[DISCUSS]Linkis should remove JSON4S dependency

2023-03-22 Thread peacewong
Hi all, Linkis should remove JSON4S dependency[1]. [1]https://github.com/apache/linkis/pull/4368/files Best Regards, Peace Wong

[DISCUSS]Linkis docbase submission to docsgpt

2023-03-21 Thread peacewong
Hi all, The Linkis document library is submitted to docsgpt, which supports the Q&A of documents through GPT[1]. [1]https://github.com/apache/linkis/discussions/4381 Best Regards, Peace Wong

[DISCUSS]Linkis 1.3.2 supports Hive multi-version compatibility

2023-03-21 Thread peacewong
Hi all, I propose that Linkis 1.3.2 supports Hive multi-version compatibility, which is more convenient for users to compile and deploy, List of versions: 1.2.x, 2.x, 3.x. Welcome to discuss. Best Regards, Peace Wong

[DISCUSS]Linkis 1.3.2 supports Spark multi-version compatibility

2023-03-21 Thread peacewong
Hi all, I propose that Linkis 1.3.2 supports Spark multi-version compatibility, which is more convenient for users to compile and deploy, welcome discuss Best Regards, Peace Wong

[DISCUSS]Linkis JDBC Driver should support passing parameters

2023-03-21 Thread peacewong
Hi all, I propose that Linkis JDBC Driver should support passing parameters, such as supporting parameters such as StartUp and Runtime, for scenarios that support more personalized parameters, welcome to discuss Best Regards, Peace Wong

[DISCUSS]Linkis JDBC Driver should support getting logs

2023-03-21 Thread peacewong
Hi all, I think that Linkis JDBC Driver should support obtaining logs, by adding the getLog method to the statement to obtain the logs of a single task, welcome to discuss Best Regards, Peace Wong

[DISCUSS] I applied to X-Lab's DocsGPT/Hypercrx for training Linkis documents

2023-03-19 Thread Andy
Li Meng 05:38 Recently, I applied to X-Lab's DocsGPT/Hypercrx for training Linkis documents https://github.com/apache/linkis/discussions/4381 If you are interested, you can try it new one 08:50 [Strong][Strong][Strong] peacewong@WDS 08:50 [Strong] [Strong] [Strong] Meng Gezan Sargent Ti 09:11

[DISCUSS] I reported an error when I just created the project

2023-03-19 Thread Andy
Xiao Zhang can't play point guard 20:52 @张华金@GZCB Boss, I reported an error when I just created the project Xiao Zhang can't play point guard 20:52 Currently three plug-ins are integrated, exchangis, schedulis, visualis Roger 20:54 Workflow workflow service configuration check @小张will not play po

[DISCUSS]Can data source management support other jdbc databases?

2023-03-17 Thread Andy
hey hello 11:45 Ladies and gentlemen, besides mysql, can data source management support other jdbc databases? Such as oracle? pg? ZJian 12:32 After modifying the parameters in the management console, why does it still use this configuration? ZJian 12:32 @Which piece of biscuit am I  Casion 12:

[DISCUSS] The linkis document says that the 30001 code

2023-03-17 Thread Andy
Homecoming 09:38 @张华金@GZCB Mr. Zhang, the linkis document says that the 30001 code is the library exceeding the limit Mr Lightning 09:39 This should be available in public services. Homecoming 09:39 public no error logs Homecoming 09:41 This is the public log silver 10:58 In fact, I have alway

[DISCUSS] Does linkis1.3.0 need to add this configuration to start the data source service

2023-03-17 Thread Andy
Y.26-11.23 19:38 Boss, does linkis1.3.0 need to add this configuration to start the data source service? Y.26-11.23 19:43 doesn't seem to Y.26-11.23 20:32 Do you know the reason why exchangeis chooses the data source to report this error? Y.26-11.23 20:32 I think the code is caused by calling

[DISCUSS] ErrCode: 10905

2023-03-17 Thread Andy
Homecoming 19:07 [ERROR] errCode: 10905 ,desc: URL /api/rest_j/v1/linkisManager/createEngineConn request failed! ResponseBody is {"method":"/api/linkisManager/createEngineConn","status":1,"message":" Create engineConn failed, caused by AMErrorException: errCode: 30001 ,desc: Failed to createEn

[DISCUSS] Linkis-mg-gateway access dolphinscheduler error

2023-03-16 Thread Andy
Home on a snowy night 14:59 linkis-mg-gateway access dolphinscheduler error You are not logged in, please login first(You are not logged in, please log in first!) Home on a snowy night 14:59 @张华金@GZCB  Home on a snowy night 14:59 What went wrong? Mr. Lightning 15:00 what did this do Home on a

[DISCUSS] Shedulis scheduling workflow,

2023-03-16 Thread Andy
God of Gods 14:53 shedulis scheduling workflow, visualis service exception, @张华金@GZCB Do you know how to solve it? Here is my workflow Mr. Lightning 14:56 There is a relatively large file Mr. Lightning 14:56 replace it and try again God of Gods 14:57 Where can I find that file? Do you have reso

[DISCUSS] What’s the reason for this?

2023-03-16 Thread Andy
Chen Hao 11:18 @张华金@GZCB Boss, what’s the reason for this? Chen Hao 11:20 Is it related to the error reported in the linkis log? Mr. Lightning 11:21 Um Mr. Lightning 11:21 no authority Chen Hao 11:26 I installed it with qualitis, how come there is a hadoop user? God of Gods 11:30 Change it to

[DISCUSS] Do you have a visualis front-end compilation that is not unsuccessful?

2023-03-15 Thread Andy
ZJian 14:38 Do you have a visualis front-end compilation that is not unsuccessful? Mr. Lightning 14:38 14.17.3 Li Guoliang 14:43 Is the version recommended for compiling the linkis front end? Mr. Lightning 14:47 yes Li Guoliang 14:47 thanks, i'll try Fai 15:00 Is there any article about cluste

[DISCUSS] I wonder if you guys have encountered this problem?

2023-03-15 Thread Andy
Mostly 10:49 I wonder if you guys have encountered this problem? Mostly 10:49 Spark can't connect Mostly 10:50 spark version is 2.4.3 linkis version is 1.0.2 WeDataSphere open source community assistant 10:51 @大半 You can first go to the QA document to find out if there is a solution: https://do

[DISCUSS] Where can I find this question?

2023-03-15 Thread Andy
Ltz ✨ 11:40 Where can I find this question? Ltz ✨ 11:42 A log is also useless entrance Ltz ✨ 11:42 have baoyang 12:22 [Cover your face] The unit of this place, you follow https://github.com/apache/linkis/blob/dev-1.3.2/linkis-engineconn-plugins/flink/src/main/scala/org/apache/linkis /enginecon

[DISCUSS] Flink is not in the dml statement

2023-03-15 Thread Andy
Ltz ✨ 09:12 flink is not in the dml statement case 09:18 If it is submitted by client, it can be specified by parameters. If it is submitted by scriptis, adjust the default engine version configuration case 09:18 https://linkis.apache.org/zh-CN/docs/latest/deployment/version-adaptation baoyang

[DISCUSS] This can't be installed

2023-03-14 Thread Andy
Sun Shibiao. Peach Blossom Island Technology 15:22 This can't be installed. . Richard_T 15:23 Boss, can you help me to see this error report? Richard_T 15:23 NoApplicationExistsException: errCode: 10050 ,desc: Application dss-server is not exists any instances. ,ip: node80 ,port: 9001 ,serviceKi

[DISCUSS] There are many package versions in the warehouse service that cannot be found

2023-03-14 Thread Andy
Zhang Liang 20:11 @张华金@GZCB Teacher, I installed dss 1.1.1, how much should the minimum version of schedules be installed, I see that the source code reaches version 0.7.1, but when Maven compiles, there are many package versions in the warehouse service that cannot be found Mr. Lightning 20:12

[DISCUSS] Have you ever encountered that ps-cs has been unable to release cpu resources after running the workflow

2023-03-14 Thread Andy
Freedom. oO 15:37 Big brother, have you ever encountered that ps-cs has been unable to release cpu resources after running the workflow, and you have to kill it every time and restart it manually [cover your face] Freedom. oO 15:37 @张华金@GZCB  God of Gods 15:38 @自由极意。oO Boss, what kind of schedu

[DISCUSS] This question looks at that service

2023-03-14 Thread Andy
Ltz ✨ 09:59 This question looks at that service Ltz ✨ 10:07 Is there an answer bro? she said 10:09 see ps log she said 10:09 LINKIS-PS-PUBLICSERVICE Ltz ✨ 10:10 watched Ltz ✨ 10:10 No log pops up Ltz ✨ 10:11 The log of ps above Ltz ✨ 10:11 The manager below she said 10:12 Did you ps up Ltz

[DISCUSS]How long does it take for your engine to initialize?

2023-03-13 Thread Andy
Li Guoliang 18:04 How long does it take for your engine to initialize? It takes 4 minutes to execute a shell to initialize the engine. Is there any optimization plan? Li Guoliang 18:04 Or is there any configuration Mr. Lightning 18:05 normal Mr. Lightning 18:06 Add an independent ECM machine M

[DISCUSS] Is there no sqoop engine in linkis version 1.1.1?

2023-03-13 Thread Andy
pluto 10:20 Is there no sqoop engine in linkis version 1.1.1? bosses Fairy and half demon 11:16 @张华金@GZCB Mr. Zhang, did you fill in SOURCE_GROUP_BY_COLUMNS and TARGET_GROUP_BY_COLUMNS in the cross-table full verification page in qualitis? ZJian 11:19 @张华金@GZCB Boss, what is the problem with cre

[DISCUSS] Is there any optimization plan?

2023-03-13 Thread Andy
Li Guoliang 18:04 How long does it take for your engine to initialize? It takes 4 minutes to execute a shell to initialize the engine. Is there any optimization plan? Li Guoliang 18:04 Or is there any configuration Mr. Lightning 18:05 normal Mr. Lightning 18:06 Add an independent ECM machine M

[DISCUSS] Error Code Module Refactoring

2023-03-12 Thread Chen Xia
Current issues: - The definition of the historical error code value is relatively random, the readability needs to be improved, and there are duplication problems, the specification needs to be determined, and the stock needs to be optimized - If the RPC call link is long, the root error will be l

[DISCUSS]About Mybatis mapper format requirements

2023-03-09 Thread Chen Xia
https://github.com/apache/linkis/pull/4293 1. Keywords in sql need to be capitalized select—>SELECT ordey by—>ORDEY BY 2. Qualified names must be written for input parameters and return parameters parameterType="InstanceInfo"—>parameterType="org.apache.linkis.instance.label.entity.Ins

[DISCUSS]About the configure of the token

2023-03-09 Thread Chen Xia
Which cookie am I: Just to ask, the official document seems to need to update the steps for qualitis to access linkis to configure the token. There is no linkis-gateway directory in the linkis $LINKIS_HOME directory of version 1.3.1. How should this be set now? https://github.com/WeBankFinTech/Qual

[DISCUSS] About EC starts via k8s

2023-03-09 Thread Chen Xia
Wechat group "Apache Linkis(incubating) community Development group "chat records are as follows: Lu Xiaolong Ladies and gentlemen, how do you plan to use the client commands and configurations in ec? I plan to make a big data client base mirror mount configuration method. I don't know if there i

[DISCUSS]About the service registration problem

2023-03-07 Thread Chen Xia
Wechat group "Apache Linkis(incubating) community Development group "chat records are as follows: rainbow: @Zhang Huajin: Teacher, may I ask if the dss-guid-server project needs to be injected into eureka? Zhang Huajin: don't want Dream Bubble: Can you share how you build the service? Dream Bu

[DISCUSS]Spark Engine Enable Problem

2023-03-07 Thread Chen Xia
kinghao 3-6 22:48:31 @奇世豪 Brother Shihao, please help me to read this, I got an error when submitting the data_calc task Xi Shihao 3-6 22:49:35 You need to put the mysql driver in the spark ec package kinghao 3-6 22:49:36 I see that linkis-computation-engineconn-1.3.2-SNAPSHOT.jar is in the spark

[DISCUSS]EC submitted to k8s using the operator method

2023-03-07 Thread Chen Xia
Guo Shupei: todo: 1. Whether kill sparkApplication can kill the EC to ensure that the EC exits normally 2. Linkismanager sends a sender request to EC and reports error 401 3. After the operator submits spark, obtain the launch log scheme - implemented in the jar package Wang Heping: 401 errors ca

[DISCUSS]DSS skip problem

2023-03-05 Thread king hao
God Father I click shedulis in DSS to jump to the login interface of shedulis. I feel that there is something wrong with the level 3 specification. There are no errors in the logs of dss and shedulis. Does anyone know how to fix it? Zhang Huajin This issue is fixed in DSS1.1.1. Check out pr

[DISCUSS] Unified engine user

2023-03-05 Thread king hao
Fang Jin Is it possible for all engines to be created by a unified user (such as hadoop), but the execution of code (shell scripts, sql statements, etc.) is still done by the logged-in user? @Zhang Huajin @GZCB Zhang Huajin Yes, just use a proxy user Fang Jin After the proxy user is set,

[DISCUSS]hive and spark user

2023-03-05 Thread king hao
Fang Jin I also set hive and spark to execute with jvm users, but I want to use loginUser to run yarn from the Executor Zhang Huajin Because your loginuser is jvmuser Fang Jin No, I didn't set up a proxy user Zhang Huajin This is the user that started the JVM Fang Jin Ok Fa

[DISCUSS] Linkis execution user

2023-03-05 Thread king hao
Fang Jin Now the create user of the engine is the execute user of the code. I want the engine to be created with hadoop users (similar to how the jdbc engine supports MULTI), but I want different users to be isolated when executing SQL, but the current situation is execute user = engine create use

[DISCUSS]Demultiplexing EC across login users

2023-03-05 Thread king hao
Chen Cheng I want to implement demultiplexing EC across login users. Is this currently possible? Zhang Huajin There are only two concepts discussed above Chen Cheng I find this configuration, I understand that the configuration of a specific type of EC, so that the user label is not cons

[DISCUSS] Deploy Linkis in clusters

2023-03-05 Thread king hao
Chen Cheng Hello @Zhang Huajin @GZCB ask me a question. In a Linkis cluster deployment scenario, is it OK to run only one ECM instance on each physical or virtual machine that needs to run EC?(Similar to the master-slave architecture, the slave service on the slave node only needs to run one insta

[DISCUSS] Windows starts qualitis

2023-03-05 Thread king hao
Wt.Y Has anyone successfully launched qualitis in Windows mode Zhang Huajin Usually on a Linux machine Wt.y I have a lot of problems Zhang Huajin Not on Windows Wt.y Ok, thank you Wt.Y 请问有大佬在Windows模式下成功启动qualitis么 Zhang Huajin 一般都是在Linux机器上 Wt.y 俺遇到了不少问题 Zha

[DISCUSS]linkis-cg-engineplugin start

2023-03-05 Thread king hao
JarOfLove linkis-cg-engineplugin Can't get up have encountered Casion Looks like engine materials failed to upload. You can view the publicservice service logs JarOfLove Yes, there is a problem with hadoop looking at logs Thank you JarOfLove linkis-cg-engineplugin 起不来 有遇到过的么

[DISCUSS]scriptis access hive libraries

2023-03-03 Thread king hao
Jie scriptis needs to access hive library and hive metadata uses pg. Do you need to modify code and add pg driver to access Hive library? @Zhang Huajin @GZCB Zhang Huajin I haven't tried it. I can try it Jie Ok, I'll try Jie scriptis要访问hive的库,hive元数据库用的是pg,是需要修改代码增加pg驱动才能访问吗?@张华金@GZ

[DISCUSS]Fail to upload engine conn to bml

2023-03-03 Thread king hao
Zjian @Zhang Huajin @GZCB, what is the reason for this Fail to upload engine conn to bml. Casion Check to see if the publicservice service didn't work Zjian Ok, thank you Zjian @张华金@GZCB 大佬,请问这个是什么原因 Fail to upload engine conn to bml. Casion 看下是不是publicservice服务没起成功 Zjian

[DISCUSS]Installation error

2023-03-03 Thread king hao
West Chen May I ask if this problem occurs during my installation? Do I need to install eureka by myself? What version is required? First See Do you have more than one network card? West Chen @First See I tried the single network card before installation according to the multi-network ca

[DISCUSS]The first deployment

2023-03-03 Thread king hao
JarOver Guys, does this need to be reinitialized at deployment time Casion The first time you use the deployment, you need to initialize, JarOver Ok, thank you JarOver 大佬们,部署的时候这个需要重新初始化么 Casion 首次使用部署,需要初始化, JarOver 好的,感谢

[DISCUSS]hive from_unixtime format problem

2023-03-02 Thread king hao
Joyven Have you ever encountered the problem that hive's from_unixtime formatting timestamp is one day shorter than the actual timestamp? from_unixtime(cast(decisiondate/1000 as bigint), '-MM-dd') as decisiondate Fly Check to see if the operating system time zone is correct Joyven

[DISCUSS]cg-engineplugin configuration

2023-03-02 Thread king hao
Elena Can @GZCB configure cg-engineplugin not to request the interface when starting Zhang Huajin need Elena Ok, thank you Elena @张华金@GZCB 能配置cg-engineplugin启动时不请求该接口吗 Zhang Huajin 需要 Elena 好的,谢谢

[DISCUSS]Failed to upload engine conn to bml

2023-03-02 Thread king hao
Year @Zhang Huajin @GZCB Please help to look at this problem [apply] - Failed to upload engine conn to bml, now exit! java.net.SocketException: Connection reset Zhang Huajin This means that the service is abnormal, you have to go to the service Year Now the Linkismanager service is

[DISCUSS] The datax task in yarn is faulty

2023-03-02 Thread king hao
Ming Jin If datax task execution is not displayed on yarn, where is the resource used? linkis? @Zhang Huajin @GZCB Li Meng datax tasks do not use yarn. The used resources can be seen on the resource manager Ming Jin Oh, I see However, the mission details are not visible in the global

[DISCUSS]qualitis matches the system version

2023-03-01 Thread king hao
Peng Bo Can qualitis tool be used with CentOS 7.9 operating system Zhang Huajin available Peng Bo Ok, thank you Peng Bo 麻烦问下,qualitis工具可以使用CentOS 7.9 的操作系统吗 Zhang Huajin 可以 Peng Bo 好的,谢谢

[DISCUSS] Does dss1.1.1 support linkis 1.3.0

2023-03-01 Thread king hao
Almost Does dss1.1.1 support linkis 1.3.0? @Zhang Huajin@GZCB Zhang Huajin support Almost Are hive3.1.2 and hadoop3 supported? @Zhang Huajin @GZCB Zhang Huajin @Almost It is recommended to see the version adaptation section on the official website Almost Ok, thank you Almos

[DISCUSS]Failed to upload materials for the first time. Procedure

2023-03-01 Thread king hao
Cookie During installation, the material call interface /api/rest_j/v1/bml/upload request failed! is uploaded for the first time. Have you ever met one? Fly I think some services are not up. Look at the Eureka service Cookie Ok, let me check It is true that the service is incompl

[DISCUSS]Failed to run Hive on Scripts

2023-03-01 Thread king hao
Li Guoliang Scripts failed to run Hive, but can run successfully in the local, the boss has time to help check sh bin/linkis-cli -submitUser hadoop -engineType hive-1.1.0_cdh5.7.0 -codeType hql -code "show tables" linkis cli can run successfully, engine directory is lib/linkis-engineconn-p

[DISCUSS]cdh-hive version configuration

2023-02-28 Thread king hao
Guoliang Li wds.linkis.hive.engine.version=1.1.0-cdh5.7.0 Is this configuration correct for cdh-hive version I feel that there is a problem. The hive plugin cannot be found dumbness @Guoliang Li This one doesn't allow horizontal lines Guoliang Li Thank you. I'll try again dum

[DISCUSS]Installation package upload Tencent cloud

2023-02-28 Thread king hao
Enjoyyin @hy Help upload to Tencent cloud hy What kind of environment is this Enjoyyin Is the binary installation package, uploaded to Tencent cloud hy Which account? I haven't used this before hy Have uploaded Enjoyyin Ok, thank you Enjoyyin @hy 帮忙上传一下到腾讯云 hy 这个

[DISCUSS]qualities index management module

2023-02-28 Thread king hao
IsBai Do you know about qualities? What is the function of the indicator management module? Can the problem data be distributed? Zhang Huajin Faulty data is stored in hive by default. Indicator management is used to do statistical analysis flying How to use the index management module.

[DISCUSS] spark engine jar package problem

2023-02-28 Thread king hao
silver Teachers have a question for you. linkis-engineplugin-spark-1.3.1.jar is not copied from linkis-engineconn-plugins Zhang Huajin The logic is as follows: At startup, upload the local engine to HDFS, download the engine management service from HDFS, generate a soft connection to the

[DISCUSS]Do scala scripts support flink

2023-02-27 Thread king hao
Tree @peacewong@WDS Does the Brother of Peace scala script currently have a flink supported environment? @peacewong@WDS There is no flink support yet, you can refer to the flink sql executor to implement a PR commit Tree I'll look into it Tree @peacewong@WDS 和平兄 scala脚本目前有支持了flink的环

[DISCUSS]The file permission setting is incorrect

2023-02-27 Thread king hao
She Say @peacewong@WDS Big Guy file permission Settings This is a bit of a problem Special permissions such as rwt will report errors Deng Jie Write 777 what do not have other rights all kinds of components are a little bit of a problem security problems through professional software

[DISCUSS] Workflow delay node

2023-02-27 Thread king hao
Tree There is no such thing as a delay node in the big guy workflow. Is there a good solution to this scenario Bao Yang Write a py to sleep? hcl Write a shell script wait? Tree That's what we came up with. That's how you guys do it She Say Write a request that is so resource-in

[DISCUSS]How to configure to receive off-day signals

2023-02-27 Thread king hao
hcl The node cannot be accepted after the signal node only.receive.today is set to false after SendFlag defaults to false, so at this level of logic, how do you configure to accept off-day signals. @Enjoyyin@WDS @peacewong@WDS @peacewong@WDS @Burd Take a look hcl @peacewong@WDS only.

[DISCUSS]Linkis' discussion on the rules for creating new data source icon

2023-02-18 Thread binbincheng
Wechat group "Apache Linkis community Development group " chat records are as follows: r@Fy2 Big men, are there any rules for adding the data source icon? Mr. Lightning: Pay attention to copyright! r@Fy2 Can you copy it from their official websites? Mr. Lightning: Notice whether the open

[DISCUSS]Some questions about linkis configuration kerberos authentication

2023-02-17 Thread binbincheng
Wechat group "Apache Linkis community Development group " chat records are as follows: magnificent: KrbException: Cannot locate default realm java.lang.IllegalArgumentException: KrbException: Cannot locate default realm magnificent: Linkis configures kerberos authentication. Has anyone encoun

[DISCUSS]Some discussions about how the redirection in GateWay is realistic

2023-02-17 Thread binbincheng
Wechat group "Apache Linkis community Development group " chat records are as follows: she says: @peacewong@WDS How to implement redirection in gateway Jiuxian layman: @she said   You can check the redirectto configuration in gatewayfilter. Generally, you can configure applicationyaml Jiuxi

[DISCUSS] Discussion about linkis calling seaTunnel related issues

2023-02-17 Thread binbincheng
Wechat group "Apache Linkis community Development group " chat records are as follows: South of: I operate seaTunnel with the codename linkis. The results of the query have been found in the log. But the follow-up still reported an error. Codename also shows failure. What is the reason? So

[DISCUSS]Spark v3.1.1 DSS one-click installation

2023-02-08 Thread 康悦Rita
Dear: Wechat group "Apache Linkis(incubating) community Development group "chat records are as follows: 微信群"Apache Linkis(incubating) 社区开发群"的聊天记录如下 — 2023-2-2 — Hua 15:04 华 15:04 If the spark version is 3.1.1, can I use this one-click installation package for dss? 请教下,

  1   2   3   4   5   6   >