[GitHub] [inlong] GanfengTan opened a new pull request, #6221: [INLONG-6220][Manager] Support query of DP cluster based on GroupId and protocol

GanfengTan opened a new pull request, #6221: URL: https://github.com/apache/inlong/pull/6221 1. Support query of DP cluster based on GroupId and protocol. 2. The common code to extract the cluster query. - Fixes #6220 ### Motivation Update Manager client, add query DP nodes

[GitHub] [inlong] dockerzhang merged pull request #6211: [INLONG-6209][Manager] Clean and reuse code for DataNode

dockerzhang merged PR #6211: URL: https://github.com/apache/inlong/pull/6211 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated (1b66f581d -> 1299284ac)

This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 1b66f581d [INLONG-6194][Agent] Support parsing metrics for different components (#6195) add 1299284ac [INLO

[GitHub] [inlong] woofyzhao commented on a diff in pull request #6168: [INLONG-6151][Manager] Add data cleansing task and optimize query indexes

woofyzhao commented on code in PR #6168: URL: https://github.com/apache/inlong/pull/6168#discussion_r999029700 ## inlong-manager/manager-dao/src/main/resources/mappers/InlongGroupEntityMapper.xml: ## @@ -211,9 +211,8 @@ select inlong_group_id from inlong_

[GitHub] [inlong] healchow commented on a diff in pull request #6168: [INLONG-6151][Manager] Add data cleansing task and optimize query indexes

healchow commented on code in PR #6168: URL: https://github.com/apache/inlong/pull/6168#discussion_r999034835 ## inlong-manager/manager-dao/src/main/resources/mappers/InlongGroupEntityMapper.xml: ## @@ -211,9 +211,8 @@ select inlong_group_id from inlong_g

[GitHub] [inlong] woofyzhao commented on a diff in pull request #6221: [INLONG-6220][Manager] Support query of DP cluster based on GroupId and protocol

woofyzhao commented on code in PR #6221: URL: https://github.com/apache/inlong/pull/6221#discussion_r999060361 ## inlong-manager/manager-client/src/main/java/org/apache/inlong/manager/client/api/InlongClient.java: ## @@ -224,6 +224,15 @@ static InlongClient create(String service

[GitHub] [inlong] woofyzhao commented on a diff in pull request #6221: [INLONG-6220][Manager] Support query of DP cluster based on GroupId and protocol

woofyzhao commented on code in PR #6221: URL: https://github.com/apache/inlong/pull/6221#discussion_r999067422 ## inlong-manager/manager-client/src/main/java/org/apache/inlong/manager/client/api/InlongClient.java: ## @@ -224,6 +224,15 @@ static InlongClient create(String service

[GitHub] [inlong] haifxu opened a new pull request, #6223: [INLONG-6222][Manager] Fix parse source status failure

haifxu opened a new pull request, #6223: URL: https://github.com/apache/inlong/pull/6223 ### Prepare a Pull Request - Fixes #6222 ### Motivation  ### Mo

[GitHub] [inlong] GanfengTan commented on a diff in pull request #6221: [INLONG-6220][Manager] Support query of DP cluster based on GroupId and protocol

GanfengTan commented on code in PR #6221: URL: https://github.com/apache/inlong/pull/6221#discussion_r999125418 ## inlong-manager/manager-client/src/main/java/org/apache/inlong/manager/client/api/InlongClient.java: ## @@ -224,6 +224,15 @@ static InlongClient create(String servic

[GitHub] [inlong] EMsnap commented on a diff in pull request #6210: [INLONG-6174][Sort] Mysql connector support meta data with debezium format

EMsnap commented on code in PR #6210: URL: https://github.com/apache/inlong/pull/6210#discussion_r999170494 ## inlong-sort/sort-common/src/main/java/org/apache/inlong/sort/protocol/node/load/KafkaLoadNode.java: ## @@ -226,8 +226,8 @@ public String getMetadataKey(MetaField metaFi

[GitHub] [inlong] EMsnap commented on a diff in pull request #6210: [INLONG-6174][Sort] Mysql connector support meta data with debezium format

EMsnap commented on code in PR #6210: URL: https://github.com/apache/inlong/pull/6210#discussion_r999170494 ## inlong-sort/sort-common/src/main/java/org/apache/inlong/sort/protocol/node/load/KafkaLoadNode.java: ## @@ -226,8 +226,8 @@ public String getMetadataKey(MetaField metaFi

[GitHub] [inlong] thesumery opened a new pull request, #6225: [INLONG-6214][Sort] Import schema and data parsing ability for DynamicSchemaFormat

thesumery opened a new pull request, #6225: URL: https://github.com/apache/inlong/pull/6225 [INLONG-6214][Sort] Import schema and data parsing ability for DynamicSchemaFormat ### Prepare a Pull Request - [INLONG-6214][Sort] Import schema and data parsing ability for DynamicSchemaF

[GitHub] [inlong] fuweng11 opened a new pull request, #6227: [INLONG-6226][Manager] Add a consumption group for each sink

fuweng11 opened a new pull request, #6227: URL: https://github.com/apache/inlong/pull/6227 - Fixes #6226 ### Motivation Add a consumption group for each sink ### Modifications Add a consumption group for each sink ### Verifying this change *(Please pick

[GitHub] [inlong-website] dockerzhang merged pull request #570: [INLONG-6196][Doc] Add configuration doc for Agent

dockerzhang merged PR #570: URL: https://github.com/apache/inlong-website/pull/570 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@i

[inlong-website] branch master updated: [INLONG-6196][Doc] Add configuration doc for Agent (#570)

This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong-website.git The following commit(s) were added to refs/heads/master by this push: new 20aefff918 [INLONG-6196][Doc] Add c

[GitHub] [inlong] gosonzhang opened a new pull request, #6229: [INLONG-6228][DataProxy] Modify the default values of the dataproxy-tube.conf file

gosonzhang opened a new pull request, #6229: URL: https://github.com/apache/inlong/pull/6229 - Fixes #6228 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

[GitHub] [inlong] healchow commented on a diff in pull request #6200: [INLONG-6103][Manager] Support update and save cluster switch info

healchow commented on code in PR #6200: URL: https://github.com/apache/inlong/pull/6200#discussion_r999324200 ## inlong-manager/manager-dao/src/main/java/org/apache/inlong/manager/dao/entity/InlongGroupEntity.java: ## @@ -35,6 +35,7 @@ public class InlongGroupEntity implements S

[inlong] branch master updated (1299284ac -> 3bc4e88d4)

This is an automated email from the ASF dual-hosted git repository. gosonzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 1299284ac [INLONG-6209][Manager] Clean and reuse code for DataNode (#6211) add 3bc4e88d4 [INLONG-6228][DataP

[GitHub] [inlong] gosonzhang merged pull request #6229: [INLONG-6228][DataProxy] Modify the default values of the dataproxy-tube.conf file

gosonzhang merged PR #6229: URL: https://github.com/apache/inlong/pull/6229 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.a

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #6210: [INLONG-6174][Sort] Mysql connector support meta data with debezium format

yunqingmoswu commented on code in PR #6210: URL: https://github.com/apache/inlong/pull/6210#discussion_r999363750 ## inlong-common/src/main/java/org/apache/inlong/common/enums/MetaField.java: ## @@ -62,12 +62,22 @@ public enum MetaField { /** * Represents a canal json

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #6225: [INLONG-6214][Sort] Import schema and data parsing ability for DynamicSchemaFormat

yunqingmoswu commented on code in PR #6225: URL: https://github.com/apache/inlong/pull/6225#discussion_r999379824 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/format/DebeziumJsonDynamicSchemaFormat.java: ## @@ -69,6 +81,49 @@ public List extractP

[inlong] branch master updated: [INLONG-6152][Sort] MySQL connector support filtering kinds of row data (#6173)

This is an automated email from the ASF dual-hosted git repository. zirui pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new bedbb5106 [INLONG-6152][Sort] MySQL connector sup

[GitHub] [inlong] EMsnap merged pull request #6173: [INLONG-6152][Sort] MySQL connector support filtering kinds of row data

EMsnap merged PR #6173: URL: https://github.com/apache/inlong/pull/6173 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apach

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #6202: [INLONG-6054][Manager] Kafka sink supports all migration

yunqingmoswu commented on code in PR #6202: URL: https://github.com/apache/inlong/pull/6202#discussion_r999388571 ## inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/sort/util/LoadNodeUtils.java: ## @@ -162,29 +166,58 @@ public static KafkaLoadNode create

[GitHub] [inlong] vernedeng opened a new pull request, #6230: [INLONG-6216][Manager] Support get group topic info

vernedeng opened a new pull request, #6230: URL: https://github.com/apache/inlong/pull/6230 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be replac

[GitHub] [inlong] dockerzhang merged pull request #6223: [INLONG-6222][Manager] Fix parse source status failure in Command tools

dockerzhang merged PR #6223: URL: https://github.com/apache/inlong/pull/6223 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated: [INLONG-6222][Manager] Fix parse source status failure in Command tools (#6223)

This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 4dee52031 [INLONG-6222][Manager] Fix parse

[GitHub] [inlong] haibo-duan commented on a diff in pull request #6208: [INLONG-6207][Agent] Optimize the unit test TestSQLServerReader

haibo-duan commented on code in PR #6208: URL: https://github.com/apache/inlong/pull/6208#discussion_r998880545 ## inlong-agent/agent-plugins/src/test/java/org/apache/inlong/agent/plugin/sources/TestSQLServerConnect.java: ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache Softwa

[GitHub] [inlong] dockerzhang merged pull request #6199: [INLONG-6231][CVE] Upgrade org.apache.hive:hive-exec to 3.1.3

dockerzhang merged PR #6199: URL: https://github.com/apache/inlong/pull/6199 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated (4dee52031 -> fbd938e0e)

This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 4dee52031 [INLONG-6222][Manager] Fix parse source status failure in Command tools (#6223) add fbd938e0e [IN

[GitHub] [inlong] liaorui opened a new pull request, #6233: [INLONG-6232][Manager]Support Apache Doris load node management

liaorui opened a new pull request, #6233: URL: https://github.com/apache/inlong/pull/6233 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be replaced

[GitHub] [inlong] lucaspeng12138 commented on a diff in pull request #6233: [INLONG-6232][Manager]Support Apache Doris load node management

lucaspeng12138 commented on code in PR #6233: URL: https://github.com/apache/inlong/pull/6233#discussion_r187081 ## inlong-manager/manager-common/src/main/java/org/apache/inlong/manager/common/consts/SinkType.java: ## @@ -36,5 +36,5 @@ public class SinkType { public sta

[GitHub] [inlong] healchow commented on a diff in pull request #6208: [INLONG-6207][Agent] Optimize the unit test TestSQLServerReader

healchow commented on code in PR #6208: URL: https://github.com/apache/inlong/pull/6208#discussion_r189852 ## inlong-agent/agent-plugins/src/test/java/org/apache/inlong/agent/plugin/sources/TestSQLServerConnect.java: ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache Softwar

[GitHub] [inlong] healchow merged pull request #6208: [INLONG-6207][Agent] Optimize the unit test for TestSQLServerReader

healchow merged PR #6208: URL: https://github.com/apache/inlong/pull/6208 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apa

[inlong] branch master updated (fbd938e0e -> 79a6ee02b)

This is an automated email from the ASF dual-hosted git repository. healchow pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from fbd938e0e [INLONG-6231][CVE] Upgrade org.apache.hive:hive-exec to 3.1.3 (#6199) add 79a6ee02b [INLONG-6207][Ag

[GitHub] [inlong] healchow commented on a diff in pull request #6221: [INLONG-6220][Manager] Support query of DP cluster based on GroupId and protocol

healchow commented on code in PR #6221: URL: https://github.com/apache/inlong/pull/6221#discussion_r194704 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/cluster/InlongClusterServiceImpl.java: ## @@ -713,31 +748,17 @@ public DataProxyNodeRe

[GitHub] [inlong] thesumery commented on a diff in pull request #6225: [INLONG-6214][Sort] Import schema and data parsing ability for DynamicSchemaFormat

thesumery commented on code in PR #6225: URL: https://github.com/apache/inlong/pull/6225#discussion_r196769 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/format/DebeziumJsonDynamicSchemaFormat.java: ## @@ -69,6 +81,49 @@ public List extractPri

[GitHub] [inlong] yunqingmoswu merged pull request #6189: [INLONG-6188][Manager] Join supports multiple fields

yunqingmoswu merged PR #6189: URL: https://github.com/apache/inlong/pull/6189 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong

[inlong] branch master updated: [INLONG-6188] join supports multiple fields (#6189)

This is an automated email from the ASF dual-hosted git repository. yunqing pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 153fdaf96 [INLONG-6188] join supports multiple

[GitHub] [inlong] yunqingmoswu merged pull request #6225: [INLONG-6214][Sort] Import schema and data parsing ability for DynamicSchemaFormat

yunqingmoswu merged PR #6225: URL: https://github.com/apache/inlong/pull/6225 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong

[inlong] branch master updated (153fdaf96 -> d062fb335)

This is an automated email from the ASF dual-hosted git repository. yunqing pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 153fdaf96 [INLONG-6188] join supports multiple fields (#6189) add d062fb335 [INLONG-6224][Sort] Import schema an

[GitHub] [inlong] healchow merged pull request #6168: [INLONG-6151][Manager] Add data cleansing task and optimize query indexes

healchow merged PR #6168: URL: https://github.com/apache/inlong/pull/6168 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apa

[inlong] branch master updated: [INLONG-6151][Manager] Add data cleansing task and optimize query indexes (#6168)

This is an automated email from the ASF dual-hosted git repository. healchow pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new eb24f3197 [INLONG-6151][Manager] Add data clea

[GitHub] [inlong] gosonzhang opened a new pull request, #6235: [INLONG-6234][DataProxy] Adjust the source report information acquisition source

gosonzhang opened a new pull request, #6235: URL: https://github.com/apache/inlong/pull/6235 - Fixes #6234 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

[GitHub] [inlong] gosonzhang merged pull request #6235: [INLONG-6234][DataProxy] Adjust the source report information acquisition source

gosonzhang merged PR #6235: URL: https://github.com/apache/inlong/pull/6235 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.a

[inlong] branch master updated (eb24f3197 -> ebf93ef09)

This is an automated email from the ASF dual-hosted git repository. gosonzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from eb24f3197 [INLONG-6151][Manager] Add data cleansing task and optimize query indexes (#6168) add ebf93ef09 [I

[GitHub] [inlong] healchow commented on a diff in pull request #6230: [INLONG-6216][Manager] Support get group topic info

healchow commented on code in PR #6230: URL: https://github.com/apache/inlong/pull/6230#discussion_r1000206616 ## inlong-manager/manager-dao/src/main/java/org/apache/inlong/manager/dao/mapper/InlongClusterEntityMapper.java: ## @@ -57,4 +57,6 @@ List selectByKey(@Param("clusterTa

[GitHub] [inlong] luchunliang commented on a diff in pull request #6219: [INLONG-6153][DataProxy]Optimize the sink architecture of DataProxy

luchunliang commented on code in PR #6219: URL: https://github.com/apache/inlong/pull/6219#discussion_r1000207370 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/sink/mq/BatchPackManager.java: ## @@ -0,0 +1,209 @@ +/** + * Licensed to the Apache So

[GitHub] [inlong] luchunliang commented on a diff in pull request #6219: [INLONG-6153][DataProxy]Optimize the sink architecture of DataProxy

luchunliang commented on code in PR #6219: URL: https://github.com/apache/inlong/pull/6219#discussion_r1000207535 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/sink/common/SinkContext.java: ## @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Soft

[GitHub] [inlong] healchow commented on a diff in pull request #6230: [INLONG-6216][Manager] Support get group topic info

healchow commented on code in PR #6230: URL: https://github.com/apache/inlong/pull/6230#discussion_r1000212145 ## inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/cluster/ClusterBriefInfo.java: ## @@ -0,0 +1,52 @@ +/* + * Licensed to the Apache Software F