[GitHub] [inlong] fuweng11 opened a new pull request, #7937: [INLONG-7936][Manager] Support issued pulsar subscriptions to sort

2023-04-27 Thread via GitHub
fuweng11 opened a new pull request, #7937: URL: https://github.com/apache/inlong/pull/7937 ### Prepare a Pull Request - Fixes #7936 ### Motivation Support issued pulsar subscriptions to sort. ### Modifications Support issued pulsar subscriptions to sort.

[GitHub] [inlong] vernedeng opened a new pull request, #7939: [INLONG-7938][Manager] Fix consume list interface does not filter by request

2023-04-27 Thread via GitHub
vernedeng opened a new pull request, #7939: URL: https://github.com/apache/inlong/pull/7939 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be re

[GitHub] [inlong] dockerzhang commented on a diff in pull request #7935: [INLONG-7934][Manager] Optimize the serializationType to support debezium json

2023-04-27 Thread via GitHub
dockerzhang commented on code in PR #7935: URL: https://github.com/apache/inlong/pull/7935#discussion_r1178728624 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/source/kafka/KafkaSourceOperator.java: ## @@ -131,8 +127,13 @@ public Map> getSour

[GitHub] [inlong] haifxu commented on a diff in pull request #7935: [INLONG-7934][Manager] Optimize the serializationType to support debezium json

2023-04-27 Thread via GitHub
haifxu commented on code in PR #7935: URL: https://github.com/apache/inlong/pull/7935#discussion_r1178742790 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/source/kafka/KafkaSourceOperator.java: ## @@ -131,8 +127,13 @@ public Map> getSourcesMa

[GitHub] [inlong] fuweng11 commented on a diff in pull request #7913: [INLONG-7912][Manager] Only issue normal DataProxy nodes

2023-04-27 Thread via GitHub
fuweng11 commented on code in PR #7913: URL: https://github.com/apache/inlong/pull/7913#discussion_r1178751472 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/cluster/InlongClusterServiceImpl.java: ## @@ -1154,6 +1155,11 @@ public DataProxyNodeR

[GitHub] [inlong] EMsnap commented on a diff in pull request #7937: [INLONG-7936][Manager] Support issued pulsar subscriptions to sort

2023-04-27 Thread via GitHub
EMsnap commented on code in PR #7937: URL: https://github.com/apache/inlong/pull/7937#discussion_r1178761123 ## inlong-sort/sort-common/src/main/java/org/apache/inlong/sort/protocol/node/extract/PulsarExtractNode.java: ## @@ -67,13 +69,15 @@ public PulsarExtractNode(@JsonPropert

[GitHub] [inlong-website] bluewang opened a new issue, #744: [Bug][Doc] The version number does not match

2023-04-27 Thread via GitHub
bluewang opened a new issue, #744: URL: https://github.com/apache/inlong-website/issues/744 ### What happened ![image](https://user-images.githubusercontent.com/88174078/234806957-9e92f6a4-9639-4a2b-abe0-255ec180d1c4.png) ### What you expected to happen open https://

[GitHub] [inlong-website] bluewang opened a new pull request, #745: [INLONG-744][Doc] The version number does not match

2023-04-27 Thread via GitHub
bluewang opened a new pull request, #745: URL: https://github.com/apache/inlong-website/pull/745 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be r

[GitHub] [inlong] gosonzhang opened a new pull request, #7942: [INLONG-7931][DataProxy] Optimize common.properties related control mechanism

2023-04-27 Thread via GitHub
gosonzhang opened a new pull request, #7942: URL: https://github.com/apache/inlong/pull/7942 - Fixes #7931 Modification details: 1. Merge CommonPropertiesHolder and ConfigManager.getCommonProperties() into CommonConfigHolder, manage configuration logic related to common.propert

[GitHub] [inlong] EMsnap opened a new pull request, #7943: [INLONG-7940][Manager] Use pulsar subscriptions and specify subscription offset in pulsar connector

2023-04-27 Thread via GitHub
EMsnap opened a new pull request, #7943: URL: https://github.com/apache/inlong/pull/7943 ### Prepare a Pull Request - Fixes #7840 ### Motivation [INLONG-7940][Manager] Use pulsar subscriptions and specify subscription offset in pulsar connector ### Modifications

[GitHub] [inlong-website] dockerzhang merged pull request #745: [INLONG-744][Doc] The version number does not match

2023-04-27 Thread via GitHub
dockerzhang merged PR #745: URL: https://github.com/apache/inlong-website/pull/745 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@i

[GitHub] [inlong-website] dockerzhang closed issue #744: [Bug][Doc] The version number does not match

2023-04-27 Thread via GitHub
dockerzhang closed issue #744: [Bug][Doc] The version number does not match URL: https://github.com/apache/inlong-website/issues/744 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[inlong-website] branch master updated: [INLONG-744][Doc] The version number does not match (#745)

2023-04-27 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong-website.git The following commit(s) were added to refs/heads/master by this push: new 416067b476 [INLONG-744][Doc] The ve

[GitHub] [inlong] haifxu opened a new pull request, #7944: [INLONG-7941][Manager][Dashborad] Add param to distinguish lightweight

2023-04-27 Thread via GitHub
haifxu opened a new pull request, #7944: URL: https://github.com/apache/inlong/pull/7944 ### Prepare a Pull Request - Fixes #7941 ### Motivation 1. We need to distinguish lightweight tasks when querying groups. ### Modifications 1. Add `lightweight` param.

[GitHub] [inlong] gong commented on a diff in pull request #7923: [INLONG-7879][Manager][Sort][Agent] Multi-version code migration

2023-04-27 Thread via GitHub
gong commented on code in PR #7923: URL: https://github.com/apache/inlong/pull/7923#discussion_r1178909366 ## inlong-sort/sort-flink/sort-flink-v1.13/pom.xml: ## @@ -0,0 +1,235 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; +

[GitHub] [inlong] gong commented on a diff in pull request #7923: [INLONG-7879][Manager][Sort][Agent] Multi-version code migration

2023-04-27 Thread via GitHub
gong commented on code in PR #7923: URL: https://github.com/apache/inlong/pull/7923#discussion_r1178934027 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors-v1.13/doris/pom.xml: ## @@ -20,7 +20,7 @@ 4.0.0 org.apache.inlong -sort-connectors +

[GitHub] [inlong] gong commented on a diff in pull request #7907: [INLONG-7906][Sort] Improve logic of calculation object byte size

2023-04-27 Thread via GitHub
gong commented on code in PR #7907: URL: https://github.com/apache/inlong/pull/7907#discussion_r1178955538 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/util/CalculateObjectSizeUtils.java: ## @@ -0,0 +1,49 @@ +/* + * Licensed to the Apache Softwar

[GitHub] [inlong] healchow commented on a diff in pull request #7944: [INLONG-7941][Manager][Dashborad] Add param to distinguish lightweight

2023-04-27 Thread via GitHub
healchow commented on code in PR #7944: URL: https://github.com/apache/inlong/pull/7944#discussion_r1179053366 ## inlong-manager/manager-web/src/main/java/org/apache/inlong/manager/web/controller/InlongGroupController.java: ## @@ -88,9 +90,12 @@ public Response get(@PathVariable

[GitHub] [inlong] healchow commented on a diff in pull request #7944: [INLONG-7941][Manager][Dashborad] Add param to distinguish lightweight

2023-04-27 Thread via GitHub
healchow commented on code in PR #7944: URL: https://github.com/apache/inlong/pull/7944#discussion_r1179054093 ## inlong-manager/manager-dao/src/main/resources/mappers/InlongGroupEntityMapper.xml: ## @@ -98,6 +98,7 @@ select count(*) as total, status from inlon

[GitHub] [inlong] healchow commented on a diff in pull request #7942: [INLONG-7931][DataProxy] Optimize common.properties related control mechanism

2023-04-27 Thread via GitHub
healchow commented on code in PR #7942: URL: https://github.com/apache/inlong/pull/7942#discussion_r1179061423 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/config/CommonConfigHolder.java: ## @@ -0,0 +1,477 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] healchow commented on a diff in pull request #7942: [INLONG-7931][DataProxy] Optimize common.properties related control mechanism

2023-04-27 Thread via GitHub
healchow commented on code in PR #7942: URL: https://github.com/apache/inlong/pull/7942#discussion_r1179066889 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/metrics/DataProxyMetricItem.java: ## @@ -144,7 +144,8 @@ public static void fillInlongId(

[GitHub] [inlong] healchow commented on a diff in pull request #7942: [INLONG-7931][DataProxy] Optimize common.properties related control mechanism

2023-04-27 Thread via GitHub
healchow commented on code in PR #7942: URL: https://github.com/apache/inlong/pull/7942#discussion_r1179072100 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/config/CommonConfigHolder.java: ## @@ -0,0 +1,477 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] healchow commented on a diff in pull request #7942: [INLONG-7931][DataProxy] Optimize common.properties related control mechanism

2023-04-27 Thread via GitHub
healchow commented on code in PR #7942: URL: https://github.com/apache/inlong/pull/7942#discussion_r1179073030 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/config/CommonConfigHolder.java: ## @@ -0,0 +1,477 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] healchow commented on a diff in pull request #7935: [INLONG-7934][Manager] Optimize the serializationType to support debezium json

2023-04-27 Thread via GitHub
healchow commented on code in PR #7935: URL: https://github.com/apache/inlong/pull/7935#discussion_r1179080013 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/source/tubemq/TubeMQSourceOperator.java: ## @@ -110,17 +110,22 @@ public Map> getSour

[GitHub] [inlong] healchow commented on a diff in pull request #7935: [INLONG-7934][Manager] Optimize the serializationType to support debezium json

2023-04-27 Thread via GitHub
healchow commented on code in PR #7935: URL: https://github.com/apache/inlong/pull/7935#discussion_r1179081867 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/source/tubemq/TubeMQSourceOperator.java: ## @@ -110,17 +110,22 @@ public Map> getSour

[GitHub] [inlong] healchow commented on pull request #7933: [INLONG-7926][TubeMQ] Add "Register2Master" method for GO SDK

2023-04-27 Thread via GitHub
healchow commented on PR #7933: URL: https://github.com/apache/inlong/pull/7933#issuecomment-1525619876 @woofyzhao Hi woofy, do you have time to review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [inlong] TszKitLo40 commented on a diff in pull request #7933: [INLONG-7926][TubeMQ] Add "Register2Master" method for GO SDK

2023-04-27 Thread via GitHub
TszKitLo40 commented on code in PR #7933: URL: https://github.com/apache/inlong/pull/7933#discussion_r1179849093 ## inlong-tubemq/tubemq-client-twins/tubemq-client-go/client/producer_impl.go: ## @@ -0,0 +1,200 @@ +// Licensed to the Apache Software Foundation (ASF) under one +//

[GitHub] [inlong] TszKitLo40 commented on pull request #7933: [INLONG-7926][TubeMQ] Add "Register2Master" method for GO SDK

2023-04-27 Thread via GitHub
TszKitLo40 commented on PR #7933: URL: https://github.com/apache/inlong/pull/7933#issuecomment-1526855483 I don't know the specific logic of producer. Maybe @gosonzhang should have a look. -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [inlong] gosonzhang commented on a diff in pull request #7942: [INLONG-7931][DataProxy] Optimize common.properties related control mechanism

2023-04-27 Thread via GitHub
gosonzhang commented on code in PR #7942: URL: https://github.com/apache/inlong/pull/7942#discussion_r1179851303 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/config/CommonConfigHolder.java: ## @@ -0,0 +1,477 @@ +/* + * Licensed to the Apache Sof

[GitHub] [inlong] gosonzhang commented on a diff in pull request #7942: [INLONG-7931][DataProxy] Optimize common.properties related control mechanism

2023-04-27 Thread via GitHub
gosonzhang commented on code in PR #7942: URL: https://github.com/apache/inlong/pull/7942#discussion_r1179854246 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/config/CommonConfigHolder.java: ## @@ -0,0 +1,477 @@ +/* + * Licensed to the Apache Sof

[GitHub] [inlong] gosonzhang commented on a diff in pull request #7942: [INLONG-7931][DataProxy] Optimize common.properties related control mechanism

2023-04-27 Thread via GitHub
gosonzhang commented on code in PR #7942: URL: https://github.com/apache/inlong/pull/7942#discussion_r1179854788 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/config/CommonConfigHolder.java: ## @@ -0,0 +1,477 @@ +/* + * Licensed to the Apache Sof

[GitHub] [inlong] gosonzhang commented on a diff in pull request #7942: [INLONG-7931][DataProxy] Optimize common.properties related control mechanism

2023-04-27 Thread via GitHub
gosonzhang commented on code in PR #7942: URL: https://github.com/apache/inlong/pull/7942#discussion_r1179855444 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/metrics/DataProxyMetricItem.java: ## @@ -144,7 +144,8 @@ public static void fillInlongI

[GitHub] [inlong] fuweng11 commented on a diff in pull request #7944: [INLONG-7941][Manager][Dashborad] Add param to distinguish lightweight

2023-04-27 Thread via GitHub
fuweng11 commented on code in PR #7944: URL: https://github.com/apache/inlong/pull/7944#discussion_r1179884219 ## inlong-manager/manager-web/src/main/java/org/apache/inlong/manager/web/controller/InlongGroupController.java: ## @@ -88,9 +90,12 @@ public Response get(@PathVariable

[GitHub] [inlong] EMsnap merged pull request #7907: [INLONG-7906][Sort] Improve logic of calculation object byte size

2023-04-27 Thread via GitHub
EMsnap merged PR #7907: URL: https://github.com/apache/inlong/pull/7907 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apach

[inlong] branch master updated: [INLONG-7906][Sort] Improve logic of calculation object byte size (#7907)

2023-04-27 Thread zirui
This is an automated email from the ASF dual-hosted git repository. zirui pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 704ef3eb7 [INLONG-7906][Sort] Improve logic of ca

[GitHub] [inlong] haifxu commented on a diff in pull request #7935: [INLONG-7934][Manager] Optimize the serializationType to support debezium json

2023-04-27 Thread via GitHub
haifxu commented on code in PR #7935: URL: https://github.com/apache/inlong/pull/7935#discussion_r1179893375 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/source/tubemq/TubeMQSourceOperator.java: ## @@ -110,17 +110,22 @@ public Map> getSource

[GitHub] [inlong] lordcheng10 commented on a diff in pull request #7905: [INLONG-7903][Sort] Kafka sink supports fixed partition strategy

2023-04-27 Thread via GitHub
lordcheng10 commented on code in PR #7905: URL: https://github.com/apache/inlong/pull/7905#discussion_r1179958099 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/Constants.java: ## @@ -187,7 +190,18 @@ public final class Constants {

[GitHub] [inlong] lordcheng10 commented on a diff in pull request #7905: [INLONG-7903][Sort] Kafka sink supports fixed partition strategy

2023-04-27 Thread via GitHub
lordcheng10 commented on code in PR #7905: URL: https://github.com/apache/inlong/pull/7905#discussion_r1179958099 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/Constants.java: ## @@ -187,7 +190,18 @@ public final class Constants {

[GitHub] [inlong] lordcheng10 commented on a diff in pull request #7905: [INLONG-7903][Sort] Kafka sink supports fixed partition strategy

2023-04-27 Thread via GitHub
lordcheng10 commented on code in PR #7905: URL: https://github.com/apache/inlong/pull/7905#discussion_r1179991387 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/Constants.java: ## @@ -187,7 +190,18 @@ public final class Constants {

[GitHub] [inlong] lordcheng10 commented on a diff in pull request #7905: [INLONG-7903][Sort] Kafka sink supports fixed partition strategy

2023-04-27 Thread via GitHub
lordcheng10 commented on code in PR #7905: URL: https://github.com/apache/inlong/pull/7905#discussion_r1179991566 ## inlong-sort/sort-connectors/kafka/src/main/java/org/apache/inlong/sort/kafka/partitioner/InLongFixedPartitionPartitioner.java: ## @@ -0,0 +1,121 @@ +/* + * Licens

[GitHub] [inlong] lordcheng10 commented on pull request #7905: [INLONG-7903][Sort] Kafka sink supports fixed partition strategy

2023-04-27 Thread via GitHub
lordcheng10 commented on PR #7905: URL: https://github.com/apache/inlong/pull/7905#issuecomment-1527067788 > Thanks for your contribution, could u please add some test for InLongFixedPartitionPartitioner? I will add some tests. -- This is an automated message from the Apache Git Se