[GitHub] [inlong] leezng merged pull request #6995: [INLONG-6994][Dashboard] Add MQ type filter box for inlong group and consume list

2022-12-26 Thread GitBox
leezng merged PR #6995: URL: https://github.com/apache/inlong/pull/6995 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apach

[inlong] branch master updated (1cd0c841c -> a471740bf)

2022-12-26 Thread leezng
This is an automated email from the ASF dual-hosted git repository. leezng pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 1cd0c841c [INLONG-7064][Dashboard] Update the FilePathHelp value (#7065) add a471740bf [INLONG-6994][Dashboard]

[GitHub] [inlong] kuansix closed pull request #6931: [INLONG-6925][Sort] Add read phase metric and table level metric for MongoDB-CDC

2022-12-26 Thread GitBox
kuansix closed pull request #6931: [INLONG-6925][Sort] Add read phase metric and table level metric for MongoDB-CDC URL: https://github.com/apache/inlong/pull/6931 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [inlong] dockerzhang commented on a diff in pull request #7044: [INLONG-7043][Dashboard] Add field prompt for ES sink

2022-12-26 Thread GitBox
dockerzhang commented on code in PR #7044: URL: https://github.com/apache/inlong/pull/7044#discussion_r1057149312 ## inlong-dashboard/src/locales/cn.json: ## @@ -167,6 +167,7 @@ "meta.Sinks.ES.RetryTimes": "重试次数", "meta.Sinks.ES.RetryTimesUnit": "次", "meta.Sinks.ES.EsVe

[GitHub] [inlong] fuweng11 opened a new pull request, #7068: [INLONG-7067][Manager] Data consumption details provide serverUrl, adminUrl and topic information

2022-12-26 Thread GitBox
fuweng11 opened a new pull request, #7068: URL: https://github.com/apache/inlong/pull/7068 ### Prepare a Pull Request - Fixes #7067 ### Motivation Data consumption details provide serverUrl, adminUrl and topic information. ### Modifications - Provide the co

[GitHub] [inlong] kuansix opened a new pull request, #7069: [INLONG-6925][Sort] Add read phase metric and table level metric for MongoDB-CDC

2022-12-26 Thread GitBox
kuansix opened a new pull request, #7069: URL: https://github.com/apache/inlong/pull/7069 ### Prepare a Pull Request - [INLONG-6925][Sort] Add read phase metric and table level metric for MongoDB-CDC - Fixes #6925 ### Motivation *Explain here the context, and why you

[GitHub] [inlong] dockerzhang commented on a diff in pull request #7044: [INLONG-7043][Dashboard] Add field prompt for ES sink

2022-12-26 Thread GitBox
dockerzhang commented on code in PR #7044: URL: https://github.com/apache/inlong/pull/7044#discussion_r1057150296 ## inlong-dashboard/src/locales/cn.json: ## @@ -167,6 +167,7 @@ "meta.Sinks.ES.RetryTimes": "重试次数", "meta.Sinks.ES.RetryTimesUnit": "次", "meta.Sinks.ES.EsVe

[GitHub] [inlong] healchow commented on a diff in pull request #7050: [INLONG-7049][Manager] Support complex data types in Hudi Sink

2022-12-26 Thread GitBox
healchow commented on code in PR #7050: URL: https://github.com/apache/inlong/pull/7050#discussion_r1057155189 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/resource/sink/hudi/HudiTypeConverter.java: ## @@ -0,0 +1,56 @@ +/* + * Licensed to the

[GitHub] [inlong] vernedeng commented on a diff in pull request #7068: [INLONG-7067][Manager] Data consumption details provide serverUrl, adminUrl and topic information

2022-12-26 Thread GitBox
vernedeng commented on code in PR #7068: URL: https://github.com/apache/inlong/pull/7068#discussion_r1057156648 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/consume/ConsumePulsarOperator.java: ## @@ -103,7 +107,16 @@ public InlongConsumeInfo

[GitHub] [inlong] woofyzhao opened a new pull request, #7071: [INLONG-7070][Manager][DataProxy] Fix mq configuration dispatching problem

2022-12-26 Thread GitBox
woofyzhao opened a new pull request, #7071: URL: https://github.com/apache/inlong/pull/7071 - Fixes #7070 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[inlong] branch master updated: [INLONG-7043][Dashboard] Add field prompt for ES sink (#7044)

2022-12-26 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new f3c6d442a [INLONG-7043][Dashboard] Add fiel

[GitHub] [inlong] dockerzhang merged pull request #7044: [INLONG-7043][Dashboard] Add field prompt for ES sink

2022-12-26 Thread GitBox
dockerzhang merged PR #7044: URL: https://github.com/apache/inlong/pull/7044 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[GitHub] [inlong] featzhang commented on pull request #7059: [INLONG-7058][Sort] Support Apache Kudu connector

2022-12-26 Thread GitBox
featzhang commented on PR #7059: URL: https://github.com/apache/inlong/pull/7059#issuecomment-1365047849 > Please add some describe for your design and implements, thanks. I have supplemented some document information in the pr description, please check -- This is an automated mess

[GitHub] [inlong] Yizhou-Yang commented on a diff in pull request #7062: [INLONG-7061][Sort] Support table level metrics for Apache Doris connector and add dirty metrics

2022-12-26 Thread GitBox
Yizhou-Yang commented on code in PR #7062: URL: https://github.com/apache/inlong/pull/7062#discussion_r1057173838 ## inlong-sort/sort-connectors/doris/src/main/java/org/apache/inlong/sort/doris/table/DorisDynamicSchemaOutputFormat.java: ## @@ -486,6 +497,17 @@ private void handl

[GitHub] [inlong] gong commented on a diff in pull request #7062: [INLONG-7061][Sort] Support table level metrics for Apache Doris connector and add dirty metrics

2022-12-26 Thread GitBox
gong commented on code in PR #7062: URL: https://github.com/apache/inlong/pull/7062#discussion_r1057176165 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -50,6 +50,11 @@ public class SinkTableMetricData ex

[GitHub] [inlong] gong commented on a diff in pull request #7062: [INLONG-7061][Sort] Support table level metrics for Apache Doris connector and add dirty metrics

2022-12-26 Thread GitBox
gong commented on code in PR #7062: URL: https://github.com/apache/inlong/pull/7062#discussion_r1057176958 ## inlong-sort/sort-connectors/doris/src/main/java/org/apache/inlong/sort/doris/table/DorisDynamicSchemaOutputFormat.java: ## @@ -503,6 +511,20 @@ private void handleDirtyD

[GitHub] [inlong] gong commented on a diff in pull request #7062: [INLONG-7061][Sort] Support table level metrics for Apache Doris connector and add dirty metrics

2022-12-26 Thread GitBox
gong commented on code in PR #7062: URL: https://github.com/apache/inlong/pull/7062#discussion_r1057177523 ## inlong-sort/sort-connectors/doris/src/main/java/org/apache/inlong/sort/doris/table/DorisDynamicSchemaOutputFormat.java: ## @@ -503,6 +511,20 @@ private void handleDirtyD

[GitHub] [inlong] Yizhou-Yang commented on a diff in pull request #7062: [INLONG-7061][Sort] Support table level metrics for Apache Doris connector and add dirty metrics

2022-12-26 Thread GitBox
Yizhou-Yang commented on code in PR #7062: URL: https://github.com/apache/inlong/pull/7062#discussion_r1057177991 ## inlong-sort/sort-connectors/doris/src/main/java/org/apache/inlong/sort/doris/table/DorisDynamicSchemaOutputFormat.java: ## @@ -503,6 +511,20 @@ private void handl

[GitHub] [inlong] vernedeng commented on a diff in pull request #7071: [INLONG-7070][Manager][DataProxy] Fix mq configuration dispatching problem

2022-12-26 Thread GitBox
vernedeng commented on code in PR #7071: URL: https://github.com/apache/inlong/pull/7071#discussion_r1057186127 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/repository/DataProxyConfigRepository.java: ## @@ -385,7 +385,8 @@ private Map> parse

[GitHub] [inlong] woofyzhao commented on a diff in pull request #7071: [INLONG-7070][Manager][DataProxy] Fix mq configuration dispatching problem

2022-12-26 Thread GitBox
woofyzhao commented on code in PR #7071: URL: https://github.com/apache/inlong/pull/7071#discussion_r1057193311 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/repository/DataProxyConfigRepository.java: ## @@ -385,7 +385,8 @@ private Map> parse

[GitHub] [inlong] healchow commented on a diff in pull request #7068: [INLONG-7067][Manager] Data consumption details provide serverUrl, adminUrl and topic information

2022-12-26 Thread GitBox
healchow commented on code in PR #7068: URL: https://github.com/apache/inlong/pull/7068#discussion_r1057213373 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/consume/ConsumePulsarOperator.java: ## @@ -103,7 +109,22 @@ public InlongConsumeInfo g

[GitHub] [inlong] healchow commented on a diff in pull request #7068: [INLONG-7067][Manager] Data consumption details provide serverUrl, adminUrl and topic information

2022-12-26 Thread GitBox
healchow commented on code in PR #7068: URL: https://github.com/apache/inlong/pull/7068#discussion_r1057214038 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/consume/ConsumePulsarOperator.java: ## @@ -103,7 +109,22 @@ public InlongConsumeInfo g

[GitHub] [inlong] healchow commented on a diff in pull request #7071: [INLONG-7070][Manager][DataProxy] Fix mq configuration dispatching problem

2022-12-26 Thread GitBox
healchow commented on code in PR #7071: URL: https://github.com/apache/inlong/pull/7071#discussion_r1057215146 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/sink/mq/MessageQueueZoneProducer.java: ## @@ -107,6 +107,7 @@ public void run() { *

[GitHub] [inlong] gong commented on a diff in pull request #7069: [INLONG-6925][Sort] Add read phase metric and table level metric for MongoDB-CDC

2022-12-26 Thread GitBox
gong commented on code in PR #7069: URL: https://github.com/apache/inlong/pull/7069#discussion_r1057215186 ## inlong-sort/sort-connectors/mongodb-cdc/src/main/java/org/apache/inlong/sort/cdc/mongodb/DebeziumSourceFunction.java: ## @@ -445,7 +456,12 @@ public void run(SourceConte

[GitHub] [inlong] gong commented on a diff in pull request #7069: [INLONG-6925][Sort] Add read phase metric and table level metric for MongoDB-CDC

2022-12-26 Thread GitBox
gong commented on code in PR #7069: URL: https://github.com/apache/inlong/pull/7069#discussion_r1057215717 ## inlong-sort/sort-connectors/mongodb-cdc/src/main/java/org/apache/inlong/sort/cdc/mongodb/DebeziumSourceFunction.java: ## @@ -485,7 +501,20 @@ public void run(SourceConte

[GitHub] [inlong] gong commented on a diff in pull request #7069: [INLONG-6925][Sort] Add read phase metric and table level metric for MongoDB-CDC

2022-12-26 Thread GitBox
gong commented on code in PR #7069: URL: https://github.com/apache/inlong/pull/7069#discussion_r1057215717 ## inlong-sort/sort-connectors/mongodb-cdc/src/main/java/org/apache/inlong/sort/cdc/mongodb/DebeziumSourceFunction.java: ## @@ -485,7 +501,20 @@ public void run(SourceConte

[GitHub] [inlong] healchow commented on a diff in pull request #7069: [INLONG-6925][Sort] Add read phase metric and table level metric for MongoDB-CDC

2022-12-26 Thread GitBox
healchow commented on code in PR #7069: URL: https://github.com/apache/inlong/pull/7069#discussion_r1057216575 ## inlong-sort/sort-connectors/mongodb-cdc/src/main/java/org/apache/inlong/sort/cdc/mongodb/debezium/table/MongoDBConnectorDeserializationSchema.java: ## @@ -125,8 +123

[GitHub] [inlong] healchow merged pull request #7050: [INLONG-7049][Manager] Support complex data types in Hudi Sink

2022-12-26 Thread GitBox
healchow merged PR #7050: URL: https://github.com/apache/inlong/pull/7050 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apa

[inlong] branch master updated: [INLONG-7049][Manager] Support complex data types in Hudi Sink (#7050)

2022-12-26 Thread healchow
This is an automated email from the ASF dual-hosted git repository. healchow pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 5834e0f7a [INLONG-7049][Manager] Support compl

[GitHub] [inlong] thesumery commented on a diff in pull request #6902: [INLONG-6829][Agent] Support for the task delivery of stream_source according to the tag granularity

2022-12-26 Thread GitBox
thesumery commented on code in PR #6902: URL: https://github.com/apache/inlong/pull/6902#discussion_r1057401046 ## inlong-manager/manager-test/src/main/resources/h2/apache_inlong_manager.sql: ## @@ -329,6 +330,7 @@ CREATE TABLE IF NOT EXISTS `stream_source` `uuid`

[GitHub] [inlong] woofyzhao commented on a diff in pull request #7071: [INLONG-7070][Manager][DataProxy] Fix mq configuration dispatching problem

2022-12-26 Thread GitBox
woofyzhao commented on code in PR #7071: URL: https://github.com/apache/inlong/pull/7071#discussion_r1057418076 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/sink/mq/MessageQueueZoneProducer.java: ## @@ -107,6 +107,7 @@ public void run() {

[GitHub] [inlong] GanfengTan commented on a diff in pull request #6902: [INLONG-6829][Agent] Support for the task delivery of stream_source according to the tag granularity

2022-12-26 Thread GitBox
GanfengTan commented on code in PR #6902: URL: https://github.com/apache/inlong/pull/6902#discussion_r1057426944 ## inlong-manager/manager-test/src/main/resources/h2/apache_inlong_manager.sql: ## @@ -329,6 +330,7 @@ CREATE TABLE IF NOT EXISTS `stream_source` `uuid`

[GitHub] [inlong] dockerzhang merged pull request #7068: [INLONG-7067][Manager] Provide MQ cluster info in consumption details

2022-12-26 Thread GitBox
dockerzhang merged PR #7068: URL: https://github.com/apache/inlong/pull/7068 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated: [INLONG-7067][Manager] Provide MQ cluster info in consumption details (#7068)

2022-12-26 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 2db5c9b25 [INLONG-7067][Manager] Provide MQ

[GitHub] [inlong] gong opened a new pull request, #7074: [INLONG-7066][Sort] Kafka connector lost topic level dirty data metric and state restore for multi sink

2022-12-26 Thread GitBox
gong opened a new pull request, #7074: URL: https://github.com/apache/inlong/pull/7074 ### Prepare a Pull Request - [INLONG-7066][Sort] Kafka connector lost topic level dirty data metric and state restore for multi sink - Fixes #7066 ### Motivation * Kafka connec

[GitHub] [inlong] gong merged pull request #7069: [INLONG-6925][Sort] Add read phase metric and table level metric for MongoDB-CDC

2022-12-26 Thread GitBox
gong merged PR #7069: URL: https://github.com/apache/inlong/pull/7069 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.

[inlong] branch master updated: [INLONG-6925][Sort] Add read phase metric and table level metric for MongoDB-CDC (#7069)

2022-12-26 Thread pacinogong
This is an automated email from the ASF dual-hosted git repository. pacinogong pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 0e0fa5bf5 [INLONG-6925][Sort] Add read phase

[GitHub] [inlong] gong commented on a diff in pull request #7062: [INLONG-7061][Sort] Support table level metrics for Apache Doris connector and add dirty metrics

2022-12-26 Thread GitBox
gong commented on code in PR #7062: URL: https://github.com/apache/inlong/pull/7062#discussion_r1057478793 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -199,6 +199,25 @@ public void outputMetricsWithEsti

[GitHub] [inlong] dockerzhang merged pull request #7071: [INLONG-7070][Manager][DataProxy] Fix mq configuration dispatching problem

2022-12-26 Thread GitBox
dockerzhang merged PR #7071: URL: https://github.com/apache/inlong/pull/7071 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated (0e0fa5bf5 -> 699af0d53)

2022-12-26 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 0e0fa5bf5 [INLONG-6925][Sort] Add read phase metric and table level metric for MongoDB-CDC (#7069) add 699a

[GitHub] [inlong] gong commented on a diff in pull request #7062: [INLONG-7061][Sort] Support table level metrics for Apache Doris connector and add dirty metrics

2022-12-26 Thread GitBox
gong commented on code in PR #7062: URL: https://github.com/apache/inlong/pull/7062#discussion_r1057480671 ## inlong-sort/sort-connectors/doris/src/main/java/org/apache/inlong/sort/doris/table/DorisDynamicSchemaOutputFormat.java: ## @@ -512,17 +512,12 @@ private void handleDirty

[GitHub] [inlong] gong commented on a diff in pull request #7062: [INLONG-7061][Sort] Support table level metrics for Apache Doris connector and add dirty metrics

2022-12-26 Thread GitBox
gong commented on code in PR #7062: URL: https://github.com/apache/inlong/pull/7062#discussion_r1057485987 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -50,6 +50,11 @@ public class SinkTableMetricData ex