[GitHub] [inlong] leezng opened a new pull request, #6901: [INLONG-6900][Dashboard] Support pulling up the field list of Source in Sink

2022-12-15 Thread GitBox
leezng opened a new pull request, #6901: URL: https://github.com/apache/inlong/pull/6901 - Fixes #6900 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

[GitHub] [inlong] thesumery opened a new pull request, #6902: [INLONG-6829][Agent] Support for the task delivery of stream_source according to the tag granularity

2022-12-15 Thread GitBox
thesumery opened a new pull request, #6902: URL: https://github.com/apache/inlong/pull/6902 ### Prepare a Pull Request - [INLONG-6829][Agent] Support for the task delivery of stream_source according to the tag granularity - Fixes #6829 ### Motivation *Explain here the co

[GitHub] [inlong] liaorui opened a new pull request, #6903: [INLONG-6899][Sort]StarRocks supports table level metric

2022-12-15 Thread GitBox
liaorui opened a new pull request, #6903: URL: https://github.com/apache/inlong/pull/6903 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be replaced

[GitHub] [inlong] dockerzhang merged pull request #6901: [INLONG-6900][Dashboard] Support pulling up the field list of Source in Sink

2022-12-15 Thread GitBox
dockerzhang merged PR #6901: URL: https://github.com/apache/inlong/pull/6901 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated: [INLONG-6900][Dashboard] Support pulling up the field list of Source in Sink (#6901)

2022-12-15 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 3cb3b37b9 [INLONG-6900][Dashboard] Support

[GitHub] [inlong] dockerzhang commented on pull request #6902: [INLONG-6829][Agent] Support for the task delivery of stream_source according to the tag granularity

2022-12-15 Thread GitBox
dockerzhang commented on PR #6902: URL: https://github.com/apache/inlong/pull/6902#issuecomment-1353064878 @thesumery Please add more detail to this PR; thanks. It's better to add a technical solution. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [inlong] gosonzhang opened a new pull request, #6906: [INLONG-6905][Manager] Add open apis for inlong cluster and data node operations

2022-12-15 Thread GitBox
gosonzhang opened a new pull request, #6906: URL: https://github.com/apache/inlong/pull/6906 - Fixes #6905 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [inlong] healchow commented on a diff in pull request #6873: [INLONG-6861][Dashboard] Support extract node of Apache Hudi

2022-12-15 Thread GitBox
healchow commented on code in PR #6873: URL: https://github.com/apache/inlong/pull/6873#discussion_r1050308228 ## inlong-dashboard/src/locales/cn.json: ## @@ -157,6 +164,9 @@ "meta.Sinks.ES.FlushRecordUnit": "条", "meta.Sinks.ES.RetryTimes": "重试次数", "meta.Sinks.ES.RetryT

[GitHub] [inlong] healchow commented on a diff in pull request #6873: [INLONG-6861][Dashboard] Support extract node of Apache Hudi

2022-12-15 Thread GitBox
healchow commented on code in PR #6873: URL: https://github.com/apache/inlong/pull/6873#discussion_r1050308228 ## inlong-dashboard/src/locales/cn.json: ## @@ -157,6 +164,9 @@ "meta.Sinks.ES.FlushRecordUnit": "条", "meta.Sinks.ES.RetryTimes": "重试次数", "meta.Sinks.ES.RetryT

[GitHub] [inlong] ZuoFengZhang commented on a diff in pull request #6873: [INLONG-6861][Dashboard] Support extract node of Apache Hudi

2022-12-15 Thread GitBox
ZuoFengZhang commented on code in PR #6873: URL: https://github.com/apache/inlong/pull/6873#discussion_r1050331823 ## inlong-dashboard/src/locales/cn.json: ## @@ -157,6 +164,9 @@ "meta.Sinks.ES.FlushRecordUnit": "条", "meta.Sinks.ES.RetryTimes": "重试次数", "meta.Sinks.ES.Re

[GitHub] [inlong] bluewang opened a new pull request, #6910: [INLONG-6904][Dashboard] File source type supports selecting agent cluster

2022-12-15 Thread GitBox
bluewang opened a new pull request, #6910: URL: https://github.com/apache/inlong/pull/6910 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be replace

[GitHub] [inlong] luchunliang opened a new pull request, #6911: [INLONG-6907][SortStandalone] Support to close StatsRecorder of pulsar

2022-12-15 Thread GitBox
luchunliang opened a new pull request, #6911: URL: https://github.com/apache/inlong/pull/6911 …r client ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XY

[GitHub] [inlong] dockerzhang commented on pull request #6910: [INLONG-6904][Dashboard] File source type supports selecting agent cluster

2022-12-15 Thread GitBox
dockerzhang commented on PR #6910: URL: https://github.com/apache/inlong/pull/6910#issuecomment-1354158904 @bluewang please add an image to show the effect, thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [inlong] dockerzhang commented on pull request #6911: [INLONG-6907][SortStandalone] Support to close StatsRecorder of pulsar client

2022-12-15 Thread GitBox
dockerzhang commented on PR #6911: URL: https://github.com/apache/inlong/pull/6911#issuecomment-1354159826 @luchunliang please rebase from master and build locally before creating a PR, and it will fix the format error automatically. -- This is an automated message from the Apache Git Ser

[GitHub] [inlong] ZuoFengZhang commented on a diff in pull request #6873: [INLONG-6861][Dashboard] Support extract node of Apache Hudi

2022-12-15 Thread GitBox
ZuoFengZhang commented on code in PR #6873: URL: https://github.com/apache/inlong/pull/6873#discussion_r1050380515 ## inlong-dashboard/src/locales/cn.json: ## @@ -157,6 +164,9 @@ "meta.Sinks.ES.FlushRecordUnit": "条", "meta.Sinks.ES.RetryTimes": "重试次数", "meta.Sinks.ES.Re

[GitHub] [inlong] gong commented on a diff in pull request #6903: [INLONG-6899][Sort] StarRocks supports table level metric

2022-12-15 Thread GitBox
gong commented on code in PR #6903: URL: https://github.com/apache/inlong/pull/6903#discussion_r1050393518 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkSubMetricData.java: ## @@ -0,0 +1,43 @@ +/* + * Licensed to the Apache Software

[GitHub] [inlong] gong commented on a diff in pull request #6903: [INLONG-6899][Sort] StarRocks supports table level metric

2022-12-15 Thread GitBox
gong commented on code in PR #6903: URL: https://github.com/apache/inlong/pull/6903#discussion_r1050393961 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -0,0 +1,275 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] gong commented on pull request #6903: [INLONG-6899][Sort] StarRocks supports table level metric

2022-12-15 Thread GitBox
gong commented on PR #6903: URL: https://github.com/apache/inlong/pull/6903#issuecomment-1354258210 starrack lost node level dirty data metric restore -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [inlong] gong commented on a diff in pull request #6903: [INLONG-6899][Sort] StarRocks supports table level metric

2022-12-15 Thread GitBox
gong commented on code in PR #6903: URL: https://github.com/apache/inlong/pull/6903#discussion_r1050395791 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -0,0 +1,275 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] gong commented on a diff in pull request #6903: [INLONG-6899][Sort] StarRocks supports table level metric

2022-12-15 Thread GitBox
gong commented on code in PR #6903: URL: https://github.com/apache/inlong/pull/6903#discussion_r1050396965 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -0,0 +1,275 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] gong commented on a diff in pull request #6903: [INLONG-6899][Sort] StarRocks supports table level metric

2022-12-15 Thread GitBox
gong commented on code in PR #6903: URL: https://github.com/apache/inlong/pull/6903#discussion_r1050397247 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -0,0 +1,275 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] gong commented on a diff in pull request #6903: [INLONG-6899][Sort] StarRocks supports table level metric

2022-12-15 Thread GitBox
gong commented on code in PR #6903: URL: https://github.com/apache/inlong/pull/6903#discussion_r1050397465 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -0,0 +1,275 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] gong commented on a diff in pull request #6903: [INLONG-6899][Sort] StarRocks supports table level metric

2022-12-15 Thread GitBox
gong commented on code in PR #6903: URL: https://github.com/apache/inlong/pull/6903#discussion_r1050397573 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -0,0 +1,275 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] gong commented on a diff in pull request #6903: [INLONG-6899][Sort] StarRocks supports table level metric

2022-12-15 Thread GitBox
gong commented on code in PR #6903: URL: https://github.com/apache/inlong/pull/6903#discussion_r1050397676 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -0,0 +1,275 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] gong commented on a diff in pull request #6903: [INLONG-6899][Sort] StarRocks supports table level metric

2022-12-15 Thread GitBox
gong commented on code in PR #6903: URL: https://github.com/apache/inlong/pull/6903#discussion_r1050397785 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -0,0 +1,275 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] gong commented on a diff in pull request #6903: [INLONG-6899][Sort] StarRocks supports table level metric

2022-12-15 Thread GitBox
gong commented on code in PR #6903: URL: https://github.com/apache/inlong/pull/6903#discussion_r1050398045 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -0,0 +1,275 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] gong commented on a diff in pull request #6903: [INLONG-6899][Sort] StarRocks supports table level metric

2022-12-15 Thread GitBox
gong commented on code in PR #6903: URL: https://github.com/apache/inlong/pull/6903#discussion_r1050398144 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -0,0 +1,275 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] gong commented on a diff in pull request #6903: [INLONG-6899][Sort] StarRocks supports table level metric

2022-12-15 Thread GitBox
gong commented on code in PR #6903: URL: https://github.com/apache/inlong/pull/6903#discussion_r1050398144 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/metric/sub/SinkTableMetricData.java: ## @@ -0,0 +1,275 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] EMsnap opened a new pull request, #6913: [INLONG-6908][Sort] support all rowkinds for metric computing for jdbc connector

2022-12-15 Thread GitBox
EMsnap opened a new pull request, #6913: URL: https://github.com/apache/inlong/pull/6913 ### Prepare a Pull Request - Fixes #6908 ### Motivation [INLONG-6908][Sort] support all rowkinds for metric computing for jdbc connector ### Modifications [INLONG-6908

[GitHub] [inlong] gong commented on pull request #6913: [INLONG-6908][Sort] support all rowkinds for metric computing for jdbc connector

2022-12-15 Thread GitBox
gong commented on PR #6913: URL: https://github.com/apache/inlong/pull/6913#issuecomment-1354266739 lost dirty data metric restore -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [inlong] gong commented on pull request #6913: [INLONG-6908][Sort] support all rowkinds for metric computing for jdbc connector

2022-12-15 Thread GitBox
gong commented on PR #6913: URL: https://github.com/apache/inlong/pull/6913#issuecomment-1354272056 ```java if (executionOptions.getBatchSize() > 0 && batchCount >= executionOptions.getBatchSize()) { flush();

[GitHub] [inlong] gong commented on pull request #6913: [INLONG-6908][Sort] support all rowkinds for metric computing for jdbc connector

2022-12-15 Thread GitBox
gong commented on PR #6913: URL: https://github.com/apache/inlong/pull/6913#issuecomment-1354277256 work is Intersecting with https://github.com/apache/inlong/pull/6752 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [inlong] gong commented on pull request #6825: [INLONG-6822][Sort] Add multi table source for MongoDb

2022-12-15 Thread GitBox
gong commented on PR #6825: URL: https://github.com/apache/inlong/pull/6825#issuecomment-135427 use mvn spotless:apply -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [inlong] gong commented on pull request #6752: [INLONG-6780][Sort] Supports dirty data side-output for JDBC connector and related sinks

2022-12-15 Thread GitBox
gong commented on PR #6752: URL: https://github.com/apache/inlong/pull/6752#issuecomment-1354282838 no use merge, use git rebase master -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [inlong] gong commented on pull request #6820: [INLONG-6819][Sort] Add multi table sink for PostgresSQL

2022-12-15 Thread GitBox
gong commented on PR #6820: URL: https://github.com/apache/inlong/pull/6820#issuecomment-1354283727 use mvn spotless:apply -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [inlong] EMsnap merged pull request #6752: [INLONG-6780][Sort] Supports dirty data side-output for JDBC connector and related sinks

2022-12-15 Thread GitBox
EMsnap merged PR #6752: URL: https://github.com/apache/inlong/pull/6752 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apach

[inlong] branch master updated: [INLONG-6780][Sort] Supports dirty data side-output for JDBC connector and related sinks (#6752)

2022-12-15 Thread zirui
This is an automated email from the ASF dual-hosted git repository. zirui pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 31f2a23f4 [INLONG-6780][Sort] Supports dirty data

[GitHub] [inlong] Keylchen opened a new pull request, #6915: [INLONG-6841][Metrics] Add grafana dockerfile to simplify configuration.

2022-12-15 Thread GitBox
Keylchen opened a new pull request, #6915: URL: https://github.com/apache/inlong/pull/6915 *(The following *XYZ* should be replaced by the actual [GitHub Issue](https://github.com/apache/inlong/issues) number)* - Fixes #6841 ### Motivation *Explain here the context, and why

[inlong] branch master updated (31f2a23f4 -> c13113cf8)

2022-12-15 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 31f2a23f4 [INLONG-6780][Sort] Supports dirty data side-output for JDBC connector and related sinks (#6752)

[GitHub] [inlong] dockerzhang merged pull request #6911: [INLONG-6907][SortStandalone] Support to close StatsRecorder of pulsar client

2022-12-15 Thread GitBox
dockerzhang merged PR #6911: URL: https://github.com/apache/inlong/pull/6911 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[GitHub] [inlong] gong opened a new pull request, #6917: [INLONG-6914][Sort] Fix Doris connector parallelism setting error

2022-12-15 Thread GitBox
gong opened a new pull request, #6917: URL: https://github.com/apache/inlong/pull/6917 ### Prepare a Pull Request - [INLONG-6914][Sort] Fix Doris connector parallelism setting error - Fixes #6914 ### Motivation * Fix Doris connector parallelism setting error

[GitHub] [inlong] kuansix commented on pull request #6825: [INLONG-6822][Sort] Add multi table source for MongoDb

2022-12-15 Thread GitBox
kuansix commented on PR #6825: URL: https://github.com/apache/inlong/pull/6825#issuecomment-1354326114 > use mvn spotless:apply done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [inlong] kuansix commented on pull request #6825: [INLONG-6822][Sort] Add multi table source for MongoDb

2022-12-15 Thread GitBox
kuansix commented on PR #6825: URL: https://github.com/apache/inlong/pull/6825#issuecomment-1354326542 > Please add describe for your design and implements. done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [inlong] kuansix closed pull request #6825: [INLONG-6822][Sort] Add multi table source for MongoDb

2022-12-15 Thread GitBox
kuansix closed pull request #6825: [INLONG-6822][Sort] Add multi table source for MongoDb URL: https://github.com/apache/inlong/pull/6825 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [inlong] EMsnap commented on pull request #6913: [INLONG-6908][Sort] support all rowkinds for metric computing for jdbc connector

2022-12-15 Thread GitBox
EMsnap commented on PR #6913: URL: https://github.com/apache/inlong/pull/6913#issuecomment-1354326986 > work is Intersecting with #6752 OK, will continue this pr after dirty sink is finished, stil has some problem there -- This is an automated message from the Apache Git Servi

[GitHub] [inlong] gosonzhang merged pull request #6906: [INLONG-6905][Manager] Add OpenAPIs for InLong cluster and data node operations

2022-12-15 Thread GitBox
gosonzhang merged PR #6906: URL: https://github.com/apache/inlong/pull/6906 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.a

[inlong] branch master updated (c13113cf8 -> 47f9e64db)

2022-12-15 Thread gosonzhang
This is an automated email from the ASF dual-hosted git repository. gosonzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from c13113cf8 [INLONG-6907][SortStandalone] Support to close StatsRecorder of pulsar client (#6911) add 47f9e64d

[GitHub] [inlong] haifxu opened a new pull request, #6920: [INLONG][Manager] Command tools support Transform

2022-12-15 Thread GitBox
haifxu opened a new pull request, #6920: URL: https://github.com/apache/inlong/pull/6920 ### Prepare a Pull Request - Fixes #6918 ### Motivation Command tools support Transform when creating inlong group. ### Modifications 1. Add `@NoArgsConstructor` and `T

[GitHub] [inlong] Yizhou-Yang opened a new pull request, #6921: [INLONG-6780][Sort] Supports dirty data side-output for JDBC connector and related sinks

2022-12-15 Thread GitBox
Yizhou-Yang opened a new pull request, #6921: URL: https://github.com/apache/inlong/pull/6921 add jdbc flush exception via batchmap (which is actually a batchset for jdbc) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [inlong] bluewang opened a new pull request, #6922: [INLONG-6916][Dashboard] MQ type adds partition limit

2022-12-15 Thread GitBox
bluewang opened a new pull request, #6922: URL: https://github.com/apache/inlong/pull/6922 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be replace

[GitHub] [inlong] gong commented on a diff in pull request #6750: [INLONG-6657][Sort] Add dirty metric for Kafka

2022-12-15 Thread GitBox
gong commented on code in PR #6750: URL: https://github.com/apache/inlong/pull/6750#discussion_r1050461048 ## inlong-sort/sort-connectors/kafka/src/main/java/org/apache/inlong/sort/kafka/FlinkKafkaProducer.java: ## @@ -860,17 +860,15 @@ public void open(Configuration configurati

[GitHub] [inlong] gong commented on a diff in pull request #6750: [INLONG-6657][Sort] Add dirty metric for Kafka

2022-12-15 Thread GitBox
gong commented on code in PR #6750: URL: https://github.com/apache/inlong/pull/6750#discussion_r1050461253 ## inlong-sort/sort-connectors/kafka/src/main/java/org/apache/inlong/sort/kafka/FlinkKafkaProducer.java: ## @@ -879,13 +877,13 @@ public void onCompletion(RecordMetadata me

[GitHub] [inlong] EMsnap commented on a diff in pull request #6921: [INLONG-6780][Sort] Supports dirty data side-output for JDBC connector and related sinks

2022-12-15 Thread GitBox
EMsnap commented on code in PR #6921: URL: https://github.com/apache/inlong/pull/6921#discussion_r1050460761 ## inlong-sort/sort-connectors/jdbc/src/main/java/org/apache/inlong/sort/jdbc/internal/JdbcBatchingOutputFormat.java: ## @@ -91,13 +93,12 @@ private transient Schedu