(inlong) branch master updated (6d3a131701 -> cd475efdc3)

This is an automated email from the ASF dual-hosted git repository. wenweihuang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 6d3a131701 [INLONG-10441][DataProxy] Supports obtaining Audit-Proxy through InLong Manager (#10442) add cd4

(inlong) branch master updated: [INLONG-10441][DataProxy] Supports obtaining Audit-Proxy through InLong Manager (#10442)

This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 6d3a131701 [INLONG-10441][DataProxy] Suppor

[PR] [INLONG-10446][Agent] Adjusting audit SDK address settings [inlong]

justinwwhuang opened a new pull request, #10447: URL: https://github.com/apache/inlong/pull/10447 Fixes #10446 ### Motivation Adjusting audit SDK address settings ### Modifications If the audit proxy address is configured, use the audit proxy address; otherwise,

Re: [PR] [INLONG-10443][Agent] Put Rocksdb into the plugins module [inlong]

justinwwhuang commented on code in PR #10444: URL: https://github.com/apache/inlong/pull/10444#discussion_r1644455108 ## inlong-agent/conf/agent.properties: ## @@ -99,4 +100,4 @@ agent.prometheus.exporter.port=9080 # whether to enable audit audit.enable=true # audit proxy add

Re: [PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once And fix TubeMQ data twice [inlong]

XiaoYou201 commented on code in PR #10440: URL: https://github.com/apache/inlong/pull/10440#discussion_r1644433532 ## inlong-sort/sort-flink/base/src/main/java/org/apache/inlong/sort/base/metric/SourceExactlyMetric.java: ## @@ -0,0 +1,330 @@ +/* + * Licensed to the Apache Softwa

Re: [PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once And fix TubeMQ data twice [inlong]

XiaoYou201 commented on code in PR #10440: URL: https://github.com/apache/inlong/pull/10440#discussion_r1644400805 ## inlong-sort/sort-flink/base/src/main/java/org/apache/inlong/sort/base/metric/MetricsCollector.java: ## @@ -31,11 +31,10 @@ public class MetricsCollector implemen

Re: [PR] [INLONG-10360][Manager] Combine schedule state transition with group operations [inlong]

fuweng11 commented on code in PR #10445: URL: https://github.com/apache/inlong/pull/10445#discussion_r1644397706 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/schedule/ScheduleOperatorImpl.java: ## @@ -0,0 +1,156 @@ +/* + * Licensed to the Apa

Re: [PR] [INLONG-10360][Manager] Combine schedule state transition with group operations [inlong]

fuweng11 commented on code in PR #10445: URL: https://github.com/apache/inlong/pull/10445#discussion_r1644394405 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/group/InlongGroupServiceImpl.java: ## @@ -239,7 +254,18 @@ public Boolean exist(Stri

Re: [PR] [INLONG-10441][DataProxy] Supports obtaining Audit-Proxy through InLong Manager [inlong]

EMsnap commented on code in PR #10442: URL: https://github.com/apache/inlong/pull/10442#discussion_r1644390502 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/config/CommonConfigHolder.java: ## @@ -668,6 +680,15 @@ private void preReadAuditSetting(

Re: [PR] [INLONG-10441][DataProxy] Supports obtaining Audit-Proxy through InLong Manager [inlong]

EMsnap commented on code in PR #10442: URL: https://github.com/apache/inlong/pull/10442#discussion_r1644390502 ## inlong-dataproxy/dataproxy-source/src/main/java/org/apache/inlong/dataproxy/config/CommonConfigHolder.java: ## @@ -668,6 +680,15 @@ private void preReadAuditSetting(

Re: [PR] [INLONG-10360][Manager] Combine schedule state transition with group operations [inlong]

fuweng11 commented on code in PR #10445: URL: https://github.com/apache/inlong/pull/10445#discussion_r1644389443 ## inlong-manager/manager-common/src/main/java/org/apache/inlong/manager/common/enums/ScheduleStatus.java: ## @@ -19,10 +19,24 @@ import lombok.Getter; +/** + *

Re: [PR] [INLONG-10443][Agent] Put Rocksdb into the plugins module [inlong]

EMsnap commented on code in PR #10444: URL: https://github.com/apache/inlong/pull/10444#discussion_r1644380211 ## inlong-agent/conf/agent.properties: ## @@ -99,4 +100,4 @@ agent.prometheus.exporter.port=9080 # whether to enable audit audit.enable=true # audit proxy address -a

Re: [PR] [INLONG-10360][Manager] Combine schedule state transition with group operations [inlong]

EMsnap commented on code in PR #10445: URL: https://github.com/apache/inlong/pull/10445#discussion_r1644363793 ## inlong-manager/manager-web/src/main/java/org/apache/inlong/manager/web/controller/InLongSchedulerController.java: ## @@ -45,35 +45,35 @@ public class InLongSchedule

Re: [PR] [INLONG-10360][Manager] Combine schedule state transition with group operations [inlong]

EMsnap commented on code in PR #10445: URL: https://github.com/apache/inlong/pull/10445#discussion_r1644363793 ## inlong-manager/manager-web/src/main/java/org/apache/inlong/manager/web/controller/InLongSchedulerController.java: ## @@ -45,35 +45,35 @@ public class InLongSchedule

Re: [PR] [INLONG-10360][Manager] Combine schedule state transition with group operations [inlong]

aloyszhang commented on code in PR #10445: URL: https://github.com/apache/inlong/pull/10445#discussion_r1644360800 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/schedule/ScheduleOperatorImpl.java: ## @@ -0,0 +1,156 @@ +/* + * Licensed to the A

Re: [PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once And fix TubeMQ data twice [inlong]

EMsnap commented on code in PR #10440: URL: https://github.com/apache/inlong/pull/10440#discussion_r1644354061 ## inlong-sort/sort-flink/base/src/main/java/org/apache/inlong/sort/base/metric/SourceExactlyMetric.java: ## @@ -0,0 +1,330 @@ +/* + * Licensed to the Apache Software F

Re: [PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once And fix TubeMQ data twice [inlong]

EMsnap commented on code in PR #10440: URL: https://github.com/apache/inlong/pull/10440#discussion_r1644349734 ## inlong-sort/sort-flink/base/src/main/java/org/apache/inlong/sort/base/metric/MetricsCollector.java: ## @@ -31,11 +31,10 @@ public class MetricsCollector implements

Re: [PR] [INLONG-10360][Manager] Combine schedule state transition with group operations [inlong]

fuweng11 commented on code in PR #10445: URL: https://github.com/apache/inlong/pull/10445#discussion_r1644324784 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/schedule/ScheduleOperatorImpl.java: ## @@ -0,0 +1,156 @@ +/* + * Licensed to the Apa

Re: [PR] [INLONG-10360][Manager] Combine schedule state transition with group operations [inlong]

EMsnap commented on code in PR #10445: URL: https://github.com/apache/inlong/pull/10445#discussion_r1644323168 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/schedule/ScheduleOperatorImpl.java: ## @@ -0,0 +1,156 @@ +/* + * Licensed to the Apach

Re: [PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once And fix TubeMQ data twice [inlong]

XiaoYou201 commented on code in PR #10440: URL: https://github.com/apache/inlong/pull/10440#discussion_r1644285163 ## inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/tubemq/src/main/java/org/apache/inlong/sort/tubemq/table/DynamicTubeMQTableDeserializationSchema.java: ##

Re: [PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once And fix TubeMQ data twice [inlong]

XiaoYou201 commented on code in PR #10440: URL: https://github.com/apache/inlong/pull/10440#discussion_r1644284075 ## inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/tubemq/src/main/java/org/apache/inlong/sort/tubemq/table/DynamicTubeMQTableDeserializationSchema.java: ##

Re: [PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once And fix TubeMQ data twice [inlong]

XiaoYou201 commented on code in PR #10440: URL: https://github.com/apache/inlong/pull/10440#discussion_r1644283540 ## inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/tubemq/src/main/java/org/apache/inlong/sort/tubemq/FlinkTubeMQConsumer.java: ## @@ -257,18 +260,24 @@ pub

Re: [PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once And fix TubeMQ data twice [inlong]

XiaoYou201 commented on code in PR #10440: URL: https://github.com/apache/inlong/pull/10440#discussion_r1644282617 ## inlong-sort/sort-flink/base/src/main/java/org/apache/inlong/sort/base/metric/MetricsCollector.java: ## @@ -31,11 +31,10 @@ public class MetricsCollector implemen

[PR] [INLONG-10360][Manager] Combine schedule state transition with group operations [inlong]

aloyszhang opened a new pull request, #10445: URL: https://github.com/apache/inlong/pull/10445 Fixes #10360 ### Motivation Combine schedule state transition with group operations. details see description in #10360 The finite state machine for schedule is ![image](h

[PR] [INLONG-10443][Agent] Put Rocksdb into the plugins module [inlong]

justinwwhuang opened a new pull request, #10444: URL: https://github.com/apache/inlong/pull/10444 Fixes #10443 ### Motivation Place Rocksdb in the plugins module and adjust the relevant unit tests ### Modifications 1 Place Rocksdb in the plugins module and adjust

Re: [PR] [INLONG-10441][DataProxy] Supports obtaining Audit-Proxy through InLong Manager [inlong]

dockerzhang commented on code in PR #10442: URL: https://github.com/apache/inlong/pull/10442#discussion_r1644252013 ## inlong-dataproxy/dataproxy-source/src/test/resources/common.properties: ## @@ -34,3 +34,5 @@ id2topic.unconfigured.default.topics= test1 test2 test3 msg.send.f

Re: [PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once [inlong]

vernedeng commented on code in PR #10440: URL: https://github.com/apache/inlong/pull/10440#discussion_r1644068341 ## inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/tubemq/src/main/java/org/apache/inlong/sort/tubemq/table/DynamicTubeMQTableDeserializationSchema.java: ##

Re: [PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once [inlong]

EMsnap commented on code in PR #10440: URL: https://github.com/apache/inlong/pull/10440#discussion_r1644066395 ## inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/tubemq/src/main/java/org/apache/inlong/sort/tubemq/table/DynamicTubeMQTableDeserializationSchema.java: ## @@

Re: [PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once [inlong]

EMsnap commented on code in PR #10440: URL: https://github.com/apache/inlong/pull/10440#discussion_r1644063097 ## inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/tubemq/src/main/java/org/apache/inlong/sort/tubemq/FlinkTubeMQConsumer.java: ## @@ -257,18 +260,24 @@ public

Re: [PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once [inlong]

EMsnap commented on code in PR #10440: URL: https://github.com/apache/inlong/pull/10440#discussion_r1644063097 ## inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/tubemq/src/main/java/org/apache/inlong/sort/tubemq/FlinkTubeMQConsumer.java: ## @@ -257,18 +260,24 @@ public

[PR] [INLONG-10441][DataProxy] DataProxy supports obtaining Audit-Proxy through InLong Manager [inlong]

gosonzhang opened a new pull request, #10442: URL: https://github.com/apache/inlong/pull/10442 Fixes #10441 1. add "audit.obtain.proxys.from.manager configure" configuration key for obtaining Audit-Proxy through InLong Manager 2. Call different setAuditProxy methods according

Re: [PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once [inlong]

vernedeng commented on code in PR #10440: URL: https://github.com/apache/inlong/pull/10440#discussion_r1644041511 ## inlong-sort/sort-flink/base/src/main/java/org/apache/inlong/sort/base/metric/MetricsCollector.java: ## @@ -31,11 +31,10 @@ public class MetricsCollector implement

[PR] [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once [inlong]

XiaoYou201 opened a new pull request, #10440: URL: https://github.com/apache/inlong/pull/10440 ### [INLONG-10311][Sort] Implement TubeMQ Source report audit information exactly once Fixes #10311 ### Motivation Now，every connectors report audit information only suppo