Re: [PR] [INLONG-9860][Manager] Manager client supports querying workflow logs [inlong]

2024-03-21 Thread via GitHub
dockerzhang merged PR #9861: URL: https://github.com/apache/inlong/pull/9861 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

(inlong) branch master updated: [INLONG-9860][Manager] Manager client supports querying workflow logs (#9861)

2024-03-21 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new bc6a0ccc58 [INLONG-9860][Manager] Manager c

[PR] [INLONG-9863][Agent] To avoid data loss caused by too many supplementary files [inlong]

2024-03-21 Thread via GitHub
justinwwhuang opened a new pull request, #9864: URL: https://github.com/apache/inlong/pull/9864 [INLONG-9863][Agent] To avoid data loss caused by too many supplementary files - Fixes #9863 ### Motivation To avoid data loss caused by too many supplementary files ### Modificat

[PR] [INLONG-9862] Support submit flink job for offline sync [inlong]

2024-03-21 Thread via GitHub
aloyszhang opened a new pull request, #9865: URL: https://github.com/apache/inlong/pull/9865 - Fixes #9862 ### Background For real-time data sync, the whole procedure is as follows: ![image](https://github.com/apache/inlong/assets/48062889/db68bae8-c50d-4f57-ae4b-03e1666c53

Re: [PR] [INLONG-9862][Manager] Support submit flink job for offline sync [inlong]

2024-03-21 Thread via GitHub
fuweng11 commented on code in PR #9865: URL: https://github.com/apache/inlong/pull/9865#discussion_r1533764631 ## inlong-manager/manager-plugins/base/src/main/java/org/apache/inlong/manager/plugin/listener/StartupSortListener.java: ## @@ -98,6 +99,14 @@ public ListenerResult lis

Re: [PR] [INLONG-9862][Manager] Support submit flink job for offline sync [inlong]

2024-03-21 Thread via GitHub
fuweng11 commented on code in PR #9865: URL: https://github.com/apache/inlong/pull/9865#discussion_r1533766527 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/listener/sort/SortConfigListener.java: ## @@ -125,6 +126,13 @@ public ListenerResult l

Re: [PR] [INLONG-9862][Manager] Support submit flink job for offline sync [inlong]

2024-03-21 Thread via GitHub
aloyszhang commented on code in PR #9865: URL: https://github.com/apache/inlong/pull/9865#discussion_r1534951131 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/listener/sort/SortConfigListener.java: ## @@ -125,6 +126,13 @@ public ListenerResult

Re: [PR] [INLONG-9862][Manager] Support submit flink job for offline sync [inlong]

2024-03-21 Thread via GitHub
baomingyu commented on code in PR #9865: URL: https://github.com/apache/inlong/pull/9865#discussion_r1535000982 ## inlong-manager/manager-plugins/base/src/main/java/org/apache/inlong/manager/plugin/listener/StartupSortListener.java: ## @@ -131,30 +140,24 @@ public ListenerResult

Re: [PR] [INLONG-9862][Manager] Support submit flink job for offline sync [inlong]

2024-03-21 Thread via GitHub
aloyszhang commented on code in PR #9865: URL: https://github.com/apache/inlong/pull/9865#discussion_r1535004395 ## inlong-manager/manager-plugins/base/src/main/java/org/apache/inlong/manager/plugin/listener/StartupSortListener.java: ## @@ -131,30 +140,24 @@ public ListenerResul

Re: [PR] [INLONG-9862][Manager] Support submit flink job for offline sync [inlong]

2024-03-21 Thread via GitHub
fuweng11 commented on code in PR #9865: URL: https://github.com/apache/inlong/pull/9865#discussion_r1535006930 ## inlong-manager/manager-plugins/base/src/main/java/org/apache/inlong/manager/plugin/listener/StartupSortListener.java: ## @@ -98,6 +99,14 @@ public ListenerResult lis

Re: [PR] [INLONG-9862][Manager] Support submit flink job for offline sync [inlong]

2024-03-21 Thread via GitHub
fuweng11 commented on code in PR #9865: URL: https://github.com/apache/inlong/pull/9865#discussion_r1535012911 ## inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/sort/util/StreamParseUtils.java: ## @@ -154,4 +159,22 @@ public static StreamPipeline parseS

Re: [PR] [INLONG-9862][Manager] Support submit flink job for offline sync [inlong]

2024-03-21 Thread via GitHub
fuweng11 commented on code in PR #9865: URL: https://github.com/apache/inlong/pull/9865#discussion_r1535006875 ## inlong-manager/manager-common/src/main/java/org/apache/inlong/manager/common/consts/InlongConstants.java: ## @@ -141,6 +141,8 @@ public class InlongConstants {

Re: [PR] [INLONG-9863][Agent] To avoid data loss caused by too many supplementary files [inlong]

2024-03-21 Thread via GitHub
justinwwhuang commented on PR #9864: URL: https://github.com/apache/inlong/pull/9864#issuecomment-2014429643 > sorry but why "too many supplementary files" would cause data loss ? Could u please add description on the pr and explain why the changes ? The dealWithEventMap function will

Re: [PR] [INLONG-9863][Agent] To avoid data loss caused by too many supplementary files [inlong]

2024-03-21 Thread via GitHub
EMsnap merged PR #9864: URL: https://github.com/apache/inlong/pull/9864 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apach

(inlong) branch master updated: [INLONG-9863][Agent] Avoiding data loss caused by too many supplementary files (#9864)

2024-03-21 Thread zirui
This is an automated email from the ASF dual-hosted git repository. zirui pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new c12be71518 [INLONG-9863][Agent] Avoiding data los