[GitHub] [inlong] healchow commented on a diff in pull request #7562: [INLONG-7560][Dashboard] When submitting group approval, determine whether to create source and sink

2023-03-12 Thread via GitHub
healchow commented on code in PR #7562: URL: https://github.com/apache/inlong/pull/7562#discussion_r1133209057 ## inlong-dashboard/src/locales/en.json: ## @@ -538,6 +538,7 @@ "pages.GroupDetail.Info.DataStreams": "Data streams", "pages.GroupDetail.Info.Submit": "Submit",

[GitHub] [inlong] dockerzhang opened a new pull request, #7571: [INLONG-7528][Script] Add the Kafka support for audit standalone deployment

2023-03-12 Thread via GitHub
dockerzhang opened a new pull request, #7571: URL: https://github.com/apache/inlong/pull/7571 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be repl

[GitHub] [inlong-website] dockerzhang opened a new pull request, #706: [INLONG-7528][Doc] Add the Kafka support for audit standalone deployment

2023-03-12 Thread via GitHub
dockerzhang opened a new pull request, #706: URL: https://github.com/apache/inlong-website/pull/706 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should b

[GitHub] [inlong] dockerzhang opened a new pull request, #7573: [INLONG-7572][Docker] Add the Kafka support for audit docker deployment

2023-03-12 Thread via GitHub
dockerzhang opened a new pull request, #7573: URL: https://github.com/apache/inlong/pull/7573 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be repl

[GitHub] [inlong-website] e-mhui opened a new issue, #707: [Feature][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC

2023-03-12 Thread via GitHub
e-mhui opened a new issue, #707: URL: https://github.com/apache/inlong-website/issues/707 ### Description Add parameter description for enabling incremental snapshot for MongoDB CDC. ### Use case none ### Are you willing to submit PR? - [X] Yes, I am willing

[GitHub] [inlong-website] e-mhui opened a new issue, #708: [Improve][Doc] Describe Oracle CDC using Markdown

2023-03-12 Thread via GitHub
e-mhui opened a new issue, #708: URL: https://github.com/apache/inlong-website/issues/708 ### Description Describe Oracle CDC using Markdown. ### Are you willing to submit PR? - [X] Yes, I am willing to submit a PR! ### Code of Conduct - [X] I agree to follo

[GitHub] [inlong-website] e-mhui opened a new pull request, #709: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC

2023-03-12 Thread via GitHub
e-mhui opened a new pull request, #709: URL: https://github.com/apache/inlong-website/pull/709 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB C

[GitHub] [inlong-website] e-mhui opened a new pull request, #710: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC

2023-03-12 Thread via GitHub
e-mhui opened a new pull request, #710: URL: https://github.com/apache/inlong-website/pull/710 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB C

[GitHub] [inlong-website] e-mhui opened a new pull request, #711: [INLONG-708][Doc] Describe Oracle CDC using Markdown

2023-03-12 Thread via GitHub
e-mhui opened a new pull request, #711: URL: https://github.com/apache/inlong-website/pull/711 ### Prepare a Pull Request [INLONG-708][Doc] Describe Oracle CDC using Markdown - Fixes #708 ### Motivation Describe Oracle CDC using Markdown -- This is an autom

[GitHub] [inlong-website] e-mhui closed pull request #709: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC

2023-03-12 Thread via GitHub
e-mhui closed pull request #709: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC URL: https://github.com/apache/inlong-website/pull/709 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [inlong] fuweng11 opened a new pull request, #7576: [INLONG-7575][Manager] Add database change script of 1.6.0 for Manager

2023-03-12 Thread via GitHub
fuweng11 opened a new pull request, #7576: URL: https://github.com/apache/inlong/pull/7576 ### Prepare a Pull Request - Fixes #7575 ### Motivation Add database change script of 1.6.0 for Manager. ### Modifications Add database change script of 1.6.0 for Manag

[GitHub] [inlong] healchow commented on a diff in pull request #7517: [INLONG-7516][Manager][Sort][Agent] Decoupling Flink version dependencies for multiple versions of Apache Flink

2023-03-12 Thread via GitHub
healchow commented on code in PR #7517: URL: https://github.com/apache/inlong/pull/7517#discussion_r1133373065 ## inlong-agent/pom.xml: ## @@ -36,4 +36,54 @@ agent-release agent-docker + + +1.8.0.Final Review Comment: Is this modification

[GitHub] [inlong] dockerzhang merged pull request #7571: [INLONG-7528][Script] Add the Kafka support for audit standalone deployment

2023-03-12 Thread via GitHub
dockerzhang merged PR #7571: URL: https://github.com/apache/inlong/pull/7571 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated (3a525c70b -> e9b10f04f)

2023-03-12 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 3a525c70b [INLONG-7555][Manager] Fix the ttl time is invalid (#7556) add e9b10f04f [INLONG-7528][Script] Add

[GitHub] [inlong-website] dockerzhang merged pull request #706: [INLONG-7528][Doc] Add the Kafka support for audit standalone deployment

2023-03-12 Thread via GitHub
dockerzhang merged PR #706: URL: https://github.com/apache/inlong-website/pull/706 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@i

[inlong-website] branch master updated: [INLONG-7528][Doc] Add the Kafka support for audit standalone deployment (#706)

2023-03-12 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong-website.git The following commit(s) were added to refs/heads/master by this push: new 89cdb0f0a9 [INLONG-7528][Doc] Add t

[GitHub] [inlong] leezng merged pull request #7564: [INLONG-7563][Dashboard] Support specific partitions in the kudu sink

2023-03-12 Thread via GitHub
leezng merged PR #7564: URL: https://github.com/apache/inlong/pull/7564 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apach

[inlong] branch master updated (e9b10f04f -> 57e32b3e9)

2023-03-12 Thread leezng
This is an automated email from the ASF dual-hosted git repository. leezng pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from e9b10f04f [INLONG-7528][Script] Add the Kafka support for audit standalone deployment (#7571) add 57e32b3e9 [INL

[GitHub] [inlong] doleyzi commented on pull request #7538: [INLONG-7533][Agent] Fix that log cannot be collected for position reset

2023-03-12 Thread via GitHub
doleyzi commented on PR #7538: URL: https://github.com/apache/inlong/pull/7538#issuecomment-1465402364 > @doleyzi Hi, please refer this PR's comment, and reset to master brach again, thanks. > > #7403 thx -- This is an automated message from the Apache Git Service. To respon

[GitHub] [inlong] doleyzi commented on pull request #7538: [INLONG-7533][Agent] Fix that log cannot be collected for position reset

2023-03-12 Thread via GitHub
doleyzi commented on PR #7538: URL: https://github.com/apache/inlong/pull/7538#issuecomment-1465402626 > > @doleyzi Hi, please refer this PR's comment, and reset to master brach again, thanks. > > #7403 > > This PR has been pending for several days. In order to merge into the main

[inlong] branch master updated: [INLONG-7572][Docker] Add the Kafka support for audit docker deployment (#7573)

2023-03-12 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 715e1a226 [INLONG-7572][Docker] Add the Kaf

[GitHub] [inlong] dockerzhang merged pull request #7573: [INLONG-7572][Docker] Add the Kafka support for audit docker deployment

2023-03-12 Thread via GitHub
dockerzhang merged PR #7573: URL: https://github.com/apache/inlong/pull/7573 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[GitHub] [inlong] dockerzhang merged pull request #7538: [INLONG-7533][Agent] Fix that log cannot be collected for position reset

2023-03-12 Thread via GitHub
dockerzhang merged PR #7538: URL: https://github.com/apache/inlong/pull/7538 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated: [INLONG-7533][Agent] Fix that log cannot be collected for position reset (#7538)

2023-03-12 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new b6014fa5f [INLONG-7533][Agent] Fix that log

[GitHub] [inlong] yunqingmoswu merged pull request #7561: [INLONG-7559][Sort] Fix Oracle CDC reads timestamp type record error

2023-03-12 Thread via GitHub
yunqingmoswu merged PR #7561: URL: https://github.com/apache/inlong/pull/7561 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong

[inlong] branch master updated (b6014fa5f -> 0175d5c1d)

2023-03-12 Thread yunqing
This is an automated email from the ASF dual-hosted git repository. yunqing pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from b6014fa5f [INLONG-7533][Agent] Fix that log cannot be collected for position reset (#7538) add 0175d5c1d [INLON

[GitHub] [inlong] leezng commented on pull request #7562: [INLONG-7560][Dashboard] When submitting group approval, determine whether to create source and sink

2023-03-12 Thread via GitHub
leezng commented on PR #7562: URL: https://github.com/apache/inlong/pull/7562#issuecomment-1465418012 Waiting for discussion. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [inlong] healchow commented on a diff in pull request #7568: [INLONG-7567][Sort] Extract metrics as common parameters

2023-03-12 Thread via GitHub
healchow commented on code in PR #7568: URL: https://github.com/apache/inlong/pull/7568#discussion_r1133391303 ## inlong-sort/sort-connectors/cdc-base/src/main/java/org/apache/inlong/sort/cdc/base/config/MetricConfig.java: ## @@ -0,0 +1,29 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] healchow commented on a diff in pull request #7568: [INLONG-7567][Sort] Extract metrics as common parameters

2023-03-12 Thread via GitHub
healchow commented on code in PR #7568: URL: https://github.com/apache/inlong/pull/7568#discussion_r1133391303 ## inlong-sort/sort-connectors/cdc-base/src/main/java/org/apache/inlong/sort/cdc/base/config/MetricConfig.java: ## @@ -0,0 +1,29 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] fuweng11 opened a new pull request, #7578: [INLONG-7577][Manager] Fix the manager generate too many streamSource instances when pulling tasks.

2023-03-12 Thread via GitHub
fuweng11 opened a new pull request, #7578: URL: https://github.com/apache/inlong/pull/7578 ### Prepare a Pull Request - Fixes #7577 ### Motivation Fix the manager generate too many streamSource instances when pulling tasks. ### Modifications Fix the manager gen

[GitHub] [inlong] e-mhui commented on a diff in pull request #7568: [INLONG-7567][Sort] Extract metrics as common parameters

2023-03-12 Thread via GitHub
e-mhui commented on code in PR #7568: URL: https://github.com/apache/inlong/pull/7568#discussion_r1133403220 ## inlong-sort/sort-connectors/cdc-base/src/main/java/org/apache/inlong/sort/cdc/base/config/MetricConfig.java: ## @@ -0,0 +1,29 @@ +/* + * Licensed to the Apache Softwar

[GitHub] [inlong] dockerzhang merged pull request #7576: [INLONG-7575][Manager] Add audit_base table change script of 1.6.0 for Manager

2023-03-12 Thread via GitHub
dockerzhang merged PR #7576: URL: https://github.com/apache/inlong/pull/7576 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated (0175d5c1d -> ec3fcd16e)

2023-03-12 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 0175d5c1d [INLONG-7559][Sort] Fix Oracle CDC reads timestamp type record error (#7561) add ec3fcd16e [INLON

[GitHub] [inlong] EMsnap opened a new pull request, #7579: [Feature] Mysql CDC support output DDL model in all migrate #7553

2023-03-12 Thread via GitHub
EMsnap opened a new pull request, #7579: URL: https://github.com/apache/inlong/pull/7579 ### Prepare a Pull Request - Fixes #7553 ### Motivation [INLONG-7555][Sort] Mysql CDC support output DDL model in all migrate ### Modifications [INLONG-7555][Sort] Mysql CDC su

[GitHub] [inlong] healchow merged pull request #7568: [INLONG-7567][Sort] Extract metrics as common parameters

2023-03-12 Thread via GitHub
healchow merged PR #7568: URL: https://github.com/apache/inlong/pull/7568 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apa

[inlong] branch master updated: [INLONG-7567][Sort] Extract metrics as common parameters (#7568)

2023-03-12 Thread healchow
This is an automated email from the ASF dual-hosted git repository. healchow pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 3e96b0332 [INLONG-7567][Sort] Extract metrics

[GitHub] [inlong] healchow commented on a diff in pull request #7570: [INLONG-7537][Sort] Enable incremental snapshot and adapt metrics for MongoDB CDC

2023-03-12 Thread via GitHub
healchow commented on code in PR #7570: URL: https://github.com/apache/inlong/pull/7570#discussion_r1133421853 ## inlong-sort/sort-connectors/cdc-base/src/main/java/org/apache/inlong/sort/cdc/base/config/BaseSourceConfig.java: ## @@ -25,7 +25,7 @@ /** A basic Source configurati

[GitHub] [inlong-website] healchow commented on a diff in pull request #710: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC

2023-03-12 Thread via GitHub
healchow commented on code in PR #710: URL: https://github.com/apache/inlong-website/pull/710#discussion_r1133422201 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/extract_node/mongodb-cdc.md: ## @@ -126,11 +126,15 @@ TODO: 未来会支持 | collection| 必须

[GitHub] [inlong-website] healchow commented on a diff in pull request #710: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC

2023-03-12 Thread via GitHub
healchow commented on code in PR #710: URL: https://github.com/apache/inlong-website/pull/710#discussion_r1133422201 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/extract_node/mongodb-cdc.md: ## @@ -126,11 +126,15 @@ TODO: 未来会支持 | collection| 必须

[GitHub] [inlong-website] healchow commented on a diff in pull request #710: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC

2023-03-12 Thread via GitHub
healchow commented on code in PR #710: URL: https://github.com/apache/inlong-website/pull/710#discussion_r1133422455 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/extract_node/mongodb-cdc.md: ## @@ -126,11 +126,15 @@ TODO: 未来会支持 | collection| 必须

[GitHub] [inlong-website] healchow commented on a diff in pull request #710: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC

2023-03-12 Thread via GitHub
healchow commented on code in PR #710: URL: https://github.com/apache/inlong-website/pull/710#discussion_r1133422952 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/extract_node/mongodb-cdc.md: ## @@ -126,11 +126,15 @@ TODO: 未来会支持 | collection| 必须

[GitHub] [inlong] dockerzhang commented on pull request #7566: [INLONG-7565][Manager] Add audit id for Apache Kudu

2023-03-12 Thread via GitHub
dockerzhang commented on PR #7566: URL: https://github.com/apache/inlong/pull/7566#issuecomment-1465527786 please rebase from https://github.com/apache/inlong/pull/7576. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [inlong] healchow commented on a diff in pull request #7578: [INLONG-7577][Manager] Fix the manager generate too many streamSource instances when pulling tasks.

2023-03-12 Thread via GitHub
healchow commented on code in PR #7578: URL: https://github.com/apache/inlong/pull/7578#discussion_r1133480042 ## inlong-manager/manager-dao/src/main/java/org/apache/inlong/manager/dao/mapper/StreamSourceEntityMapper.java: ## @@ -41,6 +41,9 @@ public interface StreamSourceEntity

[GitHub] [inlong] GanfengTan commented on a diff in pull request #7517: [INLONG-7516][Manager][Sort][Agent] Decoupling Flink version dependencies for multiple versions of Apache Flink

2023-03-12 Thread via GitHub
GanfengTan commented on code in PR #7517: URL: https://github.com/apache/inlong/pull/7517#discussion_r1133480527 ## inlong-agent/pom.xml: ## @@ -36,4 +36,54 @@ agent-release agent-docker + + +1.8.0.Final Review Comment: Each component depe

[GitHub] [inlong] fuweng11 commented on a diff in pull request #7578: [INLONG-7577][Manager] Fix the manager generate too many streamSource instances when pulling tasks.

2023-03-12 Thread via GitHub
fuweng11 commented on code in PR #7578: URL: https://github.com/apache/inlong/pull/7578#discussion_r1133483152 ## inlong-manager/manager-dao/src/main/java/org/apache/inlong/manager/dao/mapper/StreamSourceEntityMapper.java: ## @@ -41,6 +41,9 @@ public interface StreamSourceEntity

[GitHub] [inlong] healchow commented on a diff in pull request #7578: [INLONG-7577][Manager] Fix high CPU usage when the number of StreamSource is too large

2023-03-12 Thread via GitHub
healchow commented on code in PR #7578: URL: https://github.com/apache/inlong/pull/7578#discussion_r1133487231 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/core/impl/AgentServiceImpl.java: ## @@ -338,31 +334,25 @@ private void preProcessTempl

[GitHub] [inlong] gong commented on pull request #7578: [INLONG-7577][Manager] Fix high CPU usage when the number of StreamSource is too large

2023-03-12 Thread via GitHub
gong commented on PR #7578: URL: https://github.com/apache/inlong/pull/7578#issuecomment-1465591104 @fuweng11 Maybe add some description that why it can solve this fix high CPU usage. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [inlong] gong commented on a diff in pull request #7558: [INLONG-7557][Sort] Fix class incompatible error between elasticsearch6 with elasticsearch7

2023-03-12 Thread via GitHub
gong commented on code in PR #7558: URL: https://github.com/apache/inlong/pull/7558#discussion_r1133509108 ## inlong-sort/sort-connectors/elasticsearch-6/src/main/java/org/apache/inlong/sort/elasticsearch6/Elasticsearch6BulkProcessorIndexer.java: ## @@ -53,32 +49,10 @@ class Ela