[GitHub] [inlong] liaorui opened a new pull request, #6741: [INLONG-6740][Sort][Manager]StarRocks connector supports transferring all tables for all schemas in one database

2022-12-05 Thread GitBox
liaorui opened a new pull request, #6741: URL: https://github.com/apache/inlong/pull/6741 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be replaced

[GitHub] [inlong-website] dockerzhang merged pull request #635: [INLONG-632] Home page style file optimization

2022-12-05 Thread GitBox
dockerzhang merged PR #635: URL: https://github.com/apache/inlong-website/pull/635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@i

[inlong-website] branch master updated: [INLONG-632] Home page style file optimization (#635)

2022-12-05 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong-website.git The following commit(s) were added to refs/heads/master by this push: new 14342e1b43 [INLONG-632] Home page s

[GitHub] [inlong-website] dockerzhang closed issue #632: [Improve] Home page style file optimization

2022-12-05 Thread GitBox
dockerzhang closed issue #632: [Improve] Home page style file optimization URL: https://github.com/apache/inlong-website/issues/632 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [inlong-website] LvJiancheng opened a new issue, #638: [Feature][Doc] Elasticsearch-6-inlong Connector is compatible with elasticsearch versions 5 and 6

2022-12-05 Thread GitBox
LvJiancheng opened a new issue, #638: URL: https://github.com/apache/inlong-website/issues/638 ### Description The elasticsearch-6-inlong Connector is compatible with elasticsearch versions 5 and 6 ### Use case Add support for elasticsearch-5 ### Are you willing t

[GitHub] [inlong] liaorui opened a new pull request, #6746: [INLONG-6745][Manager]Support StarRocks load node management

2022-12-05 Thread GitBox
liaorui opened a new pull request, #6746: URL: https://github.com/apache/inlong/pull/6746 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be replaced

[GitHub] [inlong] liaorui opened a new pull request, #6748: [Feature][Sort]StarRocks connector supports transferring all tables for all schemas in one database

2022-12-05 Thread GitBox
liaorui opened a new pull request, #6748: URL: https://github.com/apache/inlong/pull/6748 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be replaced

[GitHub] [inlong] haifxu opened a new pull request, #6750: [INLONG-6657][Sort] Add dirty metric for Kafka

2022-12-05 Thread GitBox
haifxu opened a new pull request, #6750: URL: https://github.com/apache/inlong/pull/6750 ### Prepare a Pull Request - Fixes #6749 ### Modifications 1. Check whether the writing is successful and then count. 2. Add dirty metric. 3. Supports topic-level metrics.

[GitHub] [inlong] Yizhou-Yang opened a new pull request, #6752: [INLONG-6730][Sort] Supports dirty data side-output for oracle sink

2022-12-05 Thread GitBox
Yizhou-Yang opened a new pull request, #6752: URL: https://github.com/apache/inlong/pull/6752 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be repl

[GitHub] [inlong] ZuoFengZhang opened a new pull request, #6753: [INLONG-6734][Manager] The Row_CSV data-type is not an inlong component

2022-12-05 Thread GitBox
ZuoFengZhang opened a new pull request, #6753: URL: https://github.com/apache/inlong/pull/6753 ### Prepare a Pull Request - The `Raw_CSV` data-type is not an inlong component - Fixes #6734 ### Motivation When `Raw-CSV` DataType is selected in DataStream, the m

[GitHub] [inlong] ZuoFengZhang opened a new pull request, #6755: [INLONG-6754][Manager] Bump version of pulsar-connector to 1.13.6.2

2022-12-05 Thread GitBox
ZuoFengZhang opened a new pull request, #6755: URL: https://github.com/apache/inlong/pull/6755 ### Prepare a Pull Request Bump version of pulsar-connector to 1.13.6.2 - Fixes #6754 ### Motivation Currently, the release candidate version used in sort-connector/puls

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #6726: [INLONG-6575][Sort] Add dirty data metric for Filesystem

2022-12-05 Thread GitBox
yunqingmoswu commented on code in PR #6726: URL: https://github.com/apache/inlong/pull/6726#discussion_r1040349083 ## inlong-sort/sort-connectors/filesystem/src/main/java/org/apache/inlong/sort/filesystem/stream/AbstractStreamingWriter.java: ## @@ -129,7 +136,20 @@ public void o

[GitHub] [inlong] vernedeng commented on a diff in pull request #6677: [INLONG-6676][Manager] Support list all InlongTopicInfo under a given cluster tag

2022-12-05 Thread GitBox
vernedeng commented on code in PR #6677: URL: https://github.com/apache/inlong/pull/6677#discussion_r1040349661 ## inlong-manager/manager-web/src/main/java/org/apache/inlong/manager/web/controller/InlongGroupController.java: ## @@ -95,6 +97,12 @@ public Response getTopic(@PathVa

[GitHub] [inlong] dockerzhang merged pull request #6755: [INLONG-6754][Sort] Bump version of pulsar-connector to 1.13.6.2

2022-12-05 Thread GitBox
dockerzhang merged PR #6755: URL: https://github.com/apache/inlong/pull/6755 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated: [INLONG-6754][Manager] Bump version of pulsar-connector to 1.13.6.2 (#6755)

2022-12-05 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 5dd216482 [INLONG-6754][Manager] Bump versi

[GitHub] [inlong] gong commented on a diff in pull request #6726: [INLONG-6575][Sort] Add dirty data metric for Filesystem

2022-12-05 Thread GitBox
gong commented on code in PR #6726: URL: https://github.com/apache/inlong/pull/6726#discussion_r1040356945 ## inlong-sort/sort-connectors/filesystem/src/main/java/org/apache/inlong/sort/filesystem/stream/AbstractStreamingWriter.java: ## @@ -129,7 +136,20 @@ public void open() th

[GitHub] [inlong] dockerzhang merged pull request #6658: [INLONG-6657][Sort] Add dirty data metric for Hive

2022-12-05 Thread GitBox
dockerzhang merged PR #6658: URL: https://github.com/apache/inlong/pull/6658 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated: [INLONG-6657][Sort] Add dirty data metric for Hive (#6658)

2022-12-05 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new f718ef32a [INLONG-6657][Sort] Add dirty dat

[GitHub] [inlong] kuansix commented on issue #6723: 官方文档Doris多表写入文档错误

2022-12-05 Thread GitBox
kuansix commented on issue #6723: URL: https://github.com/apache/inlong/issues/6723#issuecomment-1338660337 'sink.multiple.enable' = 'true', 'sink.multiple.format' = 'canal-json', 'sink.multiple.database-pattern' = '${database}', 'sink.multiple.table-pattern' = 'doris_${table}' --

[GitHub] [inlong] kuansix commented on issue #6723: 官方文档Doris多表写入文档错误

2022-12-05 Thread GitBox
kuansix commented on issue #6723: URL: https://github.com/apache/inlong/issues/6723#issuecomment-1338662543 这里是flink任务运行需要的Flink SQL。多表和整库同步的逻辑可以只关注多表部分,忽略单表的部分,可能会更容易理解。'sink.multiple.enable' = 'true', 'sink.multiple.format' = 'canal-json', 'sink.multiple.database-pattern' = '${databa

[GitHub] [inlong] kuansix commented on issue #6723: 官方文档Doris多表写入文档错误

2022-12-05 Thread GitBox
kuansix commented on issue #6723: URL: https://github.com/apache/inlong/issues/6723#issuecomment-1338662894 这里是flink任务运行需要的Flink SQL。多表和整库同步的逻辑可以只关注多表部分,忽略单表的部分,可能会更容易理解。 多表的核心是:doris写设置如下参数: 'sink.multiple.enable' = 'true', 'sink.multiple.format' = 'canal-json', 'sink.multiple.da

[GitHub] [inlong] kuansix commented on issue #6723: 官方文档Doris多表写入文档错误

2022-12-05 Thread GitBox
kuansix commented on issue #6723: URL: https://github.com/apache/inlong/issues/6723#issuecomment-1338670652 这里是flink任务运行需要的Flink SQL。多表和整库同步的逻辑可以只关注多表部分,忽略单表的部分,可能会更容易理解。 多表的核心是: 1.mysql按正则读多表 'database-name' = 'user_db', 'table-name' = 'user_id_*' (这部分文档中写的确实有问题) 3.dori

[GitHub] [inlong] bluewang opened a new pull request, #6757: [INLONG-6744][Dashboard] Hive sink supports selecting hive nodes

2022-12-05 Thread GitBox
bluewang opened a new pull request, #6757: URL: https://github.com/apache/inlong/pull/6757 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be replace

[GitHub] [inlong] dockerzhang merged pull request #6709: [INLONG-6704][Agent] Add PulsarSink

2022-12-05 Thread GitBox
dockerzhang merged PR #6709: URL: https://github.com/apache/inlong/pull/6709 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated: [INLONG-6704][Agent] Add PulsarSink (#6709)

2022-12-05 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 7552b05f9 [INLONG-6704][Agent] Add PulsarSi

[GitHub] [inlong] leezng commented on a diff in pull request #6757: [INLONG-6744][Dashboard] Hive sink supports selecting hive nodes

2022-12-05 Thread GitBox
leezng commented on code in PR #6757: URL: https://github.com/apache/inlong/pull/6757#discussion_r1040414222 ## inlong-dashboard/src/metas/sinks/defaults/Hive.ts: ## @@ -117,39 +117,33 @@ export default class HiveSink extends SinkInfo implements DataWithBackend, Rende passwo

[GitHub] [inlong] e-mhui closed pull request #6642: [INLONG-6640][Manager][Sort] Function field type supports transform nodes

2022-12-05 Thread GitBox
e-mhui closed pull request #6642: [INLONG-6640][Manager][Sort] Function field type supports transform nodes URL: https://github.com/apache/inlong/pull/6642 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [inlong] yunqingmoswu merged pull request #6726: [INLONG-6575][Sort] Add dirty data metric for Filesystem

2022-12-05 Thread GitBox
yunqingmoswu merged PR #6726: URL: https://github.com/apache/inlong/pull/6726 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong

[inlong] branch master updated: [INLONG-6575][Sort] Add dirty data metric for Filesystem (#6726)

2022-12-05 Thread yunqing
This is an automated email from the ASF dual-hosted git repository. yunqing pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new b7c6f49d7 [INLONG-6575][Sort] Add dirty data me

[GitHub] [inlong] ZuoFengZhang closed pull request #6753: [INLONG-6734][Manager] The Raw_CSV data-type marked as not an inlong component

2022-12-05 Thread GitBox
ZuoFengZhang closed pull request #6753: [INLONG-6734][Manager] The Raw_CSV data-type marked as not an inlong component URL: https://github.com/apache/inlong/pull/6753 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [inlong] pocozh opened a new pull request, #6760: [INLONG-6759][Agent] Improve code style

2022-12-05 Thread GitBox
pocozh opened a new pull request, #6760: URL: https://github.com/apache/inlong/pull/6760 ### Prepare a Pull Request *(Change the title refer to the following example)* - [INLONG-6759][Agent] Improve code style *(The following *XYZ* should be replaced by the actual [GitHub Is

[GitHub] [inlong-website] allendang001 commented on issue #625: [Feature][Doc] Translate C++ SDK report guide

2022-12-05 Thread GitBox
allendang001 commented on issue #625: URL: https://github.com/apache/inlong-website/issues/625#issuecomment-1338857435 i want to translate,can you assign it to me? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [inlong] dockerzhang merged pull request #6760: [INLONG-6759][Agent] Improve code style

2022-12-05 Thread GitBox
dockerzhang merged PR #6760: URL: https://github.com/apache/inlong/pull/6760 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated: [INLONG-6759][Agent] Improve code style (#6760)

2022-12-05 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new f8faf2b37 [INLONG-6759][Agent] Improve code

[GitHub] [inlong] fuweng11 opened a new pull request, #6764: [INLONG-6763][Manager] Remove unnecessary validation when saving HiveSinkRequest

2022-12-05 Thread GitBox
fuweng11 opened a new pull request, #6764: URL: https://github.com/apache/inlong/pull/6764 ### Prepare a Pull Request - Fixes #6763 ### Motivation Remove unnecessary validation when saving HiveSinkRequest ### Modifications Remove unnecessary validation when

[GitHub] [inlong] gong commented on a diff in pull request #6741: [INLONG-6740][Sort][Manager]StarRocks connector supports transferring all tables for all schemas in one database

2022-12-05 Thread GitBox
gong commented on code in PR #6741: URL: https://github.com/apache/inlong/pull/6741#discussion_r1040598144 ## inlong-sort/sort-connectors/starrocks/pom.xml: ## @@ -0,0 +1,80 @@ + + + +http://maven.apache.org/POM/4.0.0"; +xmlns:xsi="http://www.w3.org/2001/XMLSchema-instan

[GitHub] [inlong] gong commented on a diff in pull request #6741: [INLONG-6740][Sort][Manager]StarRocks connector supports transferring all tables for all schemas in one database

2022-12-05 Thread GitBox
gong commented on code in PR #6741: URL: https://github.com/apache/inlong/pull/6741#discussion_r1040600749 ## inlong-sort/sort-connectors/starrocks/src/main/java/org/apache/inlong/sort/starrocks/table/sink/StarRocksDynamicTableSinkFactory.java: ## @@ -0,0 +1,153 @@ +/* + * Licen

[GitHub] [inlong] yunqingmoswu opened a new pull request, #6766: [INLONG-6765][Sort] Supports dirty data side-output for iceberg sink

2022-12-05 Thread GitBox
yunqingmoswu opened a new pull request, #6766: URL: https://github.com/apache/inlong/pull/6766 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title: [INLONG-6765][Sort] Supports dirty data side-output for iceberg sink *(The following *XYZ* sh