[GitHub] [inlong] dockerzhang merged pull request #6794: [INLONG-6758][Dashboard] Unify the log function components of Group and Stream

2022-12-08 Thread GitBox
dockerzhang merged PR #6794: URL: https://github.com/apache/inlong/pull/6794 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated (08db5ea09 -> 9378a1cf0)

2022-12-08 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 08db5ea09 [INLONG-6765][Sort] Supports dirty data side-output for Iceberg sink (#6766) add 9378a1cf0 [INLON

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #6736: [INLONG-6735][Sort][Manager] PostgresSQL connector supports transferring all tables for all schemas in one database

2022-12-08 Thread GitBox
yunqingmoswu commented on code in PR #6736: URL: https://github.com/apache/inlong/pull/6736#discussion_r1043072039 ## inlong-sort/sort-connectors/base/pom.xml: ## @@ -47,6 +47,13 @@ com.amazonaws aws-java-sdk-s3 + + Review Comment:

[GitHub] [inlong] EMsnap merged pull request #6583: [INLONG-6428][Sort] Add connector to support elasticsearch-5.X

2022-12-08 Thread GitBox
EMsnap merged PR #6583: URL: https://github.com/apache/inlong/pull/6583 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apach

[inlong] branch master updated (9378a1cf0 -> b27e75b49)

2022-12-08 Thread zirui
This is an automated email from the ASF dual-hosted git repository. zirui pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 9378a1cf0 [INLONG-6758][Dashboard] Unify the log function components of Group and Stream (#6794) add b27e75b49 [I

[GitHub] [inlong] gong commented on a diff in pull request #6799: [INLONG-6797][Sort] Supports dirty data side-output for filesystem sink

2022-12-08 Thread GitBox
gong commented on code in PR #6799: URL: https://github.com/apache/inlong/pull/6799#discussion_r1043076118 ## inlong-sort/sort-connectors/filesystem/src/main/java/org/apache/inlong/sort/filesystem/stream/AbstractStreamingWriter.java: ## @@ -141,14 +161,10 @@ protected void commi

[GitHub] [inlong] dockerzhang merged pull request #6746: [INLONG-6745][Manager] Support StarRocks load node management

2022-12-08 Thread GitBox
dockerzhang merged PR #6746: URL: https://github.com/apache/inlong/pull/6746 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated (b27e75b49 -> 09f257b17)

2022-12-08 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from b27e75b49 [INLONG-6428][Sort] Add connector to support elasticsearch-5.X (#6583) add 09f257b17 [INLONG-6745

[GitHub] [inlong] EMsnap commented on a diff in pull request #6783: [INLONG-6782][Sort] Support Apache Hudi connector

2022-12-08 Thread GitBox
EMsnap commented on code in PR #6783: URL: https://github.com/apache/inlong/pull/6783#discussion_r1043081702 ## inlong-sort/sort-connectors/hudi/pom.xml: ## @@ -0,0 +1,125 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; +

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #6783: [INLONG-6782][Sort] Support Apache Hudi connector

2022-12-08 Thread GitBox
yunqingmoswu commented on code in PR #6783: URL: https://github.com/apache/inlong/pull/6783#discussion_r1043083581 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/Constants.java: ## @@ -122,6 +122,8 @@ public final class Constants { public st

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #6789: [INLONG-6784][Sort] Support load node of Apache Hudi

2022-12-08 Thread GitBox
yunqingmoswu commented on code in PR #6789: URL: https://github.com/apache/inlong/pull/6789#discussion_r1043085376 ## inlong-sort/sort-common/src/main/java/org/apache/inlong/sort/protocol/node/LoadNode.java: ## @@ -69,7 +70,8 @@ @JsonSubTypes.Type(value = OracleLoadNode

[GitHub] [inlong] leezng merged pull request #6798: [INLONG-6772][Dashboard] Support ClickHouse node management

2022-12-08 Thread GitBox
leezng merged PR #6798: URL: https://github.com/apache/inlong/pull/6798 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apach

[inlong] branch master updated (09f257b17 -> 41904c2a6)

2022-12-08 Thread leezng
This is an automated email from the ASF dual-hosted git repository. leezng pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 09f257b17 [INLONG-6745][Manager] Support StarRocks load node management (#6746) add 41904c2a6 [INLONG-6772][Dash

[GitHub] [inlong] bluewang opened a new pull request, #6801: [INLONG-6772][Dashboard] MySQL sink supports selecting MySQL nodes

2022-12-08 Thread GitBox
bluewang opened a new pull request, #6801: URL: https://github.com/apache/inlong/pull/6801 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be replace

[GitHub] [inlong] chyueyi commented on issue #6723: 官方文档Doris多表写入文档错误

2022-12-08 Thread GitBox
chyueyi commented on issue #6723: URL: https://github.com/apache/inlong/issues/6723#issuecomment-1342523530 > 这里是flink任务运行需要的Flink SQL。多表和整库同步的逻辑可以只关注多表部分,忽略单表的部分,可能会更容易理解。 多表的核心是: 1.mysql按正则读多表 'database-name' = 'user_db', 'table-name' = 'user_id_*' (这部分文档中写的确实有问题) 2.doris写设置如下参数: 'sink.mu

[GitHub] [inlong] healchow commented on a diff in pull request #6677: [INLONG-6676][Manager] Support list all InlongTopicInfo under a given cluster tag

2022-12-08 Thread GitBox
healchow commented on code in PR #6677: URL: https://github.com/apache/inlong/pull/6677#discussion_r1043245195 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/group/InlongGroupServiceImpl.java: ## @@ -415,6 +417,28 @@ public void saveOrUpdateExt

[GitHub] [inlong] ZuoFengZhang commented on a diff in pull request #6791: [INLONG-6786][Dashboard] Supoort Apache Hudi sink management

2022-12-08 Thread GitBox
ZuoFengZhang commented on code in PR #6791: URL: https://github.com/apache/inlong/pull/6791#discussion_r1043259127 ## inlong-dashboard/src/locales/cn.json: ## @@ -177,6 +177,25 @@ "meta.Sinks.Iceberg.FieldDescription": "字段描述", "meta.Sinks.Iceberg.PartitionStrategy": "分区策略"

[GitHub] [inlong] woofyzhao opened a new pull request, #6803: [INLONG-6802][Dataproxy][Manager] Adapt kafka MQ as cache cluster

2022-12-08 Thread GitBox
woofyzhao opened a new pull request, #6803: URL: https://github.com/apache/inlong/pull/6803 Manager: Support kafka mq Dataproxy: Adapt kafka mq and topic configuration -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [inlong] leezng commented on a diff in pull request #6801: [INLONG-6772][Dashboard] MySQL sink supports selecting MySQL nodes

2022-12-08 Thread GitBox
leezng commented on code in PR #6801: URL: https://github.com/apache/inlong/pull/6801#discussion_r1043262256 ## inlong-dashboard/src/metas/sinks/defaults/MySQL.ts: ## @@ -120,26 +108,34 @@ export default class HiveSink extends SinkInfo implements DataWithBackend, Rende enabl

[GitHub] [inlong] ZuoFengZhang commented on a diff in pull request #5547: [INLONG-5460][Sort][Manager] Support Apache Hudi

2022-12-08 Thread GitBox
ZuoFengZhang commented on code in PR #5547: URL: https://github.com/apache/inlong/pull/5547#discussion_r1043296573 ## inlong-sort/sort-common/src/main/java/org/apache/inlong/sort/protocol/node/load/HudiLoadNode.java: ## @@ -72,6 +79,7 @@ public Map tableOptions() { Map

[GitHub] [inlong-website] aloyszhang opened a new issue, #642: [Improve] [DOC] format docs for tubemq rpc

2022-12-08 Thread GitBox
aloyszhang opened a new issue, #642: URL: https://github.com/apache/inlong-website/issues/642 ### Description format docs for tubemq rpc ### Are you willing to submit PR? - [X] Yes, I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow thi

[GitHub] [inlong-website] aloyszhang opened a new pull request, #643: [Improve] [Doc] format docs for tubemq rpc

2022-12-08 Thread GitBox
aloyszhang opened a new pull request, #643: URL: https://github.com/apache/inlong-website/pull/643 - Fixes #642 ### Motivation Current docs for tubemq RPC are not formatted, this PR tries to fix this problem ### Modifications format docs for tubemq rpc, repl

[GitHub] [inlong] wangpeix commented on issue #6806: [Bug][Manager] Failed to start the sort task because the es hosts parameter is incorrect

2022-12-08 Thread GitBox
wangpeix commented on issue #6806: URL: https://github.com/apache/inlong/issues/6806#issuecomment-1343710577 `hosts` parameter is incorrect. `elasticsearch-6-inlong` connector need like this `http://host_name:port`, but manager give only host. Is there a problem with the parameters passed

[GitHub] [inlong] chyueyi commented on issue #6723: 官方文档Doris多表写入文档错误

2022-12-08 Thread GitBox
chyueyi commented on issue #6723: URL: https://github.com/apache/inlong/issues/6723#issuecomment-1343736167 这样写可以多表同步 ```sql SET 'execution.checkpointing.interval' = '3s'; SET 'table.dynamic-table-options.enabled' = 'true'; CREATE TABLE cdc_mysql_source ( `data` BYTES ME

[GitHub] [inlong] leezng merged pull request #6791: [INLONG-6786][Dashboard] Supoort Apache Hudi sink management

2022-12-08 Thread GitBox
leezng merged PR #6791: URL: https://github.com/apache/inlong/pull/6791 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apach

[inlong] branch master updated: [INLONG-6786][Dashboard] Supoort Apache Hudi sink management (#6791)

2022-12-08 Thread leezng
This is an automated email from the ASF dual-hosted git repository. leezng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new da1a03b1e [INLONG-6786][Dashboard] Supoort Apach

[GitHub] [inlong] healchow commented on a diff in pull request #6790: [INLONG-6785][Manager] Support register and manage the resource of Apache Hudi

2022-12-08 Thread GitBox
healchow commented on code in PR #6790: URL: https://github.com/apache/inlong/pull/6790#discussion_r104477 ## inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/sink/hudi/HudiPartition.java: ## @@ -0,0 +1,54 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] [inlong] healchow commented on a diff in pull request #6790: [INLONG-6785][Manager] Support register and manage the resource of Apache Hudi

2022-12-08 Thread GitBox
healchow commented on code in PR #6790: URL: https://github.com/apache/inlong/pull/6790#discussion_r1044001261 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/resource/sink/hudi/HudiCatalogClient.java: ## @@ -0,0 +1,218 @@ +/* + * Licensed to th

[GitHub] [inlong] healchow commented on a diff in pull request #6790: [INLONG-6785][Manager] Support register and manage the resource of Apache Hudi

2022-12-08 Thread GitBox
healchow commented on code in PR #6790: URL: https://github.com/apache/inlong/pull/6790#discussion_r1044003136 ## inlong-manager/manager-plugins/src/main/java/org/apache/inlong/manager/plugin/listener/RestartStreamListener.java: ## @@ -89,9 +89,11 @@ public ListenerResult listen

[GitHub] [inlong] chestnut-c commented on issue #6806: [Bug][Manager] Failed to start the sort task because the es hosts parameter is incorrect

2022-12-08 Thread GitBox
chestnut-c commented on issue #6806: URL: https://github.com/apache/inlong/issues/6806#issuecomment-1343754618 the hosts param of es parameter is incorrect, i will fix it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [inlong] gong commented on a diff in pull request #6793: [INLONG-6792][Sort] Supports dirty data side-output for hbase sink

2022-12-08 Thread GitBox
gong commented on code in PR #6793: URL: https://github.com/apache/inlong/pull/6793#discussion_r1044034036 ## inlong-sort/sort-connectors/hbase/src/main/java/org/apache/inlong/sort/hbase/sink/HBaseSinkFunction.java: ## @@ -220,29 +236,51 @@ private org.apache.hadoop.conf.Configu

[GitHub] [inlong] healchow commented on pull request #6790: [INLONG-6785][Manager] Support register and manage the resource of Apache Hudi

2022-12-08 Thread GitBox
healchow commented on PR #6790: URL: https://github.com/apache/inlong/pull/6790#issuecomment-1343767857 I don't seem to see unit tests. There are many modifications. It is recommended to add unit tests to key logic. -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [inlong] EMsnap merged pull request #6783: [INLONG-6782][Sort] Support Apache Hudi connector

2022-12-08 Thread GitBox
EMsnap merged PR #6783: URL: https://github.com/apache/inlong/pull/6783 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apach

[inlong] branch master updated (da1a03b1e -> 4bffa88d4)

2022-12-08 Thread zirui
This is an automated email from the ASF dual-hosted git repository. zirui pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from da1a03b1e [INLONG-6786][Dashboard] Supoort Apache Hudi sink management (#6791) add 4bffa88d4 [INLONG-6782][Sort]

[GitHub] [inlong] chestnut-c opened a new pull request, #6807: [INLONG-6806] Fix the hosts incorrect parameter delivered by the manager

2022-12-08 Thread GitBox
chestnut-c opened a new pull request, #6807: URL: https://github.com/apache/inlong/pull/6807 ### Prepare a Pull Request *(Change the title refer to the following example)* [INLONG-6806] Fix the hosts incorrect parameter delivered by the manager *(The following *XYZ* should be

[GitHub] [inlong] gong commented on a diff in pull request #6793: [INLONG-6792][Sort] Supports dirty data side-output for hbase sink

2022-12-08 Thread GitBox
gong commented on code in PR #6793: URL: https://github.com/apache/inlong/pull/6793#discussion_r1044044610 ## inlong-sort/sort-connectors/hbase/src/main/java/org/apache/inlong/sort/hbase/sink/HBaseSinkFunction.java: ## @@ -258,10 +296,6 @@ private void reportMetricAfterFlush() {

[GitHub] [inlong] dockerzhang commented on issue #5099: [Umbrella] Support Apache Hudi

2022-12-08 Thread GitBox
dockerzhang commented on issue #5099: URL: https://github.com/apache/inlong/issues/5099#issuecomment-1343790250 duplicated with #https://github.com/apache/inlong/issues/6781, close it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [inlong] dockerzhang closed pull request #5547: [INLONG-5460][Sort][Manager] Support Apache Hudi

2022-12-08 Thread GitBox
dockerzhang closed pull request #5547: [INLONG-5460][Sort][Manager] Support Apache Hudi URL: https://github.com/apache/inlong/pull/5547 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [inlong] dockerzhang commented on pull request #5547: [INLONG-5460][Sort][Manager] Support Apache Hudi

2022-12-08 Thread GitBox
dockerzhang commented on PR #5547: URL: https://github.com/apache/inlong/pull/5547#issuecomment-1343794519 duplicated with https://github.com/apache/inlong/pull/6789 and https://github.com/apache/inlong/pull/6790, close it. -- This is an automated message from the Apache Git Service. To r

[GitHub] [inlong] EMsnap merged pull request #6796: [INLONG-6795][Sort] Supports dirty data side-output for hive sink

2022-12-08 Thread GitBox
EMsnap merged PR #6796: URL: https://github.com/apache/inlong/pull/6796 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apach

[inlong] branch master updated (4bffa88d4 -> 009888d3a)

2022-12-08 Thread zirui
This is an automated email from the ASF dual-hosted git repository. zirui pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 4bffa88d4 [INLONG-6782][Sort] Support Apache Hudi connector (#6783) add 009888d3a [INLONG-6795][Sort] Supports dir

[GitHub] [inlong] gong commented on pull request #6796: [INLONG-6795][Sort] Supports dirty data side-output for hive sink

2022-12-08 Thread GitBox
gong commented on PR #6796: URL: https://github.com/apache/inlong/pull/6796#issuecomment-1343798753 @haifxu I think metric computing should be after checkpoint for hive. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [inlong] gong commented on a diff in pull request #6783: [INLONG-6782][Sort] Support Apache Hudi connector

2022-12-08 Thread GitBox
gong commented on code in PR #6783: URL: https://github.com/apache/inlong/pull/6783#discussion_r1044059410 ## inlong-sort/sort-connectors/hudi/src/main/resources/META-INF/services/org.apache.flink.table.factories.Factory: ## @@ -0,0 +1,33 @@ +# +# Licensed to the Apache Software

[GitHub] [inlong] gong commented on a diff in pull request #6783: [INLONG-6782][Sort] Support Apache Hudi connector

2022-12-08 Thread GitBox
gong commented on code in PR #6783: URL: https://github.com/apache/inlong/pull/6783#discussion_r1044060648 ## inlong-sort/sort-connectors/hudi/pom.xml: ## @@ -0,0 +1,125 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; +

[GitHub] [inlong] gong commented on pull request #6783: [INLONG-6782][Sort] Support Apache Hudi connector

2022-12-08 Thread GitBox
gong commented on PR #6783: URL: https://github.com/apache/inlong/pull/6783#issuecomment-1343802885 @ZuoFengZhang I add two comment -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [inlong] dockerzhang merged pull request #6807: [INLONG-6806][Manager] Fix the hosts incorrect parameter of es connector delivered by the manager

2022-12-08 Thread GitBox
dockerzhang merged PR #6807: URL: https://github.com/apache/inlong/pull/6807 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated: [INLONG-6806][Manager] Fix the hosts incorrect parameter of es connector delivered by the manager (#6807)

2022-12-08 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new fa00407e6 [INLONG-6806][Manager] Fix the ho

[GitHub] [inlong] e-mhui opened a new pull request, #6808: [Improve][Sort] Add read phase metric and table level metric for Oracle

2022-12-08 Thread GitBox
e-mhui opened a new pull request, #6808: URL: https://github.com/apache/inlong/pull/6808 Add read phase metric and table level metric for Oracle - Fixes #6751 ### Motivation Add read phase metric and table level metric for Oracle ### Modifications *Describe

[GitHub] [inlong] gong commented on a diff in pull request #6790: [INLONG-6785][Manager] Support register and manage the resource of Apache Hudi

2022-12-08 Thread GitBox
gong commented on code in PR #6790: URL: https://github.com/apache/inlong/pull/6790#discussion_r1044062420 ## inlong-manager/manager-service/pom.xml: ## @@ -557,5 +557,13 @@ flink-core test + +org.apache.hudi +h

[GitHub] [inlong] gong commented on pull request #6808: [Improve][Sort] Add read phase metric and table level metric for Oracle

2022-12-08 Thread GitBox
gong commented on PR #6808: URL: https://github.com/apache/inlong/pull/6808#issuecomment-1343808655 @e-mhui oracle need database-schema-table level metric, pr just add database-table. @chestnut-c please help review -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [inlong] e-mhui commented on pull request #6808: [INLONG-6751][Sort] Add read phase metric and table level metric for Oracle

2022-12-08 Thread GitBox
e-mhui commented on PR #6808: URL: https://github.com/apache/inlong/pull/6808#issuecomment-1343812145 > @e-mhui oracle need database-schema-table level metric, pr just add database-table. @chestnut-c please help review ok,I‘ll add it. -- This is an automated message from the Apache

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #6793: [INLONG-6792][Sort] Supports dirty data side-output for hbase sink

2022-12-08 Thread GitBox
yunqingmoswu commented on code in PR #6793: URL: https://github.com/apache/inlong/pull/6793#discussion_r1044074024 ## inlong-sort/sort-core/src/test/java/org/apache/inlong/sort/parser/HbaseLoadFlinkSqlParseTest.java: ## @@ -71,14 +72,21 @@ private MySqlExtractNode buildMySQLExtr

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #6793: [INLONG-6792][Sort] Supports dirty data side-output for hbase sink

2022-12-08 Thread GitBox
yunqingmoswu commented on code in PR #6793: URL: https://github.com/apache/inlong/pull/6793#discussion_r1044074120 ## inlong-sort/sort-connectors/hbase/src/main/java/org/apache/inlong/sort/hbase/sink/HBaseSinkFunction.java: ## @@ -220,29 +236,51 @@ private org.apache.hadoop.conf

[GitHub] [inlong] liaorui commented on pull request #6748: [INLONG-6747][Sort] StarRocks connector supports transferring all tables for all schemas in one database

2022-12-08 Thread GitBox
liaorui commented on PR #6748: URL: https://github.com/apache/inlong/pull/6748#issuecomment-1343823988 > @liaorui Please add packaging config for this connector in `inlong-distribution/src/main/assemblies/sort-connectors.xml` done -- This is an automated message from the Apache Git

[GitHub] [inlong] liaorui commented on pull request #6748: [INLONG-6747][Sort] StarRocks connector supports transferring all tables for all schemas in one database

2022-12-08 Thread GitBox
liaorui commented on PR #6748: URL: https://github.com/apache/inlong/pull/6748#issuecomment-1343824111 > @liaorui Please add base shade in starrocks.pom, ref to iceberg pom. Because It can avoid modifying base lead classloader problem. > > ``` > >

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #6799: [INLONG-6797][Sort] Supports dirty data side-output for filesystem sink

2022-12-08 Thread GitBox
yunqingmoswu commented on code in PR #6799: URL: https://github.com/apache/inlong/pull/6799#discussion_r1044076003 ## inlong-sort/sort-connectors/filesystem/src/main/java/org/apache/inlong/sort/filesystem/stream/AbstractStreamingWriter.java: ## @@ -141,14 +161,10 @@ protected vo

[GitHub] [inlong] wangpeix opened a new pull request, #6809: [INLONG-6804][Manager] Workflow initialization threw IllegalArgumentException: Unsupported FieldType text or keyword

2022-12-08 Thread GitBox
wangpeix opened a new pull request, #6809: URL: https://github.com/apache/inlong/pull/6809 ### Prepare a Pull Request - Title: [INLONG-6804][Manager] Workflow initialization threw IllegalArgumentException: Unsupported FieldType text or keyword - Fixes #6804 ### Motivation

[GitHub] [inlong] liaorui commented on pull request #6736: [INLONG-6735][Sort][Manager] PostgresSQL connector supports transferring all tables for all schemas in one database

2022-12-08 Thread GitBox
liaorui commented on PR #6736: URL: https://github.com/apache/inlong/pull/6736#issuecomment-1343883906 > Add license for copied code such as [RowDataDebeziumDeserializeSchema.java] done -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [inlong] liaorui commented on pull request #6736: [INLONG-6735][Sort][Manager] PostgresSQL connector supports transferring all tables for all schemas in one database

2022-12-08 Thread GitBox
liaorui commented on PR #6736: URL: https://github.com/apache/inlong/pull/6736#issuecomment-1343884044 > [DebeziumDeserializationSchema.java] and classes in table module can be reused in mysql-cdc, please reuse done -- This is an automated message from the Apache Git Service. To re

[GitHub] [inlong] liaorui commented on a diff in pull request #6736: [INLONG-6735][Sort][Manager] PostgresSQL connector supports transferring all tables for all schemas in one database

2022-12-08 Thread GitBox
liaorui commented on code in PR #6736: URL: https://github.com/apache/inlong/pull/6736#discussion_r1044115114 ## inlong-sort/sort-connectors/base/pom.xml: ## @@ -47,6 +47,13 @@ com.amazonaws aws-java-sdk-s3 + + Review Comment: Afte

[GitHub] [inlong-website] dockerzhang merged pull request #643: [INLONG-642][Doc] Reformat docs for tubemq rpc

2022-12-08 Thread GitBox
dockerzhang merged PR #643: URL: https://github.com/apache/inlong-website/pull/643 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@i

[GitHub] [inlong-website] dockerzhang closed issue #642: [Improve] [Doc] format docs for tubemq rpc

2022-12-08 Thread GitBox
dockerzhang closed issue #642: [Improve] [Doc] format docs for tubemq rpc URL: https://github.com/apache/inlong-website/issues/642 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[inlong-website] branch master updated: [INLONG-642][Doc] Reformat docs for tubemq rpc (#643)

2022-12-08 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong-website.git The following commit(s) were added to refs/heads/master by this push: new 40ed7b86bd [INLONG-642][Doc] Reform

[GitHub] [inlong] gong commented on a diff in pull request #6793: [INLONG-6792][Sort] Supports dirty data side-output for hbase sink

2022-12-08 Thread GitBox
gong commented on code in PR #6793: URL: https://github.com/apache/inlong/pull/6793#discussion_r1044119416 ## inlong-sort/sort-connectors/hbase/src/main/java/org/apache/inlong/sort/hbase/sink/HBaseSinkFunction.java: ## @@ -206,7 +205,6 @@ public void open(Configuration parameter

[GitHub] [inlong] dockerzhang merged pull request #6799: [INLONG-6797][Sort] Supports dirty data side-output for filesystem sink

2022-12-08 Thread GitBox
dockerzhang merged PR #6799: URL: https://github.com/apache/inlong/pull/6799 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated: [INLONG-6797][Sort] Supports dirty data side-output for filesystem sink (#6799)

2022-12-08 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 8d6bd8c08 [INLONG-6797][Sort] Supports dirt

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #6793: [INLONG-6792][Sort] Supports dirty data side-output for hbase sink

2022-12-08 Thread GitBox
yunqingmoswu commented on code in PR #6793: URL: https://github.com/apache/inlong/pull/6793#discussion_r1044122973 ## inlong-sort/sort-connectors/hbase/src/main/java/org/apache/inlong/sort/hbase/sink/HBaseSinkFunction.java: ## @@ -206,7 +205,6 @@ public void open(Configuration p

[GitHub] [inlong] dockerzhang merged pull request #6809: [INLONG-6804][Manager] Workflow initialization threw IllegalArgumentException: Unsupported FieldType text or keyword

2022-12-08 Thread GitBox
dockerzhang merged PR #6809: URL: https://github.com/apache/inlong/pull/6809 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated (8d6bd8c08 -> 4f8df13f6)

2022-12-08 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 8d6bd8c08 [INLONG-6797][Sort] Supports dirty data side-output for filesystem sink (#6799) add 4f8df13f6 [IN

[GitHub] [inlong] seedscoder commented on issue #6672: [Feature][Manager] Add `inlongctl` status management for the group

2022-12-08 Thread GitBox
seedscoder commented on issue #6672: URL: https://github.com/apache/inlong/issues/6672#issuecomment-1343956722 The `inlongctl list group` can display the status of the group. What's special about the `inlongctl status group` @dockerzhang -- This is an automated message from the Apache G

[GitHub] [inlong] dockerzhang merged pull request #6793: [INLONG-6792][Sort] Supports dirty data side-output for hbase sink

2022-12-08 Thread GitBox
dockerzhang merged PR #6793: URL: https://github.com/apache/inlong/pull/6793 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated: [INLONG-6792][Sort] Supports dirty data side-output for hbase sink (#6793)

2022-12-08 Thread dockerzhang
This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new cc9a7bda0 [INLONG-6792][Sort] Supports dirt