[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #4396: [Feature][Transform V2 & Zeta] Make SplitTransform Support CatalogTable And CatalogTable Evolution

2023-03-24 Thread via GitHub
hailin0 commented on code in PR #4396: URL: https://github.com/apache/incubator-seatunnel/pull/4396#discussion_r1147198563 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/transform/SeaTunnelTransform.java: ## @@ -47,6 +48,13 @@ default void open() {} */ SeaTu

[GitHub] [incubator-seatunnel] EricJoy2048 commented on a diff in pull request #4396: [Feature][Transform V2 & Zeta] Make SplitTransform Support CatalogTable And CatalogTable Evolution

2023-03-24 Thread via GitHub
EricJoy2048 commented on code in PR #4396: URL: https://github.com/apache/incubator-seatunnel/pull/4396#discussion_r1147204788 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/transform/SeaTunnelTransform.java: ## @@ -47,6 +48,13 @@ default void open() {} */ S

[GitHub] [incubator-seatunnel-website] EricJoy2048 commented on a diff in pull request #217: [Feature][Doc] Add Release Manager Document To WebSite

2023-03-24 Thread via GitHub
EricJoy2048 commented on code in PR #217: URL: https://github.com/apache/incubator-seatunnel-website/pull/217#discussion_r1147216744 ## community/contribution_guide/release.md: ## @@ -0,0 +1,631 @@ +# Become Apache Release Manager + +Release managers shepherd a release from an

[incubator-seatunnel] branch dev updated: [Feature][Transform2] Add UDF SPI and a example implement for SQL Transform plugin (#4392)

2023-03-24 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new afee5de55 [Feature][Transform2] Add UDF S

[GitHub] [incubator-seatunnel] Hisoka-X merged pull request #4392: [Feature][Transform2] Add UDF SPI and a example implement for SQL Transform plugin

2023-03-24 Thread via GitHub
Hisoka-X merged PR #4392: URL: https://github.com/apache/incubator-seatunnel/pull/4392 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr.

[GitHub] [incubator-seatunnel] EricJoy2048 merged pull request #4315: [Feature][Zeta][REST-API] Add REST API To Get System Monitoring Information

2023-03-24 Thread via GitHub
EricJoy2048 merged PR #4315: URL: https://github.com/apache/incubator-seatunnel/pull/4315 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [incubator-seatunnel] EricJoy2048 closed issue #4144: [Feature][Zeta][REST-API]Get system monitoring information.

2023-03-24 Thread via GitHub
EricJoy2048 closed issue #4144: [Feature][Zeta][REST-API]Get system monitoring information. URL: https://github.com/apache/incubator-seatunnel/issues/4144 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[incubator-seatunnel] branch dev updated: [Feature][Zeta][REST-API] Add REST API To Get System Monitoring Information (#4315)

2023-03-24 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new e1b69a2ae [Feature][Zeta][REST-API]

[GitHub] [incubator-seatunnel] ic4y commented on a diff in pull request #4407: [e2e] Add TiDB JDBC e2e

2023-03-24 Thread via GitHub
ic4y commented on code in PR #4407: URL: https://github.com/apache/incubator-seatunnel/pull/4407#discussion_r1147241018 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-3/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/JdbcTidbIT.java:

[GitHub] [incubator-seatunnel] EricJoy2048 commented on a diff in pull request #4372: [Feature][Connector] http connector support pagable

2023-03-24 Thread via GitHub
EricJoy2048 commented on code in PR #4372: URL: https://github.com/apache/incubator-seatunnel/pull/4372#discussion_r1147246611 ## seatunnel-connectors-v2/connector-http/connector-http-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/http/config/PagingField.java: ##

[GitHub] [incubator-seatunnel] EricJoy2048 commented on a diff in pull request #4364: [Feature][Connector-V2][Kafka]Kafka source supports data deserializat…

2023-03-24 Thread via GitHub
EricJoy2048 commented on code in PR #4364: URL: https://github.com/apache/incubator-seatunnel/pull/4364#discussion_r1147253682 ## docs/en/connector-v2/source/kafka.md: ## @@ -28,6 +28,7 @@ Source connector for Apache Kafka. | common-options | config | no

[GitHub] [incubator-seatunnel] EricJoy2048 commented on a diff in pull request #4358: [Feature][shade] Add guava shade module

2023-03-24 Thread via GitHub
EricJoy2048 commented on code in PR #4358: URL: https://github.com/apache/incubator-seatunnel/pull/4358#discussion_r1147256177 ## seatunnel-shade/seatunnel-guava/pom.xml: ## @@ -0,0 +1,98 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-i

[GitHub] [incubator-seatunnel] EricJoy2048 merged pull request #4302: [Bug][Connector-v2][KafkaSink]Fix KafkaProducer resources have never been released.

2023-03-24 Thread via GitHub
EricJoy2048 merged PR #4302: URL: https://github.com/apache/incubator-seatunnel/pull/4302 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[incubator-seatunnel] branch dev updated: Fix KafkaProducer resources have never been released. (#4302)

2023-03-24 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new f99f02caa Fix KafkaProducer resources

[GitHub] [incubator-seatunnel] EricJoy2048 merged pull request #4246: [Bug][Connector-v2][KafkaSink]Fix the permission problem caused by client.id.

2023-03-24 Thread via GitHub
EricJoy2048 merged PR #4246: URL: https://github.com/apache/incubator-seatunnel/pull/4246 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[incubator-seatunnel] branch dev updated: [Bug][Connector-v2][KafkaSink]Fix the permission problem caused by client.id. (#4246)

2023-03-24 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 3cdb7cfa4 [Bug][Connector-v2][KafkaSi

[GitHub] [incubator-seatunnel] liugddx merged pull request #4379: [Bug][Connector-v2][KafkaSource]Fix KafkaConsumerThread exit caused by commit offset error.

2023-03-24 Thread via GitHub
liugddx merged PR #4379: URL: https://github.com/apache/incubator-seatunnel/pull/4379 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[incubator-seatunnel] branch dev updated (3cdb7cfa4 -> 71f4d0c78)

2023-03-24 Thread liugddx
This is an automated email from the ASF dual-hosted git repository. liugddx pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from 3cdb7cfa4 [Bug][Connector-v2][KafkaSink]Fix the permission problem caused by client.id. (#4246) add 7

[GitHub] [incubator-seatunnel] EricJoy2048 commented on pull request #3867: [feature][cdc][postgres] add PostgreSQL CDC

2023-03-24 Thread via GitHub
EricJoy2048 commented on PR #3867: URL: https://github.com/apache/incubator-seatunnel/pull/3867#issuecomment-1482444200 @hailin0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [incubator-seatunnel] lightzhao commented on pull request #4382: [Feature][Connector-v2][PulsarSink]Add Pulsar Sink Connector.

2023-03-24 Thread via GitHub
lightzhao commented on PR #4382: URL: https://github.com/apache/incubator-seatunnel/pull/4382#issuecomment-1482448585 Hello everyone, ci check cannot pautomatically, ci check require approval? -- This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [incubator-seatunnel-website] EricJoy2048 merged pull request #216: [Feature][Doc] Add Security Page To WebSite

2023-03-24 Thread via GitHub
EricJoy2048 merged PR #216: URL: https://github.com/apache/incubator-seatunnel-website/pull/216 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-

[incubator-seatunnel-website] branch main updated: [Feature][Doc] Add Security Page To WebSite (#216)

2023-03-24 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-website.git The following commit(s) were added to refs/heads/main by this push: new ff8abbcd25 [Feature][Doc]

[GitHub] [incubator-seatunnel] lightzhao commented on issue #4397: Every source or sink connector may have a complete configuration file like datax

2023-03-24 Thread via GitHub
lightzhao commented on issue #4397: URL: https://github.com/apache/incubator-seatunnel/issues/4397#issuecomment-1482465924 The Example module in the document has listed the basic configuration of the connector, if it does not involve permission configuration, it can be used directly. --

[GitHub] [incubator-seatunnel] lightzhao commented on issue #4371: Null Pointer Exception while synchronising data from mysql to mysql using mysql cdc connector.

2023-03-24 Thread via GitHub
lightzhao commented on issue #4371: URL: https://github.com/apache/incubator-seatunnel/issues/4371#issuecomment-1482475848 Your Mysql-CDC module configuration is missing the 'database.user' parameter -- This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [incubator-seatunnel-website] lianghuan-xatu commented on a diff in pull request #217: [Feature][Doc] Add Release Manager Document To WebSite

2023-03-24 Thread via GitHub
lianghuan-xatu commented on code in PR #217: URL: https://github.com/apache/incubator-seatunnel-website/pull/217#discussion_r1147312805 ## community/contribution_guide/release.md: ## @@ -0,0 +1,631 @@ +# Become Apache Release Manager + +Release managers shepherd a release from

[GitHub] [incubator-seatunnel] EricJoy2048 merged pull request #4396: [Feature][Transform V2 & Zeta] Make SplitTransform Support CatalogTable And CatalogTable Evolution

2023-03-24 Thread via GitHub
EricJoy2048 merged PR #4396: URL: https://github.com/apache/incubator-seatunnel/pull/4396 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[incubator-seatunnel] branch dev updated: [Feature][Transform V2 & Zeta] Make SplitTransform Support CatalogTable And CatalogTable Evolution (#4396)

2023-03-24 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new cee6c1983 [Feature][Transform V2 & Ze

[GitHub] [incubator-seatunnel] EricJoy2048 opened a new pull request, #4411: [Feature][Transform]

2023-03-24 Thread via GitHub
EricJoy2048 opened a new pull request, #4411: URL: https://github.com/apache/incubator-seatunnel/pull/4411 sub task of https://github.com/apache/incubator-seatunnel/issues/4402 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [incubator-seatunnel] ashulin commented on a diff in pull request #4404: [Feature][Transform] Support copy field list

2023-03-24 Thread via GitHub
ashulin commented on code in PR #4404: URL: https://github.com/apache/incubator-seatunnel/pull/4404#discussion_r1147419471 ## seatunnel-e2e/seatunnel-transforms-v2-e2e/seatunnel-transforms-v2-e2e-part-1/src/test/resources/copy_transform.conf: ## @@ -42,11 +42,20 @@ transform {

[GitHub] [incubator-seatunnel] ashulin opened a new pull request, #4412: [hotfix][DAG] fix MultipleTableJobConfigParser parse only one transform

2023-03-24 Thread via GitHub
ashulin opened a new pull request, #4412: URL: https://github.com/apache/incubator-seatunnel/pull/4412 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary p

[GitHub] [incubator-seatunnel] TyrantLucifer merged pull request #4364: [Feature][Connector-V2][Kafka]Kafka source supports data deserializat…

2023-03-24 Thread via GitHub
TyrantLucifer merged PR #4364: URL: https://github.com/apache/incubator-seatunnel/pull/4364 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[incubator-seatunnel] branch dev updated: [Feature][Connector-V2][Kafka] Kafka source supports data deserialization failure skipping (#4364)

2023-03-24 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new e1ed22b15 [Feature][Connector-V2][

[GitHub] [incubator-seatunnel] TyrantLucifer commented on a diff in pull request #4372: [Feature][Connector] http connector support pagable

2023-03-24 Thread via GitHub
TyrantLucifer commented on code in PR #4372: URL: https://github.com/apache/incubator-seatunnel/pull/4372#discussion_r1147673580 ## docs/en/connector-v2/source/Http.md: ## @@ -289,6 +293,32 @@ Http { } ``` +### page options + +## Example + +simple: + +```hocon +Http { + ur

[GitHub] [incubator-seatunnel] TyrantLucifer merged pull request #4412: [Hotfix][Zeta] Fix MultipleTableJobConfigParser parse only one transform

2023-03-24 Thread via GitHub
TyrantLucifer merged PR #4412: URL: https://github.com/apache/incubator-seatunnel/pull/4412 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[incubator-seatunnel] branch dev updated: [Hotfix][Zeta] Fix MultipleTableJobConfigParser parse only one transform (#4412)

2023-03-24 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 5afafb7eb [Hotfix][Zeta] Fix Multi

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #4093: [Umbrella] Enrich Catalog

2023-03-24 Thread via GitHub
github-actions[bot] commented on issue #4093: URL: https://github.com/apache/incubator-seatunnel/issues/4093#issuecomment-1483626716 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. --

[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #4093: [Umbrella] Enrich Catalog

2023-03-24 Thread via GitHub
github-actions[bot] closed issue #4093: [Umbrella] Enrich Catalog URL: https://github.com/apache/incubator-seatunnel/issues/4093 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [incubator-seatunnel] github-actions[bot] commented on pull request #3116: [Feature][Connector-V2] Kylin source connector

2023-03-24 Thread via GitHub
github-actions[bot] commented on PR #3116: URL: https://github.com/apache/incubator-seatunnel/pull/3116#issuecomment-1483626782 This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in i

[GitHub] [incubator-seatunnel] github-actions[bot] closed pull request #3116: [Feature][Connector-V2] Kylin source connector

2023-03-24 Thread via GitHub
github-actions[bot] closed pull request #3116: [Feature][Connector-V2] Kylin source connector URL: https://github.com/apache/incubator-seatunnel/pull/3116 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #4090: [Bug] [Connector-ClickHouse] The date type cannot maintain the original type

2023-03-24 Thread via GitHub
github-actions[bot] commented on issue #4090: URL: https://github.com/apache/incubator-seatunnel/issues/4090#issuecomment-1483626746 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity

[GitHub] [incubator-seatunnel] TyrantLucifer closed pull request #4369: ci(backend): add commit message check step

2023-03-24 Thread via GitHub
TyrantLucifer closed pull request #4369: ci(backend): add commit message check step URL: https://github.com/apache/incubator-seatunnel/pull/4369 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [incubator-seatunnel] TyrantLucifer closed pull request #4369: ci(backend): add commit message check step

2023-03-24 Thread via GitHub
TyrantLucifer closed pull request #4369: ci(backend): add commit message check step URL: https://github.com/apache/incubator-seatunnel/pull/4369 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [incubator-seatunnel] TyrantLucifer closed pull request #4369: ci(backend): add commit message check step

2023-03-24 Thread via GitHub
TyrantLucifer closed pull request #4369: ci(backend): add commit message check step URL: https://github.com/apache/incubator-seatunnel/pull/4369 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s