(seatunnel) branch dev updated: [Improve][Document] Fix Postgre to PostgreSQL in Postgre-CDC.md file (#7112)

2024-07-07 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 194472ba8f [Improve][Document] Fix Postgre to P

Re: [PR] [Improve][Document] Fix Postgre to PostgreSQL in Postgre-CDC.md file [seatunnel]

2024-07-07 Thread via GitHub
hailin0 merged PR #7112: URL: https://github.com/apache/seatunnel/pull/7112 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Feature][Zeta] Add Master and Worker split mode deployment [seatunnel]

2024-07-07 Thread via GitHub
hailin0 merged PR #6947: URL: https://github.com/apache/seatunnel/pull/6947 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Fix][Connector-V2][Elasticsearch]Fix sink configuration for DROP_DATA [seatunnel]

2024-07-07 Thread via GitHub
Hisoka-X commented on PR #7124: URL: https://github.com/apache/seatunnel/pull/7124#issuecomment-2213175038 Could you add a test case in https://github.com/apache/seatunnel/blob/ae818792131909b5b6ce2d5866360db5ff50a2d5/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-elasticsearch-e2e/src/t

Re: [PR] [Fix][Flink-starter]Hotfix flink checkpoint default value [seatunnel]

2024-07-07 Thread via GitHub
zhangshenghang commented on code in PR #7040: URL: https://github.com/apache/seatunnel/pull/7040#discussion_r1668077323 ## seatunnel-core/seatunnel-flink-starter/seatunnel-flink-13-starter/src/main/java/org/apache/seatunnel/core/starter/flink/execution/FlinkRuntimeEnvironment.java:

Re: [PR] [Fix][Flink-starter]Hotfix flink checkpoint default value [seatunnel]

2024-07-07 Thread via GitHub
Hisoka-X commented on code in PR #7040: URL: https://github.com/apache/seatunnel/pull/7040#discussion_r1668075519 ## seatunnel-core/seatunnel-flink-starter/seatunnel-flink-13-starter/src/main/java/org/apache/seatunnel/core/starter/flink/execution/FlinkRuntimeEnvironment.java: ##

Re: [PR] [Feature][Connector-V2] [Hudi]Add hudi sink connector [seatunnel]

2024-07-07 Thread via GitHub
EricJoy2048 commented on code in PR #4405: URL: https://github.com/apache/seatunnel/pull/4405#discussion_r1668070960 ## docs/en/connector-v2/sink/Hudi.md: ## @@ -0,0 +1,98 @@ +# Hudi + +> Hudi sink connector + +## Description + +Used to write data to Hudi. + +## Key features + +

Re: [PR] [Fix][Flink-starter]Hotfix flink checkpoint default value [seatunnel]

2024-07-07 Thread via GitHub
zhangshenghang commented on code in PR #7040: URL: https://github.com/apache/seatunnel/pull/7040#discussion_r1668072856 ## seatunnel-core/seatunnel-flink-starter/seatunnel-flink-13-starter/src/main/java/org/apache/seatunnel/core/starter/flink/execution/FlinkRuntimeEnvironment.java:

Re: [PR] [Fix][Flink-starter]Hotfix flink checkpoint default value [seatunnel]

2024-07-07 Thread via GitHub
Hisoka-X commented on PR #7040: URL: https://github.com/apache/seatunnel/pull/7040#issuecomment-2213139960 cc @TyrantLucifer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [Fix][Flink-starter]Hotfix flink checkpoint default value [seatunnel]

2024-07-07 Thread via GitHub
Hisoka-X commented on code in PR #7040: URL: https://github.com/apache/seatunnel/pull/7040#discussion_r1668058602 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/env/EnvCommonOptions.java: ## @@ -54,7 +54,7 @@ public interface EnvCommonOptions { Option CHECKPOINT_IN

Re: [PR] [Fix][Connector-V2][Elasticsearch]Fix sink configuration for DROP_DATA [seatunnel]

2024-07-07 Thread via GitHub
Hisoka-X commented on PR #7124: URL: https://github.com/apache/seatunnel/pull/7124#issuecomment-2213113627 cc @hailin0 as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[PR] [Feature][Connector-V2] Add emqx source connector [seatunnel]

2024-07-07 Thread via GitHub
Hisoka-X opened a new pull request, #7132: URL: https://github.com/apache/seatunnel/pull/7132 ### Purpose of this pull request This PR add new source connector emqx. Please refer https://docs.emqx.com/en/emqx/latest/ ### Does this PR introduce _any_ user-facing chan

[PR] [Improve][MulitTableSink] Refactor multi-table configurations [seatunnel]

2024-07-07 Thread via GitHub
hailin0 opened a new pull request, #7131: URL: https://github.com/apache/seatunnel/pull/7131 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list * [

[I] [Feature][connector-doris] Doris sink does not support auto-creating tables with a largeint type. [seatunnel]

2024-07-07 Thread via GitHub
chess3cake opened a new issue, #7130: URL: https://github.com/apache/seatunnel/issues/7130 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Improve][MulitTableSink] Refactor multi-table configurations [seatunnel]

2024-07-07 Thread via GitHub
hailin0 closed pull request #7129: [Improve][MulitTableSink] Refactor multi-table configurations URL: https://github.com/apache/seatunnel/pull/7129 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[PR] [Improve][MulitTableSink] Refactor multi-table configurations [seatunnel]

2024-07-07 Thread via GitHub
hailin0 opened a new pull request, #7129: URL: https://github.com/apache/seatunnel/pull/7129 ### Purpose of this pull request [MulitTableSink] Refactor multi-table configurations ### Does this PR introduce _any_ user-facing change? No ### How was this patch

(seatunnel) branch dev updated: [Fix][Connector-V2][CDC] SeaTunnelRowDebeziumDeserializationConverters NPE (#7119)

2024-07-07 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new ae81879213 [Fix][Connector-V2][CDC] SeaTunnelRowDe

Re: [PR] [bugFix][Connector-V2][CDC] SeaTunnelRowDebeziumDeserializationConverters NPE [seatunnel]

2024-07-07 Thread via GitHub
Hisoka-X merged PR #7119: URL: https://github.com/apache/seatunnel/pull/7119 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [I] postgreCDC TO hive [seatunnel]

2024-07-07 Thread via GitHub
Hisoka-X closed issue #6901: postgreCDC TO hive URL: https://github.com/apache/seatunnel/issues/6901 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[PR] [Feature][Core] Add a test case for dynamic custom parameters [seatunnel]

2024-07-07 Thread via GitHub
liugddx opened a new pull request, #7128: URL: https://github.com/apache/seatunnel/pull/7128 ### Purpose of this pull request close #7115 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

Re: [PR] [Fix][Connector-V2][Elasticsearch]Fix sink configuration for DROP_DATA [seatunnel]

2024-07-07 Thread via GitHub
Hisoka-X commented on PR #7124: URL: https://github.com/apache/seatunnel/pull/7124#issuecomment-2212993460 Thanks @Wudadada for created this PR! Could you follow the guide to open github action on your fork repository? https://github.com/apache/seatunnel/pull/7124/checks?check_run_id=271414

Re: [PR] [Fix][Connector-V2][Elasticsearch]Fix sink configuration for DROP_DATA [seatunnel]

2024-07-07 Thread via GitHub
Hisoka-X commented on PR #7124: URL: https://github.com/apache/seatunnel/pull/7124#issuecomment-2212992879 cc @chl-wxp as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [I] [Feature][Core] Introduce dynamic custom parameters [seatunnel]

2024-07-07 Thread via GitHub
liugddx closed issue #7115: [Feature][Core] Introduce dynamic custom parameters URL: https://github.com/apache/seatunnel/issues/7115 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] [Feature][Core] Introduce dynamic custom parameters [seatunnel]

2024-07-07 Thread via GitHub
liugddx closed pull request #7121: [Feature][Core] Introduce dynamic custom parameters URL: https://github.com/apache/seatunnel/pull/7121 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [Fix][Seatunnel-api]fix timestamp type [seatunnel]

2024-07-07 Thread via GitHub
Hisoka-X commented on PR #7126: URL: https://github.com/apache/seatunnel/pull/7126#issuecomment-2212937169 In fact, SeaTunnel doesn't support `Timestamp` type at now. We should make sure flink layer not send timestamp type to seatunnel connector. Please refer https://github.com/apache/seatu

[I] The seatunnel cluster has some error [seatunnel]

2024-07-07 Thread via GitHub
ccczhouxin opened a new issue, #7127: URL: https://github.com/apache/seatunnel/issues/7127 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [PR] [Feature][Connector-V2][Milvus] Support Milvus source & sink [seatunnel]

2024-07-07 Thread via GitHub
hailin0 commented on code in PR #7060: URL: https://github.com/apache/seatunnel/pull/7060#discussion_r1667879929 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-milvus-e2e/src/test/java/org/apache/seatunnel/e2e/connector/v2/milvus/MilvusIT.java: ## @@ -0,0 +1,208 @@ +packa

Re: [PR] [Feature][Connector-V2][Milvus] Support Milvus source & sink [seatunnel]

2024-07-07 Thread via GitHub
hailin0 commented on code in PR #7060: URL: https://github.com/apache/seatunnel/pull/7060#discussion_r1667879929 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-milvus-e2e/src/test/java/org/apache/seatunnel/e2e/connector/v2/milvus/MilvusIT.java: ## @@ -0,0 +1,208 @@ +packa

[PR] [Fix][Seatunnel-api]fix timestamp type [seatunnel]

2024-07-07 Thread via GitHub
litiliu opened a new pull request, #7126: URL: https://github.com/apache/seatunnel/pull/7126 ### Purpose of this pull request This close #7125 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? add UT case

Re: [PR] [Feature][Connector-V2][Milvus] Support Milvus source & sink [seatunnel]

2024-07-07 Thread via GitHub
hailin0 commented on code in PR #7060: URL: https://github.com/apache/seatunnel/pull/7060#discussion_r1667879929 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-milvus-e2e/src/test/java/org/apache/seatunnel/e2e/connector/v2/milvus/MilvusIT.java: ## @@ -0,0 +1,208 @@ +packa

[I] [Bug] [Seatunnel-api] Unsupported type: Timestamp [seatunnel]

2024-07-07 Thread via GitHub
litiliu opened a new issue, #7125: URL: https://github.com/apache/seatunnel/issues/7125 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[PR] [Fix][Connector-V2][Elasticsearch]Fix sink configuration for DROP_DATA [seatunnel]

2024-07-07 Thread via GitHub
Wudadada opened a new pull request, #7124: URL: https://github.com/apache/seatunnel/pull/7124 ### Purpose of this pull request According to the documentation, the logic for DROP_DATA is to preserve the database structure and delete the data. The original implementation

Re: [PR] [Feature][Connector-V2][Milvus] Support Milvus source & sink [seatunnel]

2024-07-07 Thread via GitHub
Thomas-HuWei commented on code in PR #7060: URL: https://github.com/apache/seatunnel/pull/7060#discussion_r1667868356 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/type/SqlType.java: ## @@ -36,5 +36,10 @@ public enum SqlType { TIME, TIMESTAMP, ROW,

Re: [I] [Bug] [seatunnel-engine-storage] map and checkpoint Writing HDFS Kerberos tickets with automatic 24-hour expiration [seatunnel]

2024-07-07 Thread via GitHub
weipengfei-sj commented on issue #7102: URL: https://github.com/apache/seatunnel/issues/7102#issuecomment-2212689311 ![image](https://github.com/apache/seatunnel/assets/36789477/d705d995-62f9-4ab4-9de5-5bba71a9478c) 我尝试在客户端增加了定时刷新,24h后,仍然是报kerberos认证的错误 -- This is an automated message

Re: [I] [Bug] Doris data synchronization error [seatunnel]

2024-07-07 Thread via GitHub
github-actions[bot] commented on issue #6909: URL: https://github.com/apache/seatunnel/issues/6909#issuecomment-2212667788 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] Doris data synchronization error [seatunnel]

2024-07-07 Thread via GitHub
github-actions[bot] closed issue #6909: [Bug] Doris data synchronization error URL: https://github.com/apache/seatunnel/issues/6909 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [I] 在海豚调度中使用seatunnel采集MySQL数据到ClickHouse问题 [seatunnel]

2024-07-07 Thread via GitHub
github-actions[bot] closed issue #6920: 在海豚调度中使用seatunnel采集MySQL数据到ClickHouse问题 URL: https://github.com/apache/seatunnel/issues/6920 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [I] 在海豚调度中使用seatunnel采集MySQL数据到ClickHouse问题 [seatunnel]

2024-07-07 Thread via GitHub
github-actions[bot] commented on issue #6920: URL: https://github.com/apache/seatunnel/issues/6920#issuecomment-2212667769 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] SQLSERVERCDC on flink :If the original table is an update, the target table will generate two pieces of data (one original record and one modified record). The following two sources have been

2024-07-07 Thread via GitHub
github-actions[bot] commented on issue #6926: URL: https://github.com/apache/seatunnel/issues/6926#issuecomment-2212667736 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] SQLSERVERCDC on flink :If the original table is an update, the target table will generate two pieces of data (one original record and one modified record). The following two sources have been

2024-07-07 Thread via GitHub
github-actions[bot] closed issue #6926: SQLSERVERCDC on flink :If the original table is an update, the target table will generate two pieces of data (one original record and one modified record). The following two sources have been verified and problems have been found in both of them URL: ht

[I] [Improve][RestAPI] overview api add tag filter [seatunnel]

2024-07-07 Thread via GitHub
liunaijie opened a new issue, #7123: URL: https://github.com/apache/seatunnel/issues/7123 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

[PR] [CI] Fix k8s engine it not run when only test case changed [seatunnel]

2024-07-07 Thread via GitHub
Hisoka-X opened a new pull request, #7122: URL: https://github.com/apache/seatunnel/pull/7122 ### Purpose of this pull request This PR fix k8s engine it not run when only test case changed ### Does this PR introduce _any_ user-facing change? no ###

[PR] [Feature][Core] Introduce dynamic custom parameters [seatunnel]

2024-07-07 Thread via GitHub
liugddx opened a new pull request, #7121: URL: https://github.com/apache/seatunnel/pull/7121 ### Purpose of this pull request close #7115 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check