Re: [PR] [connector-file-local][feature] add save mode function for localfile [seatunnel]

2024-07-05 Thread via GitHub
chl-wxp commented on code in PR #7080: URL: https://github.com/apache/seatunnel/pull/7080#discussion_r1666503088 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-file-local-e2e/src/test/resources/json/fake_to_local_file_json.conf: ## @@ -77,5 +77,7 @@ sink { file_forma

[I] Whether the paging function of the http connector can specify the page from which to read [seatunnel]

2024-07-05 Thread via GitHub
gaowudi opened a new issue, #7114: URL: https://github.com/apache/seatunnel/issues/7114 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

[I] [Feature][Core] Introduce dynamic custom parameters [seatunnel]

2024-07-05 Thread via GitHub
liugddx opened a new issue, #7115: URL: https://github.com/apache/seatunnel/issues/7115 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

Re: [PR] [Feature][Connector-V2] [Hudi]Add hudi sink connector [seatunnel]

2024-07-05 Thread via GitHub
EricJoy2048 commented on code in PR #4405: URL: https://github.com/apache/seatunnel/pull/4405#discussion_r1666597978 ## docs/en/connector-v2/sink/Hudi.md: ## @@ -0,0 +1,98 @@ +# Hudi + +> Hudi sink connector + +## Description + +Used to write data to Hudi. + +## Key features + +

Re: [I] [Feature][Core] Introduce dynamic custom parameters [seatunnel]

2024-07-05 Thread via GitHub
CheneyYin commented on issue #7115: URL: https://github.com/apache/seatunnel/issues/7115#issuecomment-2210677122 Hi, @liugddx What is the access scope of dynamic parameters? The command substitutions function provided by the shell can also output parameters. Compared with command sub

Re: [PR] [bugFix][Connector-V2][CDC] SeaTunnelRowDebeziumDeserializationConverters NPE [seatunnel]

2024-07-05 Thread via GitHub
Hisoka-X commented on PR #7113: URL: https://github.com/apache/seatunnel/pull/7113#issuecomment-2210741001 cc @hailin0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] [Improve][Document] Fix Postgre to PostgreSQL in Postgre-CDC.md file [seatunnel]

2024-07-05 Thread via GitHub
Hisoka-X commented on PR #7112: URL: https://github.com/apache/seatunnel/pull/7112#issuecomment-2210741885 Please follow the guide to open github action on your fork repository. ![image](https://github.com/apache/seatunnel/assets/32387433/949427e9-9ccb-46d8-9158-598bc0a6ad12) -- T

Re: [PR] [Feature][Connector-V2][Milvus] Support Milvus source & sink [seatunnel]

2024-07-05 Thread via GitHub
Hisoka-X commented on code in PR #7060: URL: https://github.com/apache/seatunnel/pull/7060#discussion_r1666726117 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/type/SqlType.java: ## @@ -36,5 +36,10 @@ public enum SqlType { TIME, TIMESTAMP, ROW, +

Re: [PR] [Hotfix][connector-v2-rabbit] fix rabbit checkpoint exception in Flink mode [seatunnel]

2024-07-05 Thread via GitHub
hailin0 merged PR #7108: URL: https://github.com/apache/seatunnel/pull/7108 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [I] [Bug] [connector-v2-rabbit] Rabbit Checkpoint exception in Flink mode [seatunnel]

2024-07-05 Thread via GitHub
hailin0 closed issue #7098: [Bug] [connector-v2-rabbit] Rabbit Checkpoint exception in Flink mode URL: https://github.com/apache/seatunnel/issues/7098 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

(seatunnel) branch dev updated: [Hotfix][connector-v2-rabbit] fix rabbit checkpoint exception in Flink mode (#7108)

2024-07-05 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 423a7b142b [Hotfix][connector-v2-rabbit] fix ra

Re: [PR] [Improve][Zeta] Add check for submit duplicate job id [seatunnel]

2024-07-05 Thread via GitHub
hailin0 commented on code in PR #7021: URL: https://github.com/apache/seatunnel/pull/7021#discussion_r1666779375 ## seatunnel-engine/seatunnel-engine-core/src/main/java/org/apache/seatunnel/engine/core/protocol/codec/SeaTunnelSubmitJobCodec.java: ## @@ -37,30 +40,40 @@ * to s

Re: [I] [Feature][Core] Introduce dynamic custom parameters [seatunnel]

2024-07-05 Thread via GitHub
liugddx commented on issue #7115: URL: https://github.com/apache/seatunnel/issues/7115#issuecomment-2210885837 > Hi, @liugddx What is the access scope of dynamic parameters? The command substitutions function provided by the shell can also output parameters. Compared with command substituti

[PR] [feature][connector-v2-hbase-sink] Support Connector v2 HBase sink TTL data writing [seatunnel]

2024-07-05 Thread via GitHub
zhangshenghang opened a new pull request, #7116: URL: https://github.com/apache/seatunnel/pull/7116 ### Purpose of this pull request In some scenarios, you need to set the TTL time ### How was this patch tested? Local and server deployment operation

(seatunnel) branch dev updated: [Improve][Doc] Improve DingTalk doc (#7075)

2024-07-05 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 0bb50c77b7 [Improve][Doc] Improve DingTalk doc

Re: [PR] [Improve][Doc] Improve DingTalk doc [seatunnel]

2024-07-05 Thread via GitHub
hailin0 merged PR #7075: URL: https://github.com/apache/seatunnel/pull/7075 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

[I] shade.identifier and custom encryptionproblem [seatunnel]

2024-07-05 Thread via GitHub
a11dev opened a new issue, #7117: URL: https://github.com/apache/seatunnel/issues/7117 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[I] java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.getTimeDuration [seatunnel]

2024-07-05 Thread via GitHub
yangkaikb opened a new issue, #7118: URL: https://github.com/apache/seatunnel/issues/7118 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] [Bug] [FTP Sink] FTPException: Client not connected (XML -> XML) [seatunnel]

2024-07-05 Thread via GitHub
github-actions[bot] commented on issue #6948: URL: https://github.com/apache/seatunnel/issues/6948#issuecomment-2211534948 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][JDBC-SINK] Insert into a table with auto-increment fields [seatunnel]

2024-07-05 Thread via GitHub
github-actions[bot] closed issue #6911: [Feature][JDBC-SINK] Insert into a table with auto-increment fields URL: https://github.com/apache/seatunnel/issues/6911 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [I] [Feature][JDBC-SINK] Insert into a table with auto-increment fields [seatunnel]

2024-07-05 Thread via GitHub
github-actions[bot] commented on issue #6911: URL: https://github.com/apache/seatunnel/issues/6911#issuecomment-2211535016 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [PR] [feature][connector-v2-hbase-sink] Support Connector v2 HBase sink TTL data writing [seatunnel]

2024-07-05 Thread via GitHub
Hisoka-X commented on code in PR #7116: URL: https://github.com/apache/seatunnel/pull/7116#discussion_r1667219702 ## seatunnel-connectors-v2/connector-hbase/src/main/java/org/apache/seatunnel/connectors/seatunnel/hbase/config/HbaseConfig.java: ## @@ -97,6 +97,9 @@ public class H

Re: [PR] [bugFix][Connector-V2][CDC] SeaTunnelRowDebeziumDeserializationConverters NPE [seatunnel]

2024-07-05 Thread via GitHub
Hisoka-X commented on PR #7113: URL: https://github.com/apache/seatunnel/pull/7113#issuecomment-2211549981 Hi @Asura7969 , could you follow the guide to open github action on your fork repository? Thanks. https://github.com/apache/seatunnel/pull/7113/checks?check_run_id=27071218748 -- Th

Re: [PR] [Improve][Zeta] Add check for submit duplicate job id [seatunnel]

2024-07-05 Thread via GitHub
Hisoka-X commented on code in PR #7021: URL: https://github.com/apache/seatunnel/pull/7021#discussion_r1667220593 ## seatunnel-engine/seatunnel-engine-core/src/main/java/org/apache/seatunnel/engine/core/protocol/codec/SeaTunnelSubmitJobCodec.java: ## @@ -37,30 +40,40 @@ * to

Re: [PR] [feature][connector-v2-hbase-sink] Support Connector v2 HBase sink TTL data writing [seatunnel]

2024-07-05 Thread via GitHub
zhangshenghang commented on code in PR #7116: URL: https://github.com/apache/seatunnel/pull/7116#discussion_r1667221426 ## seatunnel-connectors-v2/connector-hbase/src/main/java/org/apache/seatunnel/connectors/seatunnel/hbase/config/HbaseConfig.java: ## @@ -97,6 +97,9 @@ public c

Re: [PR] [feature][connector-v2-hbase-sink] Support Connector v2 HBase sink TTL data writing [seatunnel]

2024-07-05 Thread via GitHub
Hisoka-X commented on code in PR #7116: URL: https://github.com/apache/seatunnel/pull/7116#discussion_r1667222365 ## seatunnel-connectors-v2/connector-hbase/src/main/java/org/apache/seatunnel/connectors/seatunnel/hbase/config/HbaseConfig.java: ## @@ -97,6 +97,9 @@ public class H

Re: [PR] [feature][connector-v2-hbase-sink] Support Connector v2 HBase sink TTL data writing [seatunnel]

2024-07-05 Thread via GitHub
zhangshenghang commented on code in PR #7116: URL: https://github.com/apache/seatunnel/pull/7116#discussion_r1667223724 ## seatunnel-connectors-v2/connector-hbase/src/main/java/org/apache/seatunnel/connectors/seatunnel/hbase/config/HbaseConfig.java: ## @@ -97,6 +97,9 @@ public c

Re: [PR] [Docs][connector-sink] add Docs connector v2 sink [seatunnel]

2024-07-05 Thread via GitHub
hailin0 merged PR #7097: URL: https://github.com/apache/seatunnel/pull/7097 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Docs][connector-sink] add Docs connector v2 sink (#7097)

2024-07-05 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new f1f7c38cce [Docs][connector-sink] add Docs conn

Re: [PR] [feature][connector-v2-hbase-sink] Support Connector v2 HBase sink TTL data writing [seatunnel]

2024-07-05 Thread via GitHub
hailin0 merged PR #7116: URL: https://github.com/apache/seatunnel/pull/7116 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [feature][connector-v2-hbase-sink] Support Connector v2 HBase sink TTL data writing (#7116)

2024-07-05 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new adafd80255 [feature][connector-v2-hbase-sink] S