Re: [I] seatunnel oracle invalid [seatunnel]

2025-02-18 Thread via GitHub
github-actions[bot] closed issue #8389: seatunnel oracle invalid URL: https://github.com/apache/seatunnel/issues/8389 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [PR] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-18 Thread via GitHub
Hisoka-X commented on code in PR #8739: URL: https://github.com/apache/seatunnel/pull/8739#discussion_r1960886801 ## seatunnel-core/seatunnel-core-starter/src/main/java/org/apache/seatunnel/core/starter/utils/ConfigBuilder.java: ## @@ -116,23 +117,39 @@ public static Config of(

Re: [PR] [Fix][Connector-V2] Fix assert connector assertion errors [seatunnel]

2025-02-18 Thread via GitHub
Hisoka-X commented on PR #8746: URL: https://github.com/apache/seatunnel/pull/8746#issuecomment-2667407774 cc @zhangshenghang -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] [improve] update localfile connector config [seatunnel]

2025-02-18 Thread via GitHub
misi1987107 closed pull request #8761: [improve] update localfile connector config URL: https://github.com/apache/seatunnel/pull/8761 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [Fix][zeta][Connector-paimon] Fix paimon run from checkpoint bug [seatunnel]

2025-02-18 Thread via GitHub
Hisoka-X commented on PR #8730: URL: https://github.com/apache/seatunnel/pull/8730#issuecomment-2667425588 > Could you add a test case too? @uniding -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/sink/TDengine.md] [seatunnel]

2025-02-18 Thread via GitHub
Hisoka-X commented on code in PR #8732: URL: https://github.com/apache/seatunnel/pull/8732#discussion_r1960898859 ## docs/zh/connector-v2/sink/TDengine.md: ## @@ -0,0 +1,71 @@ +# TDengine + +> TDengine 数据接收器 + +## 描述 + +用于将数据写入TDengine. 在运行 seatunnel 任务之前,你需要创建稳定的环境。 + +## 主要特性

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Tablestore.md] [seatunnel]

2025-02-18 Thread via GitHub
Hisoka-X commented on code in PR #8731: URL: https://github.com/apache/seatunnel/pull/8731#discussion_r1960900210 ## docs/zh/connector-v2/sink/Tablestore.md: ## @@ -0,0 +1,73 @@ +# Tablestore + +> Tablestore 数据接收器 + +## 描述 + +用于将数据写入 Tablestore + +## 主要特性 + +- [ ] [exactly-once]

Re: [PR] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-18 Thread via GitHub
remones commented on code in PR #8739: URL: https://github.com/apache/seatunnel/pull/8739#discussion_r1960853732 ## docs/en/connector-v2/Config-Encryption-Decryption.md: ## @@ -41,6 +43,7 @@ Next, I'll show how to quickly use SeaTunnel's own `base64` encryption: env {

[I] [Feature][Module Name] Feature title [seatunnel]

2025-02-18 Thread via GitHub
Babelyj opened a new issue, #8764: URL: https://github.com/apache/seatunnel/issues/8764 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

[PR] [Feature][Connector-V2] Fix possible data loss in certain scenarios of starrocks [seatunnel]

2025-02-18 Thread via GitHub
xiaochen-zhou opened a new pull request, #8768: URL: https://github.com/apache/seatunnel/pull/8768 ### Purpose of this pull request When users explicitly set QUERY_TABLET_SIZE instead of using the default value Integer.MAX_VALUE, the returned List partitions contains partitio

[PR] [improve] update localfile connector config [seatunnel]

2025-02-18 Thread via GitHub
misi1987107 opened a new pull request, #8765: URL: https://github.com/apache/seatunnel/pull/8765 ### Purpose of this pull request subtask of https://github.com/apache/seatunnel/issues/8576 ### Does this PR introduce _any_ user-facing change? ### Ho

Re: [PR] [Fix][Connector-V2] Fix possible data loss in certain scenarios of starrocks [seatunnel]

2025-02-18 Thread via GitHub
xiaochen-zhou commented on PR #8768: URL: https://github.com/apache/seatunnel/pull/8768#issuecomment-2667480412 Friendly ping, do you have time to take a look @Hisoka-X 🙏 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [I] [Feature][Module Name] TiDB CDC data into Doris [seatunnel]

2025-02-18 Thread via GitHub
hailin0 commented on issue #8764: URL: https://github.com/apache/seatunnel/issues/8764#issuecomment-2667655654 Currently TiDB CDC connector unsupport read multi-tables -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [I] [Feature][Module Name] TiDB CDC data into Doris [seatunnel]

2025-02-18 Thread via GitHub
Babelyj commented on issue #8764: URL: https://github.com/apache/seatunnel/issues/8764#issuecomment-2667674957 Alright, thank you for your response. I would like to ask if there are any plans to add support for multiple tables? -- This is an automated message from the Apache Git Service.

Re: [I] [Feature][Module Name] TiDB CDC data into Doris [seatunnel]

2025-02-18 Thread via GitHub
Babelyj commented on issue #8764: URL: https://github.com/apache/seatunnel/issues/8764#issuecomment-2667682672 Or is there some difficulty in implementing it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] [Fix] [Mongo-cdc] Fallback to timestamp startup mode when resume token has expired [seatunnel]

2025-02-18 Thread via GitHub
jw-itq commented on PR #8754: URL: https://github.com/apache/seatunnel/pull/8754#issuecomment-2667818605 This PR also fixes the issue where MongoDB CDC fails to resume from the savepoint during restart recovery. -- This is an automated message from the Apache Git Service. To respond to th

Re: [PR] [feature][connectors-v2][ActiveMQ] add ActiveMQ source connector [seatunnel]

2025-02-18 Thread via GitHub
L-Gryps commented on code in PR #8581: URL: https://github.com/apache/seatunnel/pull/8581#discussion_r1961142984 ## seatunnel-connectors-v2/connector-activemq/src/main/java/org/apache/seatunnel/connectors/seatunnel/activemq/source/ActivemqSourceReader.java: ## @@ -0,0 +1,197 @@

Re: [PR] [feature][connectors-v2][ActiveMQ] add ActiveMQ source connector [seatunnel]

2025-02-18 Thread via GitHub
L-Gryps commented on code in PR #8581: URL: https://github.com/apache/seatunnel/pull/8581#discussion_r1961142765 ## seatunnel-connectors-v2/connector-activemq/src/main/java/org/apache/seatunnel/connectors/seatunnel/activemq/source/ActivemqSourceReader.java: ## @@ -0,0 +1,197 @@

Re: [PR] [improve] re-struct Zeta Engine config options [seatunnel]

2025-02-18 Thread via GitHub
hailin0 merged PR #8741: URL: https://github.com/apache/seatunnel/pull/8741 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Improve] re-struct Zeta Engine config options (#8741)

2025-02-18 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 6b6d8fae54 [Improve] re-struct Zeta Engine conf

Re: [PR] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-18 Thread via GitHub
hailin0 commented on code in PR #8739: URL: https://github.com/apache/seatunnel/pull/8739#discussion_r1960996199 ## docs/en/connector-v2/Config-Encryption-Decryption.md: ## @@ -8,17 +8,19 @@ In most production environments, sensitive configuration items such as passwords Sea

Re: [PR] [Improve][Zeta] Disable restful api v1 by default [seatunnel]

2025-02-18 Thread via GitHub
hailin0 merged PR #8766: URL: https://github.com/apache/seatunnel/pull/8766 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Feature]Support enable https protocol for rest-api v2 [seatunnel]

2025-02-18 Thread via GitHub
hailin0 commented on code in PR #8698: URL: https://github.com/apache/seatunnel/pull/8698#discussion_r1960991011 ## seatunnel-engine/seatunnel-engine-common/src/main/java/org/apache/seatunnel/engine/common/config/server/ServerConfigOptions.java: ## @@ -300,6 +300,61 @@ public cl

(seatunnel) branch dev updated: [Improve][Zeta] Disable restful api v1 by default (#8766)

2025-02-18 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new b0f29f52a0 [Improve][Zeta] Disable restful api

Re: [PR] [Fix][zeta][Connector-paimon] Fix paimon run from checkpoint bug [seatunnel]

2025-02-18 Thread via GitHub
uniding commented on PR #8730: URL: https://github.com/apache/seatunnel/pull/8730#issuecomment-2667617449 > > Could you add a test case too? > > @uniding This modification will no longer report null pointer errors when running from checkpoint, but the Paimon jar package code wi

Re: [I] mysql 实时同步 msyql 出错 [seatunnel]

2025-02-18 Thread via GitHub
chunhongZheng commented on issue #8342: URL: https://github.com/apache/seatunnel/issues/8342#issuecomment-2667624816 > SeaTunnel Version 2.3.8 There are similar problems。 batch data is success,stream mode is report there errors 。 and the configuration file information is as follows: >

Re: [I] [Bug] [seatunnel] imap hdfs history-job-expire-minutes Invalid parameter [seatunnel]

2025-02-18 Thread via GitHub
github-actions[bot] commented on issue #8386: URL: https://github.com/apache/seatunnel/issues/8386#issuecomment-2667227092 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] mongodb 使用match.query 无法接受外部参数 [seatunnel]

2025-02-18 Thread via GitHub
github-actions[bot] closed issue #8498: mongodb 使用match.query 无法接受外部参数 URL: https://github.com/apache/seatunnel/issues/8498 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] mongodb 使用match.query 无法接受外部参数 [seatunnel]

2025-02-18 Thread via GitHub
github-actions[bot] commented on issue #8498: URL: https://github.com/apache/seatunnel/issues/8498#issuecomment-2667227007 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [PR] [Fix][zeta][Connector-paimon] Fix paimon run from checkpoint bug [seatunnel]

2025-02-18 Thread via GitHub
uniding commented on PR #8730: URL: https://github.com/apache/seatunnel/pull/8730#issuecomment-2667241838 > Please update `PaimonSaveModeHandler` too. I think we can skip `setLoadTable` in `PaimonSaveModeHandler` if `paimonTable` field value is not null. It has been modif

Re: [I] seatunnel oracle invalid [seatunnel]

2025-02-18 Thread via GitHub
github-actions[bot] commented on issue #8389: URL: https://github.com/apache/seatunnel/issues/8389#issuecomment-2667227058 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

[PR] [Improve][Zeta] Disable restful api v1 by default [seatunnel]

2025-02-18 Thread via GitHub
Hisoka-X opened a new pull request, #8766: URL: https://github.com/apache/seatunnel/pull/8766 ### Purpose of this pull request We introduce restapi v2 in #7647 . So I think we can disable restapi v1 by default. Then user can move to v2 ASAP. ### Does this PR introdu

Re: [PR] [Improve][Zeta] Disable restful api v1 by default [seatunnel]

2025-02-18 Thread via GitHub
Hisoka-X commented on PR #8766: URL: https://github.com/apache/seatunnel/pull/8766#issuecomment-2667444732 cc @hailin0 @liugddx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[I] [Feature][JDBC] Improve the jdbc parallel-reader generated sql [seatunnel]

2025-02-18 Thread via GitHub
liunaijie opened a new issue, #8767: URL: https://github.com/apache/seatunnel/issues/8767 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Feature] [Zeta] Client print event which received from jobmaster [seatunnel]

2025-02-18 Thread via GitHub
Hisoka-X commented on code in PR #8696: URL: https://github.com/apache/seatunnel/pull/8696#discussion_r1960915370 ## config/seatunnel.yaml: ## @@ -23,6 +23,8 @@ seatunnel: queue-type: blockingqueue print-execution-info-interval: 60 print-job-metrics-info-interval:

Re: [PR] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-18 Thread via GitHub
remones commented on code in PR #8739: URL: https://github.com/apache/seatunnel/pull/8739#discussion_r1961151004 ## docs/en/connector-v2/Config-Encryption-Decryption.md: ## @@ -8,17 +8,19 @@ In most production environments, sensitive configuration items such as passwords Sea

Re: [PR] [Feature]Support enable https protocol for rest-api v2 [seatunnel]

2025-02-18 Thread via GitHub
akulabs8 commented on code in PR #8698: URL: https://github.com/apache/seatunnel/pull/8698#discussion_r1960242464 ## seatunnel-engine/seatunnel-engine-common/src/main/java/org/apache/seatunnel/engine/common/config/server/ServerConfigOptions.java: ## @@ -300,6 +300,61 @@ public c

Re: [PR] [Feature] [Zeta] Client print event which received from jobmaster [seatunnel]

2025-02-18 Thread via GitHub
Hisoka-X commented on PR #8696: URL: https://github.com/apache/seatunnel/pull/8696#issuecomment-2665253549 cc @hailin0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] [Feature]Support enable https protocol for rest-api v2 [seatunnel]

2025-02-18 Thread via GitHub
akulabs8 commented on PR #8698: URL: https://github.com/apache/seatunnel/pull/8698#issuecomment-2665458517 Thanks for the comments @hailin0 I will make the necessary changes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] [Feature]Support enable https protocol for rest-api v2 [seatunnel]

2025-02-18 Thread via GitHub
hailin0 commented on code in PR #8698: URL: https://github.com/apache/seatunnel/pull/8698#discussion_r1959605661 ## seatunnel-engine/seatunnel-engine-common/src/main/java/org/apache/seatunnel/engine/common/config/server/HttpConfig.java: ## @@ -35,9 +36,23 @@ public class HttpCon

Re: [PR] [Fix][Connector-v2] Add DateMilliConvertor to Convert DateMilliVector into Default Timezone [seatunnel]

2025-02-18 Thread via GitHub
hailin0 merged PR #8736: URL: https://github.com/apache/seatunnel/pull/8736 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Fix][Connector-v2] Add DateMilliConvertor to Convert DateMilliVector into Default Timezone (#8736)

2025-02-18 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 7b8298a8a4 [Fix][Connector-v2] Add DateMilliCon

Re: [PR] [Fix] [Mongo-cdc] Fallback to timestamp startup mode when resume token has expired [seatunnel]

2025-02-18 Thread via GitHub
jw-itq commented on PR #8754: URL: https://github.com/apache/seatunnel/pull/8754#issuecomment-2665611596 > Thanks @jw-itq , Do we have some way to add test case verify it? ok, I'll give it a try. It might take some time. -- This is an automated message from the Apache Git Service. T

Re: [I] [Bug] [Seatunnel-Web] java.lang.NoClassDefFoundError: org/apache/seatunnel/api/table/catalog/schema/TableSchemaOptions [seatunnel]

2025-02-18 Thread via GitHub
King-Saber-Love commented on issue #7224: URL: https://github.com/apache/seatunnel/issues/7224#issuecomment-2665621849 I have the same problem. How can I solve it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] [Feature]Support enable https protocol for rest-api v2 [seatunnel]

2025-02-18 Thread via GitHub
hailin0 commented on code in PR #8698: URL: https://github.com/apache/seatunnel/pull/8698#discussion_r1959585009 ## seatunnel-e2e/seatunnel-engine-e2e/connector-seatunnel-e2e-base/src/test/java/org/apache/seatunnel/engine/e2e/RestApiHttpsIT.java: ## @@ -0,0 +1,226 @@ +/* + * Lic

[I] [Bug] [connector-kafka] Kafka start_made is inconsistent with native [seatunnel]

2025-02-18 Thread via GitHub
CosmosNi opened a new issue, #8763: URL: https://github.com/apache/seatunnel/issues/8763 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-18 Thread via GitHub
litiliu commented on code in PR #8739: URL: https://github.com/apache/seatunnel/pull/8739#discussion_r1959374952 ## docs/en/connector-v2/Config-Encryption-Decryption.md: ## @@ -41,6 +43,7 @@ Next, I'll show how to quickly use SeaTunnel's own `base64` encryption: env {

Re: [PR] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-18 Thread via GitHub
litiliu commented on code in PR #8739: URL: https://github.com/apache/seatunnel/pull/8739#discussion_r1959383324 ## seatunnel-core/seatunnel-core-starter/src/main/java/org/apache/seatunnel/core/starter/utils/ConfigShadeUtils.java: ## @@ -185,6 +198,19 @@ private static Config pr

Re: [I] [Bug] [seatunnel] mysqlcdc to mysql job-info/jobid error [seatunnel]

2025-02-18 Thread via GitHub
fanxishu commented on issue #8758: URL: https://github.com/apache/seatunnel/issues/8758#issuecomment-2664885333 cdc的会出现这个问题离线的不会 The issue occurs with CDC (Change Data Capture) systems, but not with offline systems. -- This is an automated message from the Apache Git Service. To respon

[PR] Resolve apache/seatunnel#8691 [seatunnel]

2025-02-18 Thread via GitHub
ckl750 opened a new pull request, #8760: URL: https://github.com/apache/seatunnel/pull/8760 ### Purpose of this pull request Resolve #8691 ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? exist tests

Re: [PR] [improve] update localfile connector config [seatunnel]

2025-02-18 Thread via GitHub
misi1987107 closed pull request #8750: [improve] update localfile connector config URL: https://github.com/apache/seatunnel/pull/8750 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[PR] [improve] update localfile connector config [seatunnel]

2025-02-18 Thread via GitHub
misi1987107 opened a new pull request, #8761: URL: https://github.com/apache/seatunnel/pull/8761 ### Purpose of this pull request subtask of https://github.com/apache/seatunnel/issues/8576 ### Does this PR introduce _any_ user-facing change? ### Ho

Re: [PR] [improve] update localfile connector config [seatunnel]

2025-02-18 Thread via GitHub
Hisoka-X commented on code in PR #8761: URL: https://github.com/apache/seatunnel/pull/8761#discussion_r1959267394 ## seatunnel-ci-tools/src/test/java/org/apache/seatunnel/api/ConnectorOptionCheckTest.java: ## @@ -233,6 +233,8 @@ private Set buildWhiteList() { whiteList.

Re: [PR] [improve] update localfile connector config [seatunnel]

2025-02-18 Thread via GitHub
liunaijie commented on code in PR #8761: URL: https://github.com/apache/seatunnel/pull/8761#discussion_r1959287429 ## seatunnel-ci-tools/src/test/java/org/apache/seatunnel/api/ConnectorOptionCheckTest.java: ## @@ -233,6 +233,8 @@ private Set buildWhiteList() { whiteList

[I] How PostgreSQL-CDC uses heartbeat.action.query to reduce WAL disk space consumption [seatunnel]

2025-02-18 Thread via GitHub
huangyutongs opened a new issue, #8762: URL: https://github.com/apache/seatunnel/issues/8762 ### **What happened** seatunnel 2.3.9 Without the `heartbeat.action.query` parameter it works fine,I can confirm that I have the table test_heartbeat_table and seatunneluser has write perm

Re: [PR] [improve] update localfile connector config [seatunnel]

2025-02-18 Thread via GitHub
misi1987107 commented on code in PR #8761: URL: https://github.com/apache/seatunnel/pull/8761#discussion_r1959294890 ## seatunnel-ci-tools/src/test/java/org/apache/seatunnel/api/ConnectorOptionCheckTest.java: ## @@ -233,6 +233,8 @@ private Set buildWhiteList() { whiteLi

Re: [PR] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-18 Thread via GitHub
litiliu commented on code in PR #8739: URL: https://github.com/apache/seatunnel/pull/8739#discussion_r1959406615 ## seatunnel-core/seatunnel-core-starter/src/main/java/org/apache/seatunnel/core/starter/utils/ConfigBuilder.java: ## @@ -116,23 +117,39 @@ public static Config of(