[I] [Bug] [Oracle-CDC] 报错Oracle日志保存点断裂,但是数据库日志查看正常,未发生断裂。 [seatunnel]

2025-02-19 Thread via GitHub
Quilian opened a new issue, #8772: URL: https://github.com/apache/seatunnel/issues/8772 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[I] [Bug] [Oracle-CDC] startup.mode not supported specific [seatunnel]

2025-02-19 Thread via GitHub
Quilian opened a new issue, #8771: URL: https://github.com/apache/seatunnel/issues/8771 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Feature][Connector-V2] Add `file_extension` parameter for read/write file [seatunnel]

2025-02-19 Thread via GitHub
litiliu commented on code in PR #8769: URL: https://github.com/apache/seatunnel/pull/8769#discussion_r1962959943 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/config/BaseSinkConfig.java: ## @@ -214,6 +2

Re: [PR] [Feature][Connector-V2] Add `file_extension` parameter for read/write file [seatunnel]

2025-02-19 Thread via GitHub
litiliu commented on code in PR #8769: URL: https://github.com/apache/seatunnel/pull/8769#discussion_r1962948805 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/sink/writer/AbstractWriteStrategy.java: ##

Re: [PR] [Feature][Connector-V2] Add `file_extension` parameter for read/write file [seatunnel]

2025-02-19 Thread via GitHub
Hisoka-X commented on code in PR #8769: URL: https://github.com/apache/seatunnel/pull/8769#discussion_r1962909577 ## docs/en/connector-v2/sink/CosFile.md: ## @@ -46,6 +46,7 @@ By default, we use 2PC commit to ensure `exactly-once` | file_name_expression | strin

Re: [I] [Feature][Kafka] Support XML format read/write kafka record [seatunnel]

2025-02-19 Thread via GitHub
litiliu commented on issue #8749: URL: https://github.com/apache/seatunnel/issues/8749#issuecomment-2670502974 I'll handle this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] [Fix][Connector-V2] Fix assert connector assertion errors [seatunnel]

2025-02-19 Thread via GitHub
corgy-w commented on PR #8746: URL: https://github.com/apache/seatunnel/pull/8746#issuecomment-2670386880 > > Let's add a new check to make sure the assert can throw error normally. > > +1 , We need to verify that exceptions can be thrown correctly when an error occurs. get -

[PR] [Fix][E2e] Optimized pom file name tag [seatunnel]

2025-02-19 Thread via GitHub
corgy-w opened a new pull request, #8770: URL: https://github.com/apache/seatunnel/pull/8770 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

[PR] [Feature] Add export functionality for job configuration [seatunnel-web]

2025-02-19 Thread via GitHub
liunaijie opened a new pull request, #279: URL: https://github.com/apache/seatunnel-web/pull/279 ## Purpose of this pull request add api to export job conf ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason:

Re: [I] [Feature][Module Name] TiDB CDC data into Doris [seatunnel]

2025-02-19 Thread via GitHub
remones commented on issue #8764: URL: https://github.com/apache/seatunnel/issues/8764#issuecomment-2670310716 @hailin0 you can assign it to me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [Fix][Connector-V2] Fix possible data loss in certain scenarios of starrocks [seatunnel]

2025-02-19 Thread via GitHub
xiaochen-zhou commented on PR #8768: URL: https://github.com/apache/seatunnel/pull/8768#issuecomment-2670323737 > Please add testcase (reproduce & verify) Ok. I'll try to complete it today. -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [PR] [Feature][Connector-V2] Add `file_extension` parameter for read/write file [seatunnel]

2025-02-19 Thread via GitHub
hailin0 commented on code in PR #8769: URL: https://github.com/apache/seatunnel/pull/8769#discussion_r1962767560 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/config/BaseSinkConfig.java: ## @@ -214,6 +2

Re: [PR] [Feature][Connector-V2] Add `file_extension` parameter for read/write file [seatunnel]

2025-02-19 Thread via GitHub
hailin0 commented on code in PR #8769: URL: https://github.com/apache/seatunnel/pull/8769#discussion_r1962764747 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/config/BaseSinkConfig.java: ## @@ -214,6 +2

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/sink/TDengine.md] [seatunnel]

2025-02-19 Thread via GitHub
duzhendi commented on code in PR #8732: URL: https://github.com/apache/seatunnel/pull/8732#discussion_r1962767390 ## docs/zh/connector-v2/sink/TDengine.md: ## @@ -0,0 +1,71 @@ +# TDengine + +> TDengine 数据接收器 + +## 描述 + +用于将数据写入TDengine. 在运行 seatunnel 任务之前,你需要创建稳定的环境。 + +## 主要特性

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/sink/TDengine.md] [seatunnel]

2025-02-19 Thread via GitHub
duzhendi commented on code in PR #8732: URL: https://github.com/apache/seatunnel/pull/8732#discussion_r1962762391 ## docs/zh/connector-v2/sink/TDengine.md: ## @@ -0,0 +1,71 @@ +# TDengine + +> TDengine 数据接收器 + +## 描述 + +用于将数据写入TDengine. 在运行 seatunnel 任务之前,你需要创建稳定的环境。 + +## 主要特性

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Tablestore.md] [seatunnel]

2025-02-19 Thread via GitHub
duzhendi commented on code in PR #8731: URL: https://github.com/apache/seatunnel/pull/8731#discussion_r1962764998 ## docs/zh/connector-v2/sink/Tablestore.md: ## @@ -0,0 +1,73 @@ +# Tablestore + +> Tablestore 数据接收器 + +## 描述 + +用于将数据写入 Tablestore + +## 主要特性 + +- [ ] [exactly-once]

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/sink/TDengine.md] [seatunnel]

2025-02-19 Thread via GitHub
duzhendi commented on code in PR #8732: URL: https://github.com/apache/seatunnel/pull/8732#discussion_r1962762391 ## docs/zh/connector-v2/sink/TDengine.md: ## @@ -0,0 +1,71 @@ +# TDengine + +> TDengine 数据接收器 + +## 描述 + +用于将数据写入TDengine. 在运行 seatunnel 任务之前,你需要创建稳定的环境。 + +## 主要特性

(seatunnel) branch dev updated (b16aac232a -> b964189b75)

2025-02-19 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from b16aac232a [Feature][Config] Support custom config keys for encrypt/decrypt (#8739) add b964189b75 [improve] upd

Re: [PR] [improve] update clickhouse connector config option [seatunnel]

2025-02-19 Thread via GitHub
Hisoka-X merged PR #8755: URL: https://github.com/apache/seatunnel/pull/8755 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

(seatunnel) branch dev updated (4eec9be012 -> b16aac232a)

2025-02-19 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 4eec9be012 [Improve] rabbit mq options (#8740) add b16aac232a [Feature][Config] Support custom config keys for e

Re: [PR] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-19 Thread via GitHub
Hisoka-X merged PR #8739: URL: https://github.com/apache/seatunnel/pull/8739 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [I] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-19 Thread via GitHub
Hisoka-X closed issue #8511: [Feature][Config] Support custom config keys for encrypt/decrypt URL: https://github.com/apache/seatunnel/issues/8511 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [improve] update clickhouse connector config option [seatunnel]

2025-02-19 Thread via GitHub
liunaijie commented on PR #8755: URL: https://github.com/apache/seatunnel/pull/8755#issuecomment-2670125176 LGTM, Thanks! @lyne7-sc -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [I] [Feature][Module Name] When synchronizing multiple tables in CDC, define a table name mapping to map the source table to target table names with different names [seatunnel]

2025-02-19 Thread via GitHub
sin70611 commented on issue #8756: URL: https://github.com/apache/seatunnel/issues/8756#issuecomment-2670119808 Thanks ,I used 2.3.8 and I have seen this in 2.3.9. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] [Feature][Module Name] When synchronizing multiple tables in CDC, define a table name mapping to map the source table to target table names with different names [seatunnel]

2025-02-19 Thread via GitHub
sin70611 closed issue #8756: [Feature][Module Name] When synchronizing multiple tables in CDC, define a table name mapping to map the source table to target table names with different names URL: https://github.com/apache/seatunnel/issues/8756 -- This is an automated message from the Apache G

Re: [I] [Bug] [MySQL CDC] Memory Leak [seatunnel]

2025-02-19 Thread via GitHub
github-actions[bot] commented on issue #8475: URL: https://github.com/apache/seatunnel/issues/8475#issuecomment-2670089196 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] [MySQL CDC] Memory Leak [seatunnel]

2025-02-19 Thread via GitHub
github-actions[bot] closed issue #8475: [Bug] [MySQL CDC] Memory Leak URL: https://github.com/apache/seatunnel/issues/8475 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [I] [Bug] [MongoDB-CDC] Can not find catalog with factoryId [MongoDB] [seatunnel]

2025-02-19 Thread via GitHub
github-actions[bot] commented on issue #8562: URL: https://github.com/apache/seatunnel/issues/8562#issuecomment-2670089083 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][Elasticsearch] When I want to get the _id of es, it is difficult [seatunnel]

2025-02-19 Thread via GitHub
github-actions[bot] commented on issue #8506: URL: https://github.com/apache/seatunnel/issues/8506#issuecomment-2670089160 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Feature][Elasticsearch] When I want to get the _id of es, it is difficult [seatunnel]

2025-02-19 Thread via GitHub
github-actions[bot] closed issue #8506: [Feature][Elasticsearch] When I want to get the _id of es, it is difficult URL: https://github.com/apache/seatunnel/issues/8506 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [I] [Feature][MySQL 8.4 CDC Source] Any New version support MySQL 8.4 CDC source ? [seatunnel]

2025-02-19 Thread via GitHub
hailin0 closed issue #8675: [Feature][MySQL 8.4 CDC Source] Any New version support MySQL 8.4 CDC source ? URL: https://github.com/apache/seatunnel/issues/8675 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [I] [Bug] [connector-elasticsearch] Cannot replace capitalized dynamic index names [seatunnel]

2025-02-19 Thread via GitHub
hailin0 commented on issue #8752: URL: https://github.com/apache/seatunnel/issues/8752#issuecomment-2668931333 What is ${OP_DAY}? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [I] [Feature][Module Name] When synchronizing multiple tables in CDC, define a table name mapping to map the source table to target table names with different names [seatunnel]

2025-02-19 Thread via GitHub
hailin0 commented on issue #8756: URL: https://github.com/apache/seatunnel/issues/8756#issuecomment-2668924278 https://github.com/apache/seatunnel/blob/dev/docs/en/transform-v2/table-rename.md https://github.com/apache/seatunnel/blob/dev/docs/en/transform-v2/field-rename.md -- This is

Re: [I] [Feature][Module Name] TiDB CDC data into Doris [seatunnel]

2025-02-19 Thread via GitHub
hailin0 commented on issue #8764: URL: https://github.com/apache/seatunnel/issues/8764#issuecomment-2668917656 Waiting for contributors to claim this issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] [improve] update clickhouse connector config option [seatunnel]

2025-02-19 Thread via GitHub
lyne7-sc commented on PR #8755: URL: https://github.com/apache/seatunnel/pull/8755#issuecomment-2668837296 Hi , @liunaijie I noticed that the CI license header check failed in the previous PR. To address this, I've added a new commit to include the missing license headers for the follow

(seatunnel) branch dev updated: [Improve] rabbit mq options (#8740)

2025-02-19 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 4eec9be012 [Improve] rabbit mq options (#8740)

Re: [PR] [improve] rabbit mq options [seatunnel]

2025-02-19 Thread via GitHub
hailin0 merged PR #8740: URL: https://github.com/apache/seatunnel/pull/8740 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Socket.md] [seatunnel]

2025-02-19 Thread via GitHub
hailin0 merged PR #8729: URL: https://github.com/apache/seatunnel/pull/8729 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Socket.md] (#8729)

2025-02-19 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new b83076c0df [Doc][Improve] support chinese [doc

(seatunnel) branch dev updated (6b6d8fae54 -> d78b143d90)

2025-02-19 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 6b6d8fae54 [Improve] re-struct Zeta Engine config options (#8741) add d78b143d90 [Doc][Improve] support chine

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Milvus.md] [seatunnel]

2025-02-19 Thread via GitHub
hailin0 merged PR #8727: URL: https://github.com/apache/seatunnel/pull/8727 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Fix][Connector-V2] Fix possible data loss in certain scenarios of starrocks [seatunnel]

2025-02-19 Thread via GitHub
hailin0 commented on PR #8768: URL: https://github.com/apache/seatunnel/pull/8768#issuecomment-2668689941 Please add testcase (reproduce & verify) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[PR] [Feature][Connector-V2] Add `file_extension` parameter for read/write file [seatunnel]

2025-02-19 Thread via GitHub
Hisoka-X opened a new pull request, #8769: URL: https://github.com/apache/seatunnel/pull/8769 ### Purpose of this pull request Add `file_extension` parameter for read/write file. When read file, it used to filter files. When write file, it used to override default file extension.

Re: [PR] [Fix][Connector-V2] Fix assert connector assertion errors [seatunnel]

2025-02-19 Thread via GitHub
zhangshenghang commented on PR #8746: URL: https://github.com/apache/seatunnel/pull/8746#issuecomment-2668029870 > Let's add a new check to make sure the assert can throw error normally. +1 , We need to verify that exceptions can be thrown correctly when an error occurs. -- This is

Re: [I] [Feature][JDBC] Improve the jdbc parallel-reader generated sql [seatunnel]

2025-02-19 Thread via GitHub
liunaijie commented on issue #8767: URL: https://github.com/apache/seatunnel/issues/8767#issuecomment-2668023369 Related code: - - https://github.com/apache/seatunnel/blob/dev/seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/source/F

Re: [PR] [Feature][Kafka] Support native format read/write kafka record [seatunnel]

2025-02-19 Thread via GitHub
hailin0 commented on code in PR #8724: URL: https://github.com/apache/seatunnel/pull/8724#discussion_r1961236747 ## docs/en/connector-v2/sink/Kafka.md: ## @@ -30,21 +30,21 @@ They can be downloaded via install-plugin.sh or from the Maven central repositor ## Sink Options -

Re: [PR] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-19 Thread via GitHub
hailin0 commented on PR #8739: URL: https://github.com/apache/seatunnel/pull/8739#issuecomment-2667944796 > I noticed that every time I push a new commit, the GitHub Actions test workflow runs for over an hour, and some e2e test cases are not stable so it may fail sometimes. do you have any

Re: [PR] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-19 Thread via GitHub
remones commented on PR #8739: URL: https://github.com/apache/seatunnel/pull/8739#issuecomment-2667843073 I noticed that every time I push a new commit, the GitHub Actions test workflow runs for over an hour, and some e2e test cases are not stable so it may fail sometimes. do you have any s