[I] [Bug] [Oracle CDC to Kafka] table column with default value, if the insert column is null, the result to kafka is the default value but not null [seatunnel]

2025-02-17 Thread via GitHub
sin70611 opened a new issue, #8759: URL: https://github.com/apache/seatunnel/issues/8759 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[I] [Bug] [seatunnel] mysqlcdc to mysql job-info/jobid error [seatunnel]

2025-02-17 Thread via GitHub
fanxishu opened a new issue, #8758: URL: https://github.com/apache/seatunnel/issues/8758 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-17 Thread via GitHub
Hisoka-X commented on code in PR #8739: URL: https://github.com/apache/seatunnel/pull/8739#discussion_r195917 ## seatunnel-core/seatunnel-core-starter/src/main/java/org/apache/seatunnel/core/starter/utils/ConfigShadeUtils.java: ## @@ -185,6 +198,18 @@ private static Config p

Re: [I] [Bug] [Seatunnel-Web] java.lang.NoClassDefFoundError: org/apache/seatunnel/api/table/catalog/schema/TableSchemaOptions [seatunnel]

2025-02-17 Thread via GitHub
jinchengkinght-bot commented on issue #7224: URL: https://github.com/apache/seatunnel/issues/7224#issuecomment-2664761138 I have the same problem. How can I solve it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-17 Thread via GitHub
remones commented on code in PR #8739: URL: https://github.com/apache/seatunnel/pull/8739#discussion_r1959152081 ## seatunnel-core/seatunnel-core-starter/src/main/java/org/apache/seatunnel/core/starter/utils/ConfigShadeUtils.java: ## @@ -185,6 +198,18 @@ private static Config pr

Re: [PR] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-17 Thread via GitHub
Hisoka-X commented on code in PR #8739: URL: https://github.com/apache/seatunnel/pull/8739#discussion_r1959030054 ## seatunnel-core/seatunnel-core-starter/src/main/java/org/apache/seatunnel/core/starter/utils/ConfigShadeUtils.java: ## @@ -185,6 +198,18 @@ private static Config p

Re: [PR] [Fix][Connector-v2] Fix MySQLTypeConvert Between Varchar and String [seatunnel]

2025-02-17 Thread via GitHub
xiaochen-zhou commented on code in PR #8734: URL: https://github.com/apache/seatunnel/pull/8734#discussion_r1959030251 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/dialect/mysql/MySqlTypeConverter.java: ## @@ -24

Re: [PR] [Fix][Connector-v2] Fix MySQLTypeConvert Between Varchar and String [seatunnel]

2025-02-17 Thread via GitHub
xiaochen-zhou commented on PR #8734: URL: https://github.com/apache/seatunnel/pull/8734#issuecomment-2664562042 Thank you for the guidance, I will take another look at the code. @hailin0 @Hisoka-X -- This is an automated message from the Apache Git Service. To respond to the message, ple

[I] [Bug] [Module Name] RabbitMQ组件连接rabbitmq的时候会出现空指针 [seatunnel]

2025-02-17 Thread via GitHub
HuGuangcui opened a new issue, #8757: URL: https://github.com/apache/seatunnel/issues/8757 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [PR] [Feature]Support enable https protocol for rest-api v2 [seatunnel]

2025-02-17 Thread via GitHub
Hisoka-X commented on code in PR #8698: URL: https://github.com/apache/seatunnel/pull/8698#discussion_r1959008138 ## seatunnel-e2e/seatunnel-engine-e2e/connector-seatunnel-e2e-base/src/test/java/org/apache/seatunnel/engine/e2e/RestApiHttpsIT.java: ## @@ -0,0 +1,226 @@ +/* + * Li

Re: [PR] [Fix][Connector-v2] Add DateMilliConvertor to Convert DateMilliVector into Default Timezone [seatunnel]

2025-02-17 Thread via GitHub
xiaochen-zhou commented on PR #8736: URL: https://github.com/apache/seatunnel/pull/8736#issuecomment-2664453096 @Hisoka-X @hawk9821 done. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[I] [Feature][Module Name] When synchronizing multiple tables in CDC, define a table name mapping to map the source table to target table names with different names [seatunnel]

2025-02-17 Thread via GitHub
sin70611 opened a new issue, #8756: URL: https://github.com/apache/seatunnel/issues/8756 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] [Discuss][Zeta] Support pekko as new distributed service framework [seatunnel]

2025-02-17 Thread via GitHub
github-actions[bot] commented on issue #8416: URL: https://github.com/apache/seatunnel/issues/8416#issuecomment-2664277921 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Discuss][Zeta] Support pekko as new distributed service framework [seatunnel]

2025-02-17 Thread via GitHub
github-actions[bot] closed issue #8416: [Discuss][Zeta] Support pekko as new distributed service framework URL: https://github.com/apache/seatunnel/issues/8416 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [I] [Bug] [connector-kafka] In spark engine streaming mode, kafka source can read data, but cannot write to mysql. [seatunnel]

2025-02-17 Thread via GitHub
github-actions[bot] commented on issue #8394: URL: https://github.com/apache/seatunnel/issues/8394#issuecomment-2664277960 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Feature][connector-v2] emqx source connector [seatunnel]

2025-02-17 Thread via GitHub
github-actions[bot] closed issue #8404: [Feature][connector-v2] emqx source connector URL: https://github.com/apache/seatunnel/issues/8404 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [I] [Feature][connector-v2] emqx source connector [seatunnel]

2025-02-17 Thread via GitHub
github-actions[bot] commented on issue #8404: URL: https://github.com/apache/seatunnel/issues/8404#issuecomment-2664277942 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] [connector-kafka] In spark engine streaming mode, kafka source can read data, but cannot write to mysql. [seatunnel]

2025-02-17 Thread via GitHub
github-actions[bot] closed issue #8394: [Bug] [connector-kafka] In spark engine streaming mode, kafka source can read data, but cannot write to mysql. URL: https://github.com/apache/seatunnel/issues/8394 -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [I] [Feature][Connector-V2] Support multi-table sink feature [seatunnel]

2025-02-17 Thread via GitHub
akulabs8 commented on issue #5652: URL: https://github.com/apache/seatunnel/issues/5652#issuecomment-2663839375 Hey, I am taking the Slack one for starters @davidzollo @Hisoka-X Just one question, we have to do both the sink and source of a particular connector simultaneously ? --

(seatunnel) branch dev updated: [Improve][connector][activemq] Remove duplicate dependencies (#8753)

2025-02-17 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new da6241aa1c [Improve][connector][activemq] Remov

[PR] [improve] update clickhouse connector config option [seatunnel]

2025-02-17 Thread via GitHub
lyne7-sc opened a new pull request, #8755: URL: https://github.com/apache/seatunnel/pull/8755 ### Purpose of this pull request subtask of https://github.com/apache/seatunnel/issues/8576 ### Does this PR introduce _any_ user-facing change? ### How w

Re: [PR] [improve] update clickhouse connector config option [seatunnel]

2025-02-17 Thread via GitHub
lyne7-sc closed pull request #8747: [improve] update clickhouse connector config option URL: https://github.com/apache/seatunnel/pull/8747 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

(seatunnel) branch dev updated: [Improve][Connector-V2] Improve orc read error message (#8751)

2025-02-17 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new d66d9dc9ce [Improve][Connector-V2] Improve orc

Re: [PR] [Fix][Plugin] Optimize the plugin discovery mechanism [seatunnel]

2025-02-17 Thread via GitHub
hailin0 commented on code in PR #8603: URL: https://github.com/apache/seatunnel/pull/8603#discussion_r1958234416 ## seatunnel-plugin-discovery/src/main/java/org/apache/seatunnel/plugin/discovery/AbstractPluginDiscovery.java: ## @@ -455,104 +453,53 @@ public boolean accept(File p

[PR] [Fix] [Mongo-cdc] Fallback to timestamp startup mode when resume token has expired [seatunnel]

2025-02-17 Thread via GitHub
jw-itq opened a new pull request, #8754: URL: https://github.com/apache/seatunnel/pull/8754 ### Purpose of this pull request Synchronize the Flink-CDC code to fix the Mongo-CDC issue. When MongoDB CDC connector tries to create cursor with an expired resuming

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/source/Greenplum.md] [seatunnel]

2025-02-17 Thread via GitHub
hailin0 commented on PR #8707: URL: https://github.com/apache/seatunnel/pull/8707#issuecomment-2663019259 https://github.com/user-attachments/assets/55e74e41-0ff6-442a-a58a-ec4b906c47a8"; /> -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [Feature][Kafka] Support native format read/write kafka record [seatunnel]

2025-02-17 Thread via GitHub
hailin0 commented on code in PR #8724: URL: https://github.com/apache/seatunnel/pull/8724#discussion_r1958223215 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/sink/KafkaSinkWriter.java: ## @@ -110,8 +115,12 @@ public Kaf

(seatunnel) branch dev updated: [improve] console sink options (#8743)

2025-02-17 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new c439b99f19 [improve] console sink options (#874

Re: [I] [Bug] [connector-file-ftp] When accessing an FTP server in a different subnet, it results in a failure to retrieve the FTP directory listing,show: Get file list failed [seatunnel]

2025-02-17 Thread via GitHub
mesutmutluitu commented on issue #8493: URL: https://github.com/apache/seatunnel/issues/8493#issuecomment-2663037138 same problem here `POST]{uri='/hazelcast/rest/maps/submit-job'}AbstractTextCommand[HTTP_POST]{requestId=2} org.apache.seatunnel.api.table.factory.FactoryException: E

Re: [PR] [Fix][Connector-v2] Fix MySQLTypeConvert Between Varchar and String [seatunnel]

2025-02-17 Thread via GitHub
hailin0 commented on code in PR #8734: URL: https://github.com/apache/seatunnel/pull/8734#discussion_r1958169127 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/dialect/mysql/MySqlTypeConverter.java: ## @@ -248,7 +2

Re: [PR] [Fix][Connector-v2] Fix MySQLTypeConvert Between Varchar and String [seatunnel]

2025-02-17 Thread via GitHub
hailin0 commented on code in PR #8734: URL: https://github.com/apache/seatunnel/pull/8734#discussion_r1958161637 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/dialect/mysql/MySqlTypeConverter.java: ## @@ -248,7 +2

Re: [PR] [Improve][connector][activemq] Remove duplicate dependencies [seatunnel]

2025-02-17 Thread via GitHub
hailin0 merged PR #8753: URL: https://github.com/apache/seatunnel/pull/8753 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Fix][Connector-v2] Fix MySQLTypeConvert Between Varchar and String [seatunnel]

2025-02-17 Thread via GitHub
hailin0 commented on code in PR #8734: URL: https://github.com/apache/seatunnel/pull/8734#discussion_r1958161637 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/dialect/mysql/MySqlTypeConverter.java: ## @@ -248,7 +2

(seatunnel) branch dev updated: [Doc][Improve] support chinese [docs/zh/connector-v2/sink/IoTDB.md] (#8722)

2025-02-17 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 87e93554b2 [Doc][Improve] support chinese [doc

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/sink/IoTDB.md] [seatunnel]

2025-02-17 Thread via GitHub
hailin0 merged PR #8722: URL: https://github.com/apache/seatunnel/pull/8722 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Docs][S3File] "Orc Data Type" should be corrected to "Parquet Data Type" in the documentation [seatunnel]

2025-02-17 Thread via GitHub
hailin0 merged PR #8705: URL: https://github.com/apache/seatunnel/pull/8705 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [improve] update kafka source default schema from content> to content [seatunnel]

2025-02-17 Thread via GitHub
hailin0 merged PR #8642: URL: https://github.com/apache/seatunnel/pull/8642 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Docs][S3File] "Orc Data Type" should be corrected to "Parquet Data Type" in the documentation (#8705)

2025-02-17 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new f67d933391 [Docs][S3File] "Orc Data Type" shoul

(seatunnel) branch dev updated: [improve] update kafka source default schema from content> to content (#8642)

2025-02-17 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new db6e2994d4 [improve] update kafka source defaul

(seatunnel) branch dev updated: [Feature][Transforms-V2] Handling LLM non-standard format responses (#8551)

2025-02-17 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new e0c99ace23 [Feature][Transforms-V2] Handling LL

Re: [PR] [Feature][Transforms-V2] Handling LLM non-standard format responses [seatunnel]

2025-02-17 Thread via GitHub
hailin0 merged PR #8551: URL: https://github.com/apache/seatunnel/pull/8551 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [improve] console sink options [seatunnel]

2025-02-17 Thread via GitHub
hailin0 merged PR #8743: URL: https://github.com/apache/seatunnel/pull/8743 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Improve][Connector-V2] Improve orc read error message [seatunnel]

2025-02-17 Thread via GitHub
hailin0 merged PR #8751: URL: https://github.com/apache/seatunnel/pull/8751 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [improve] dingtalk sink options (#8742)

2025-02-17 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new f2145dcc4f [improve] dingtalk sink options (#8742

(seatunnel) branch dev updated (f2145dcc4f -> 88f35bd705)

2025-02-17 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from f2145dcc4f [improve] dingtalk sink options (#8742) add 88f35bd705 [improve] datahub sink options (#8744) No ne

Re: [PR] [Improve] Add "download_datasource.sh" for downloading datasource. [seatunnel-web]

2025-02-17 Thread via GitHub
opschen2002 commented on PR #136: URL: https://github.com/apache/seatunnel-web/pull/136#issuecomment-2662654643 ![1739787325061_3723208D-1952-44b5-939F-4E0598C03A72](https://github.com/user-attachments/assets/36dd936f-0284-45f5-82c2-accaa5dfb36d) me too -- This is an automated message

Re: [PR] [Fix][zeta][Connector-paimon] Fix paimon run from checkpoint bug [seatunnel]

2025-02-17 Thread via GitHub
Hisoka-X commented on PR #8730: URL: https://github.com/apache/seatunnel/pull/8730#issuecomment-2662532465 Could you add a test case too? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] [improve] datahub sink options [seatunnel]

2025-02-17 Thread via GitHub
wuchunfu merged PR #8744: URL: https://github.com/apache/seatunnel/pull/8744 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [Fix][Transform] Fix FieldMapper transform lost field constraint information [seatunnel]

2025-02-17 Thread via GitHub
wuchunfu merged PR #8697: URL: https://github.com/apache/seatunnel/pull/8697 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

(seatunnel) branch dev updated (6205065b25 -> 04d50545aa)

2025-02-17 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 6205065b25 [Improve][Jdbc] Improve catalog connection cache (#8626) add 04d50545aa [Bugfix][Canal] Fix canal se

(seatunnel) branch dev updated (04d50545aa -> 3c9fa0117e)

2025-02-17 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 04d50545aa [Bugfix][Canal] Fix canal serialization to json (#8695) add 3c9fa0117e [Fix][Transform] Fix FieldMap

[PR] [Improve][connector][activemq] Remove duplicate dependencies [seatunnel]

2025-02-17 Thread via GitHub
wuchunfu opened a new pull request, #8753: URL: https://github.com/apache/seatunnel/pull/8753 ### Purpose of this pull request Remove duplicate dependencies ![image](https://github.com/user-attachments/assets/7b57120b-7f17-4abf-9913-41a886fcbcd5) ### Does thi

Re: [PR] [Bugfix][Canal] Fix canal serialization to json [seatunnel]

2025-02-17 Thread via GitHub
wuchunfu merged PR #8695: URL: https://github.com/apache/seatunnel/pull/8695 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

(seatunnel) branch dev updated (88f35bd705 -> 6205065b25)

2025-02-17 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 88f35bd705 [improve] datahub sink options (#8744) add 6205065b25 [Improve][Jdbc] Improve catalog connection cac

Re: [PR] [Improve][Jdbc] Improve catalog connection cache [seatunnel]

2025-02-17 Thread via GitHub
wuchunfu merged PR #8626: URL: https://github.com/apache/seatunnel/pull/8626 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [improve] dingtalk sink options [seatunnel]

2025-02-17 Thread via GitHub
wuchunfu merged PR #8742: URL: https://github.com/apache/seatunnel/pull/8742 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

[I] [Bug] [connector-elasticsearch] Cannot replace capitalized dynamic index names [seatunnel]

2025-02-17 Thread via GitHub
zhdech opened a new issue, #8752: URL: https://github.com/apache/seatunnel/issues/8752 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened