Re: [I] [Bug] [Mysql-cdc] send Mysql data to kafka [seatunnel]

2024-06-17 Thread via GitHub
haiwang2517 commented on issue #5010: URL: https://github.com/apache/seatunnel/issues/5010#issuecomment-2175293331 > 这问题咋解决? 没人回复这个问题,自动关闭了 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[I] Mysql-Cdc同步数据到kafka,某些字段自动转换成科学计数法 [seatunnel]

2024-06-17 Thread via GitHub
zhangxx0123 opened a new issue, #7010: URL: https://github.com/apache/seatunnel/issues/7010 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happen

Re: [I] [Feature][Spark] Support multiple tables read and write [seatunnel]

2024-06-17 Thread via GitHub
hailin0 commented on issue #7009: URL: https://github.com/apache/seatunnel/issues/7009#issuecomment-2175265970 link https://github.com/apache/seatunnel/issues/7008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[I] [Feature][Spark] Support multiple tables read and write [seatunnel]

2024-06-17 Thread via GitHub
hailin0 opened a new issue, #7009: URL: https://github.com/apache/seatunnel/issues/7009 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

[I] [Feature][Flink] Support multiple tables read and write [seatunnel]

2024-06-17 Thread via GitHub
hailin0 opened a new issue, #7008: URL: https://github.com/apache/seatunnel/issues/7008 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

Re: [I] [Bug] [Kingbase] Why 2.3.4 support Kingbase, but could not find any jdbc dialect factory [seatunnel]

2024-06-17 Thread via GitHub
turnglight commented on issue #7005: URL: https://github.com/apache/seatunnel/issues/7005#issuecomment-2175230625 done it to replace the latest connect-jdbc-2.3.4.jar -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] [Bug] [Kingbase] Why 2.3.4 support Kingbase, but could not find any jdbc dialect factory [seatunnel]

2024-06-17 Thread via GitHub
turnglight closed issue #7005: [Bug] [Kingbase] Why 2.3.4 support Kingbase, but could not find any jdbc dialect factory URL: https://github.com/apache/seatunnel/issues/7005 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

(seatunnel) branch dev updated: [Hotfix][CDC] Fix split schema change stream (#7003)

2024-06-17 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 0c3044e3f6 [Hotfix][CDC] Fix split schema chang

Re: [I] [Bug] [CDC] Loss last batch data in splitSchemaChangeStream [seatunnel]

2024-06-17 Thread via GitHub
hailin0 closed issue #7000: [Bug] [CDC] Loss last batch data in splitSchemaChangeStream URL: https://github.com/apache/seatunnel/issues/7000 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [PR] [Hotfix][CDC] Fix split schema change stream [seatunnel]

2024-06-17 Thread via GitHub
hailin0 merged PR #7003: URL: https://github.com/apache/seatunnel/pull/7003 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [I] There is a problem with SeaTunnel Web's sql function for processing and transforming tasks [seatunnel]

2024-06-17 Thread via GitHub
liunaijie commented on issue #7007: URL: https://github.com/apache/seatunnel/issues/7007#issuecomment-2175074336 this is an know issue, it will auto generate the result_table_name. so you can't query the source table. -- This is an automated message from the Apache Git Service. To res

Re: [PR] [Feature][Connector] Add druid sink connector [seatunnel]

2024-06-17 Thread via GitHub
TaoZex commented on code in PR #6346: URL: https://github.com/apache/seatunnel/pull/6346#discussion_r1643783128 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-druid-e2e/src/test/resources/fakesource_to_druid.conf: ## @@ -0,0 +1,57 @@ +# +# Licensed to the Apache Software

Re: [PR] [Hotfix][CDC] Fix split schema change stream [seatunnel]

2024-06-17 Thread via GitHub
hailin0 commented on code in PR #7003: URL: https://github.com/apache/seatunnel/pull/7003#discussion_r1643707286 ## seatunnel-connectors-v2/connector-cdc/connector-cdc-base/src/main/java/org/apache/seatunnel/connectors/cdc/base/source/reader/external/IncrementalSourceStreamFetcher.java:

Re: [I] SeaTunnel community meeting Topic collect [seatunnel]

2024-06-17 Thread via GitHub
laixueyong commented on issue #7004: URL: https://github.com/apache/seatunnel/issues/7004#issuecomment-2174890872 Web的数据集成的转换与处理的sql功能 总是报找不到source中的表 ![3264995dbb65099422b8a6974113e05](https://github.com/apache/seatunnel/assets/141210485/2b2e19a7-2dc5-4a6b-bd96-553c3c08be4a) ![415181

[I] There is a problem with SeaTunnel Web's sql function for processing and transforming tasks [seatunnel]

2024-06-17 Thread via GitHub
laixueyong opened a new issue, #7007: URL: https://github.com/apache/seatunnel/issues/7007 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Hotfix][CDC] Fix split schema change stream [seatunnel]

2024-06-17 Thread via GitHub
hailin0 commented on code in PR #7003: URL: https://github.com/apache/seatunnel/pull/7003#discussion_r1643681715 ## seatunnel-connectors-v2/connector-cdc/connector-cdc-base/src/main/java/org/apache/seatunnel/connectors/cdc/base/source/reader/external/IncrementalSourceStreamFetcher.java:

[I] [Bug] [Kingbase] Why 2.3.4 support Kingbase, but could not find any jdbc dialect factory [seatunnel]

2024-06-17 Thread via GitHub
turnglight opened a new issue, #7005: URL: https://github.com/apache/seatunnel/issues/7005 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [I] SeaTunnel community meeting Topic collect [seatunnel]

2024-06-17 Thread via GitHub
zhang5059T commented on issue #7004: URL: https://github.com/apache/seatunnel/issues/7004#issuecomment-2174868047 Hi could talk about the supported Spark versions of Seatunnel on Spark? Recently, I was submitting the Seatunnel project using Spark-operator and found that it threw a type conv

Re: [PR] [Hotfix][CDC] Fix split schema change stream [seatunnel]

2024-06-17 Thread via GitHub
dailai commented on code in PR #7003: URL: https://github.com/apache/seatunnel/pull/7003#discussion_r1643574218 ## seatunnel-connectors-v2/connector-cdc/connector-cdc-base/src/main/java/org/apache/seatunnel/connectors/cdc/base/source/reader/external/IncrementalSourceStreamFetcher.java:

Re: [I] SeaTunnel community meeting Topic collect [seatunnel]

2024-06-17 Thread via GitHub
hailin0 commented on issue #7004: URL: https://github.com/apache/seatunnel/issues/7004#issuecomment-2174846901 @EricJoy2048 - https://github.com/apache/seatunnel/pull/6885 - https://github.com/apache/seatunnel/pull/6825 - https://github.com/apache/seatunnel/pull/6193 - https://git

Re: [I] SeaTunnel community meeting Topic collect [seatunnel]

2024-06-17 Thread via GitHub
hailin0 commented on issue #7004: URL: https://github.com/apache/seatunnel/issues/7004#issuecomment-2174845036 @hailin0 - https://github.com/apache/seatunnel/pull/6785 - https://github.com/apache/seatunnel/pull/6526 - https://github.com/apache/seatunnel/pull/6915 -- This is an au

Re: [I] SeaTunnel community meeting Topic collect [seatunnel]

2024-06-17 Thread via GitHub
hailin0 commented on issue #7004: URL: https://github.com/apache/seatunnel/issues/7004#issuecomment-2174845549 @dailai - https://github.com/apache/seatunnel/pull/6740 - https://github.com/apache/seatunnel/pull/6929 -- This is an automated message from the Apache Git Service. To respo

Re: [I] SeaTunnel community meeting Topic collect [seatunnel]

2024-06-17 Thread via GitHub
hailin0 commented on issue #7004: URL: https://github.com/apache/seatunnel/issues/7004#issuecomment-2174839088 @Hisoka-X - https://github.com/apache/seatunnel/pull/6826 - https://github.com/apache/seatunnel/pull/6843 -- This is an automated message from the Apache Git Service. To

Re: [I] SeaTunnel community meeting Topic collect [seatunnel]

2024-06-17 Thread via GitHub
hailin0 closed issue #6848: SeaTunnel community meeting Topic collect URL: https://github.com/apache/seatunnel/issues/6848 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[I] SeaTunnel community meeting Topic collect [seatunnel]

2024-06-17 Thread via GitHub
hailin0 opened a new issue, #7004: URL: https://github.com/apache/seatunnel/issues/7004 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

(seatunnel-website) branch main updated: [NOTICE] Update security notice (#313)

2024-06-17 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/seatunnel-website.git The following commit(s) were added to refs/heads/main by this push: new bd34fb6e76b [NOTICE] Update security

Re: [PR] [NOTICE] Update security notice [seatunnel-website]

2024-06-17 Thread via GitHub
hailin0 merged PR #313: URL: https://github.com/apache/seatunnel-website/pull/313 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@se

Re: [I] seatunnel engine 与Datax采集性能比对 [seatunnel]

2024-06-17 Thread via GitHub
rocketguan commented on issue #6983: URL: https://github.com/apache/seatunnel/issues/6983#issuecomment-2174776528 谢谢各位的耐心答复,问题排查到了,是因为我的sink端jdbc没有加上:rewriteBatchedStatements=true,因为DataX是默认会增加这个配置,所以没有受影响,ST需要手工增加这个配置 -- This is an automated message from the Apache Git Service. To respon

Re: [I] seatunnel engine 与Datax采集性能比对 [seatunnel]

2024-06-17 Thread via GitHub
rocketguan closed issue #6983: seatunnel engine 与Datax采集性能比对 URL: https://github.com/apache/seatunnel/issues/6983 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

(seatunnel-website) branch main updated: [Teams] Update team list

2024-06-17 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/seatunnel-website.git The following commit(s) were added to refs/heads/main by this push: new e077823c42c [Teams] Update team list e077

Re: [PR] [Teams] Update team list [seatunnel-website]

2024-06-17 Thread via GitHub
Hisoka-X merged PR #310: URL: https://github.com/apache/seatunnel-website/pull/310 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@s

Re: [I] During Hive metastore connection, the underlying NULL data is\N error [seatunnel]

2024-06-17 Thread via GitHub
15810785091 commented on issue #6744: URL: https://github.com/apache/seatunnel/issues/6744#issuecomment-2174741112 I try to use ORC or parquet file format for my subsequent data. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] [Bug] mvn install fail [seatunnel]

2024-06-17 Thread via GitHub
hoey94 commented on issue #6607: URL: https://github.com/apache/seatunnel/issues/6607#issuecomment-2174732518 @ashulin -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] [Hotfix][CDC] Fix split schema change stream [seatunnel]

2024-06-17 Thread via GitHub
hailin0 commented on PR #7003: URL: https://github.com/apache/seatunnel/pull/7003#issuecomment-2173706906 link https://github.com/apache/seatunnel/pull/6929 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[PR] [Hotfix][CDC] Fix split schema change stream [seatunnel]

2024-06-17 Thread via GitHub
hailin0 opened a new pull request, #7003: URL: https://github.com/apache/seatunnel/pull/7003 ### Purpose of this pull request close https://github.com/apache/seatunnel/issues/7000 [CDC] Fix split schema change stream ### Does this PR introduce _any_ user-facing ch

Re: [I] During Hive metastore connection, the underlying NULL data is\N error [seatunnel]

2024-06-17 Thread via GitHub
iture123 commented on issue #6744: URL: https://github.com/apache/seatunnel/issues/6744#issuecomment-2173477367 > @iture123 Are you dealing with this matter? I had try to fix,but I see It is a feature not bug.Becasue It use a common deserialize schema in `org.apache.seatunnel.forma

Re: [PR] [Connector]Add druid sink connector [seatunnel]

2024-06-17 Thread via GitHub
hailin0 commented on code in PR #6346: URL: https://github.com/apache/seatunnel/pull/6346#discussion_r1642854722 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-druid-e2e/src/test/resources/fakesource_to_druid.conf: ## @@ -0,0 +1,57 @@ +# +# Licensed to the Apache Software

Re: [I] [Bug] [Mysql-cdc] send Mysql data to kafka [seatunnel]

2024-06-17 Thread via GitHub
phineasliu commented on issue #5010: URL: https://github.com/apache/seatunnel/issues/5010#issuecomment-2173434786 这问题咋解决? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [Connector]Add druid sink connector [seatunnel]

2024-06-17 Thread via GitHub
TaoZex commented on PR #6346: URL: https://github.com/apache/seatunnel/pull/6346#issuecomment-2173431568 > Do you have plans to support cdc/savemode/multi-table? Of course. Please assign to me. -- This is an automated message from the Apache Git Service. To respond to the message, p

[I] [Feature][Druid] Druid sink connector support multi table and cdc [seatunnel]

2024-06-17 Thread via GitHub
TaoZex opened a new issue, #7002: URL: https://github.com/apache/seatunnel/issues/7002 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ##

Re: [PR] [Connector]Add druid sink connector [seatunnel]

2024-06-17 Thread via GitHub
hailin0 commented on PR #6346: URL: https://github.com/apache/seatunnel/pull/6346#issuecomment-2173417130 Do you have plans to support cdc/savemode/multi-table? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [I] [Doc][Improve] support chinese [seatunnel]

2024-06-17 Thread via GitHub
latch890727 commented on issue #6378: URL: https://github.com/apache/seatunnel/issues/6378#issuecomment-2173322578 Please assign it to me : connector-v2/sink/Rabbitmq.md connector-v2/sink/StarRocks.md connector-v2/sink/Phoenix.md connector-v2/sink/ClickhouseFile.md connector-v2

svn commit: r69810 - /dev/seatunnel/seatunnel-web/1.0.1/ /release/seatunnel/seatunnel-web/1.0.1/

2024-06-17 Thread fanjia
Author: fanjia Date: Mon Jun 17 12:41:42 2024 New Revision: 69810 Log: Release web 1.0.1 Added: release/seatunnel/seatunnel-web/1.0.1/ - copied from r69809, dev/seatunnel/seatunnel-web/1.0.1/ Removed: dev/seatunnel/seatunnel-web/1.0.1/

Re: [I] [Bug] [Spark] Running on spark-operator Executor run error [seatunnel]

2024-06-17 Thread via GitHub
zhang5059T closed issue #6988: [Bug] [Spark] Running on spark-operator Executor run error URL: https://github.com/apache/seatunnel/issues/6988 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

(seatunnel) branch dev updated: [bugfix] fix mysql create table comment special string bug (#6998)

2024-06-17 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 904e9cf785 [bugfix] fix mysql create table comm

Re: [PR] [connector-jdbc][bugfix] fix mysql create table comment special string bug [seatunnel]

2024-06-17 Thread via GitHub
EricJoy2048 merged PR #6998: URL: https://github.com/apache/seatunnel/pull/6998 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seat

[PR] [fix] revert IMAP cache data field type to compatible with old version [seatunnel]

2024-06-17 Thread via GitHub
liunaijie opened a new pull request, #7001: URL: https://github.com/apache/seatunnel/pull/7001 ### Purpose of this pull request fix #6853 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? using exist test.

Re: [I] [Bug] [Connector-CDC-Base] Loss last batch data in splitSchemaChangeStream [seatunnel]

2024-06-17 Thread via GitHub
dailai commented on issue #7000: URL: https://github.com/apache/seatunnel/issues/7000#issuecomment-2172960114 Maybe there's something wrong with the code here. ![截屏2024-06-17 18 08 01](https://github.com/apache/seatunnel/assets/18141150/6881f177-f460-44b4-b650-dae485c23bc3) -- This

[I] [Bug] [Connector-CDC-Base] Loss last batch data in splitSchemaChangeStream [seatunnel]

2024-06-17 Thread via GitHub
dailai opened a new issue, #7000: URL: https://github.com/apache/seatunnel/issues/7000 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] When extracting hive data to mysql, the parallelism parameter setting is invalid. [seatunnel]

2024-06-17 Thread via GitHub
Dsrong commented on issue #6830: URL: https://github.com/apache/seatunnel/issues/6830#issuecomment-2172705858 I had some issue at 2.3.5 version,the parallelism parameter is not work,only one parallelism working -- This is an automated message from the Apache Git Service. To respond to th

Re: [PR] [connector-jdbc][bugfix] fix mysql create table comment special string bug [seatunnel]

2024-06-17 Thread via GitHub
chl-wxp commented on code in PR #6998: URL: https://github.com/apache/seatunnel/pull/6998#discussion_r1642424192 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/catalog/mysql/MysqlCreateTableSqlBuilder.java: ## @@ -191,7 +19

Re: [PR] [Connector]Add druid sink connector [seatunnel]

2024-06-17 Thread via GitHub
TaoZex commented on code in PR #6346: URL: https://github.com/apache/seatunnel/pull/6346#discussion_r1642392579 ## docs/en/connector-v2/sink/Druid.md: ## @@ -0,0 +1,67 @@ +# Druid + +> Druid sink connector + +## Description + +Write data to Druid + +## Key features + +- [ ] [exa

Re: [I] An error is reported for data synchronization Caused by: java.sql.BatchUpdateException: ORA-01461 [seatunnel]

2024-06-17 Thread via GitHub
Carl-Zhou-CN closed issue #6972: An error is reported for data synchronization Caused by: java.sql.BatchUpdateException: ORA-01461 URL: https://github.com/apache/seatunnel/issues/6972 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [I] An error is reported for data synchronization Caused by: java.sql.BatchUpdateException: ORA-01461 [seatunnel]

2024-06-17 Thread via GitHub
Carl-Zhou-CN commented on issue #6972: URL: https://github.com/apache/seatunnel/issues/6972#issuecomment-2172585328 > Originally, the jar of the ojdbc8-12 version was adjusted, and the adjustment to the ojdbc8-19 version will not cause an error Issue resolved, close this issue -- T

Re: [I] An error is reported for data synchronization Caused by: java.sql.BatchUpdateException: ORA-01461 [seatunnel]

2024-06-17 Thread via GitHub
mtzcsc commented on issue #6972: URL: https://github.com/apache/seatunnel/issues/6972#issuecomment-2172582370 Originally, the jar of the ojdbc8-12 version was adjusted, and the adjustment to the ojdbc8-19 version will not cause an error -- This is an automated message from the Apache Git

Re: [PR] [connector-jdbc][bugfix] fix mysql create table comment special string bug [seatunnel]

2024-06-17 Thread via GitHub
hailin0 commented on code in PR #6998: URL: https://github.com/apache/seatunnel/pull/6998#discussion_r1642326872 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/catalog/mysql/MysqlCreateTableSqlBuilder.java: ## @@ -191,7 +19

[I] [Feature][Core] Support Bach Write or BulkWrite [seatunnel]

2024-06-17 Thread via GitHub
Thomas-HuWei opened a new issue, #6999: URL: https://github.com/apache/seatunnel/issues/6999 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.