Re: [I] An error is reported for data synchronization Caused by: java.sql.BatchUpdateException: ORA-01461 [seatunnel]

2024-06-13 Thread via GitHub
hailin0 commented on issue #6972: URL: https://github.com/apache/seatunnel/issues/6972#issuecomment-2167337815 [source table datatype](https://github.com/user-attachments/files/15832730/default.xlsx) -- This is an automated message from the Apache Git Service. To respond to the messag

Re: [I] [Bug] [S3AFile Sink] s3aFile as sink,SeaTunnel rename file [seatunnel]

2024-06-13 Thread via GitHub
EricJoy2048 closed issue #6952: [Bug] [S3AFile Sink] s3aFile as sink,SeaTunnel rename file URL: https://github.com/apache/seatunnel/issues/6952 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [I] [Bug] [SQLServer CDC2Doris] Data write error [seatunnel]

2024-06-13 Thread via GitHub
EricJoy2048 closed issue #6963: [Bug] [SQLServer CDC2Doris] Data write error URL: https://github.com/apache/seatunnel/issues/6963 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] [Bug] [SQLServer CDC2Doris] Data write error [seatunnel]

2024-06-13 Thread via GitHub
EricJoy2048 commented on issue #6964: URL: https://github.com/apache/seatunnel/issues/6964#issuecomment-2167318308 Can you update `table = "ODS_TEST_${table_name}_CDC"` to `table = "ODS.ODS_TEST_${table_name}_CDC"` -- This is an automated message from the Apache Git Service. To respond to

(seatunnel-website) branch main updated: remove seatunnel-web (#311)

2024-06-13 Thread lidongdai
This is an automated email from the ASF dual-hosted git repository. lidongdai pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/seatunnel-website.git The following commit(s) were added to refs/heads/main by this push: new c86c18aa897 remove seatunnel-web (#311

Re: [PR] remove seatunnel-web url link from website [seatunnel-website]

2024-06-13 Thread via GitHub
davidzollo merged PR #311: URL: https://github.com/apache/seatunnel-website/pull/311 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

Re: [I] [Bug] [Doris 2 Doris] Unsupported doris type: JSON [seatunnel]

2024-06-13 Thread via GitHub
EricJoy2048 commented on issue #6965: URL: https://github.com/apache/seatunnel/issues/6965#issuecomment-2167310836 Hi, In seatunnel 2.3.5, the doris source connector support read json column. And you can get `data.XBNO` use SQL Transform. The job config can like this: ``` so

Re: [I] The cluster has 4 machines, but the job only has one master server and one slave server to process jobs. What is the reason [seatunnel]

2024-06-13 Thread via GitHub
EricJoy2048 commented on issue #6979: URL: https://github.com/apache/seatunnel/issues/6979#issuecomment-2167287550 Because your job only have `1` `parallelism ` , So, only run one reader and write. -- This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [I] [Feature][Config File Encryption And Decryption] The decrypted result does not need to be printed [seatunnel]

2024-06-13 Thread via GitHub
EricJoy2048 commented on issue #6980: URL: https://github.com/apache/seatunnel/issues/6980#issuecomment-2167285857 @chl-wxp -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] seatunnel engine 与Datax采集性能比对 [seatunnel]

2024-06-13 Thread via GitHub
EricJoy2048 commented on issue #6983: URL: https://github.com/apache/seatunnel/issues/6983#issuecomment-2167284300 ``` env { job.mode = "BATCH" } source{ Jdbc { parallelism=5 url = "jdbc:mysql://127.0.0.1:3306/mysql_src" driver = "com.mysql.cj.jdbc.Driv

Re: [I] [Bug] [Module Name] Bug title [seatunnel]

2024-06-13 Thread via GitHub
hailin0 commented on issue #6972: URL: https://github.com/apache/seatunnel/issues/6972#issuecomment-2167268570 @mtzcsc Please add source table create table sql into this issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[PR] remove seatunnel-web [seatunnel-website]

2024-06-13 Thread via GitHub
baicie opened a new pull request, #311: URL: https://github.com/apache/seatunnel-website/pull/311 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

(seatunnel) branch dev updated: [Improve][Zeta] Support close idle task for multiple sinks (#6864)

2024-06-13 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 4aa59987e7 [Improve][Zeta] Support close idle task

Re: [PR] [Improve][Zeta] Support close idle task for multiple sinks [seatunnel]

2024-06-13 Thread via GitHub
Hisoka-X merged PR #6864: URL: https://github.com/apache/seatunnel/pull/6864 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

[I] [Bug] [Redis Sink] cluster mode has some issue [seatunnel]

2024-06-13 Thread via GitHub
liunaijie opened a new issue, #6984: URL: https://github.com/apache/seatunnel/issues/6984 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[I] seatunnel engine 与Datax采集性能比对 [seatunnel]

2024-06-13 Thread via GitHub
rocketguan opened a new issue, #6983: URL: https://github.com/apache/seatunnel/issues/6983 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [I] [Bug] [kafka-sink] canal_json 输出格式不正确 [seatunnel]

2024-06-13 Thread via GitHub
UFOXD commented on issue #6955: URL: https://github.com/apache/seatunnel/issues/6955#issuecomment-2167087678 > Can you provide DDL and sample data for me to check ``` CREATE TABLE IF NOT EXISTS `runoob_tbl`( `runoob_id` INT AUTO_INCREMENT, `runoob_title` VARCHAR(100) NOT

Re: [I] [Bug] [Zeta] Config variable substitution 不一致 [seatunnel]

2024-06-13 Thread via GitHub
github-actions[bot] commented on issue #6840: URL: https://github.com/apache/seatunnel/issues/6840#issuecomment-2166996596 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] SeaTunnel community meeting Topic collect [seatunnel]

2024-06-13 Thread via GitHub
github-actions[bot] commented on issue #6848: URL: https://github.com/apache/seatunnel/issues/6848#issuecomment-2166996572 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [serializer-protobuf] exception with compiling seatunnel [seatunnel]

2024-06-13 Thread via GitHub
github-actions[bot] commented on issue #6849: URL: https://github.com/apache/seatunnel/issues/6849#issuecomment-2166996548 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][Connector-v2] The paimon sink is not supported the schema change evolution. [seatunnel]

2024-06-13 Thread via GitHub
github-actions[bot] commented on issue #6852: URL: https://github.com/apache/seatunnel/issues/6852#issuecomment-2166996533 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [PR] [Paimon]support projection for paimon source [seatunnel]

2024-06-13 Thread via GitHub
hailin0 commented on PR #6343: URL: https://github.com/apache/seatunnel/pull/6343#issuecomment-2166077341 cc @dailai -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [I] [Bug] [kafka-sink] canal_json 输出格式不正确 [seatunnel]

2024-06-13 Thread via GitHub
zhilinli123 commented on issue #6955: URL: https://github.com/apache/seatunnel/issues/6955#issuecomment-2165890071 Can you provide DDL and sample data for me to check -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[PR] [Hotfix][Connector-V2][Jdbc] Flink engine, source is LocalFile, sink … [seatunnel]

2024-06-13 Thread via GitHub
luoyongsir opened a new pull request, #6982: URL: https://github.com/apache/seatunnel/pull/6982 …is jdbc, get "No suitable driver" Exception fix (#6902) ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### H

Re: [PR] [Hotfix][Connector-V2][Jdbc] Flink engine, source is LocalFile, sink … [seatunnel]

2024-06-13 Thread via GitHub
luoyongsir closed pull request #6981: [Hotfix][Connector-V2][Jdbc] Flink engine, source is LocalFile, sink … URL: https://github.com/apache/seatunnel/pull/6981 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[PR] [Hotfix][Connector-V2][Jdbc] Flink engine, source is LocalFile, sink … [seatunnel]

2024-06-13 Thread via GitHub
luoyongsir opened a new pull request, #6981: URL: https://github.com/apache/seatunnel/pull/6981 …is jdbc, get "No suitable driver" Exception fix (#6902) ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### H

Re: [PR] [Improve] Add custom job id arg in client [seatunnel]

2024-06-13 Thread via GitHub
Hisoka-X commented on code in PR #6943: URL: https://github.com/apache/seatunnel/pull/6943#discussion_r1638139907 ## seatunnel-engine/seatunnel-engine-client/src/main/java/org/apache/seatunnel/engine/client/job/ClientJobExecutionEnvironment.java: ## @@ -67,8 +67,13 @@ public Cli

Re: [I] [Feature][Transform-V2 Filter] support exclude columns in the filter transform [seatunnel]

2024-06-13 Thread via GitHub
EricJoy2048 closed issue #6910: [Feature][Transform-V2 Filter] support exclude columns in the filter transform URL: https://github.com/apache/seatunnel/issues/6910 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [PR] [Improve][Connector-V2] Improve Paimon source split enumerator [seatunnel]

2024-06-13 Thread via GitHub
EricJoy2048 commented on code in PR #6766: URL: https://github.com/apache/seatunnel/pull/6766#discussion_r1637932861 ## seatunnel-connectors-v2/connector-paimon/src/main/java/org/apache/seatunnel/connectors/seatunnel/paimon/source/PaimonSourceSplitEnumerator.java: ## @@ -39,36 +

Re: [PR] [Improve] Add custom job id arg in client [seatunnel]

2024-06-13 Thread via GitHub
liunaijie commented on code in PR #6943: URL: https://github.com/apache/seatunnel/pull/6943#discussion_r1638073068 ## seatunnel-engine/seatunnel-engine-client/src/main/java/org/apache/seatunnel/engine/client/job/ClientJobExecutionEnvironment.java: ## @@ -67,8 +67,13 @@ public Cl

(seatunnel) branch dev updated: [Feature][Transform-V2 Filter] support exclude columns in the filter transform (#6960)

2024-06-13 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 4ba66372d0 [Feature][Transform-V2 Filter] suppo

Re: [PR] [Feature][Transform-V2 Filter] support exclude columns in the filter transform [seatunnel]

2024-06-13 Thread via GitHub
EricJoy2048 merged PR #6960: URL: https://github.com/apache/seatunnel/pull/6960 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seat

Re: [PR] [Paimon]support projection for paimon source [seatunnel]

2024-06-13 Thread via GitHub
TaoZex commented on PR #6343: URL: https://github.com/apache/seatunnel/pull/6343#issuecomment-2165269036 > this pr #6887 is merged @TaoZex I have changed the code. PTAL. @Hisoka-X @hailin0 -- This is an automated message from the Apache Git Service. To respond to the message, pleas

[I] [Feature][Config File Encryption And Decryption] The decrypted result does not need to be printed [seatunnel]

2024-06-13 Thread via GitHub
mayufeng2595 opened a new issue, #6980: URL: https://github.com/apache/seatunnel/issues/6980 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Improve] refactor clickhouse connector, using Factory to create source/sink [seatunnel]

2024-06-13 Thread via GitHub
liunaijie commented on code in PR #6975: URL: https://github.com/apache/seatunnel/pull/6975#discussion_r1637790885 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/source/ClickhouseSourceFactory.java: ## @@ -37,11

Re: [I] [Bug2.3.4] [postgresqlCDC]对源表做update操作时 ,同步任务报错停止When updating the source table, the synchronization task stops with an error [seatunnel]

2024-06-13 Thread via GitHub
hailin0 commented on issue #6407: URL: https://github.com/apache/seatunnel/issues/6407#issuecomment-2164956101 Please check your database settings https://github.com/apache/seatunnel/blob/dev/docs/en/connector-v2/source/Postgre-CDC.md#using-dependency Here are the steps

Re: [I] [Bug2.3.4] [postgresqlCDC]对源表做update操作时 ,同步任务报错停止When updating the source table, the synchronization task stops with an error [seatunnel]

2024-06-13 Thread via GitHub
hailin0 commented on issue #6407: URL: https://github.com/apache/seatunnel/issues/6407#issuecomment-2164998779 check ``` ALTER TABLE your_table_name REPLICA IDENTITY FULL; ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] [Bug2.3.4] [postgresqlCDC]对源表做update操作时 ,同步任务报错停止When updating the source table, the synchronization task stops with an error [seatunnel]

2024-06-13 Thread via GitHub
chess3cake commented on issue #6407: URL: https://github.com/apache/seatunnel/issues/6407#issuecomment-2164969240 > Please check your database settings https://github.com/apache/seatunnel/blob/dev/docs/en/connector-v2/source/Postgre-CDC.md#using-dependency > > Here are the steps to en

[I] The cluster has 4 machines, but the job only has one master server and one slave server to process jobs. What is the reason [seatunnel]

2024-06-13 Thread via GitHub
sandyustc opened a new issue, #6979: URL: https://github.com/apache/seatunnel/issues/6979 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Improve] refactor clickhouse connector, using Factory to create source/sink [seatunnel]

2024-06-13 Thread via GitHub
Carl-Zhou-CN commented on code in PR #6975: URL: https://github.com/apache/seatunnel/pull/6975#discussion_r1637795471 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/source/ClickhouseSourceFactory.java: ## @@ -37

Re: [I] [Bug2.3.4] [postgresqlCDC]对源表做update操作时 ,同步任务报错停止When updating the source table, the synchronization task stops with an error [seatunnel]

2024-06-13 Thread via GitHub
chess3cake commented on issue #6407: URL: https://github.com/apache/seatunnel/issues/6407#issuecomment-2164943990 对源表delete时也有该问题 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

(seatunnel-web) branch update-doc-of-jwt created (now d7320f34)

2024-06-13 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a change to branch update-doc-of-jwt in repository https://gitbox.apache.org/repos/asf/seatunnel-web.git at d7320f34 Update doc of jwt.secretKey This branch includes the following new commits: new d732

[PR] Update doc of jwt.secretKey [seatunnel-web]

2024-06-13 Thread via GitHub
Hisoka-X opened a new pull request, #169: URL: https://github.com/apache/seatunnel-web/pull/169 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary package

(seatunnel-web) 01/01: Update doc of jwt.secretKey

2024-06-13 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch update-doc-of-jwt in repository https://gitbox.apache.org/repos/asf/seatunnel-web.git commit d7320f34ad79bd72a38f0b9293ff9fc06a8459d3 Author: Jia Fan AuthorDate: Thu Jun 13 15:52:07 2024 +0800

(seatunnel-web) branch 1.0.1-release updated: Update doc of jwt.secretKey

2024-06-13 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch 1.0.1-release in repository https://gitbox.apache.org/repos/asf/seatunnel-web.git The following commit(s) were added to refs/heads/1.0.1-release by this push: new ad1c842f Update doc of jwt.

(seatunnel-web) branch 1.0.1-release updated: Add 1.0.1 release note

2024-06-13 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch 1.0.1-release in repository https://gitbox.apache.org/repos/asf/seatunnel-web.git The following commit(s) were added to refs/heads/1.0.1-release by this push: new 8bdde43b Add 1.0.1 release

(seatunnel) branch dev updated: [Improve][File Connector]Improve xml read code & fix can not use true for a boolean option (#6930)

2024-06-13 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new c13a563994 [Improve][File Connector]Improve xml

Re: [PR] [Improve][File Connector]Improve xml read code & fix can not use true for a boolean option [seatunnel]

2024-06-13 Thread via GitHub
hailin0 merged PR #6930: URL: https://github.com/apache/seatunnel/pull/6930 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Improve] refactor clickhouse connector, using Factory to create source/sink [seatunnel]

2024-06-13 Thread via GitHub
Carl-Zhou-CN commented on PR #6975: URL: https://github.com/apache/seatunnel/pull/6975#issuecomment-2164716974 good job -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u