(seatunnel) branch 2.3.7-release created (now c783652826)

2024-08-13 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a change to branch 2.3.7-release in repository https://gitbox.apache.org/repos/asf/seatunnel.git at c783652826 [Release][2.3.7][release-note] Add release-note This branch includes the following new commits

(seatunnel) 01/01: [Release][2.3.7][release-note] Add release-note

2024-08-13 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a commit to branch 2.3.7-release in repository https://gitbox.apache.org/repos/asf/seatunnel.git commit c78365282626d181aebbbd56b7dc39074f0252ce Author: wuchunfu <319355...@qq.com> AuthorDate: Wed Aug 14 14:46:45

Re: [I] [Improvement][Seatunnel-web] Add support to execute seatunnel-web REST API e2e [seatunnel]

2024-08-13 Thread via GitHub
arshadmohammad commented on issue #7344: URL: https://github.com/apache/seatunnel/issues/7344#issuecomment-2287956838 Raised PR https://github.com/apache/seatunnel-web/pull/180 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [I] [Feature][Connector-V2] Fake Source support produce vector data [seatunnel]

2024-08-13 Thread via GitHub
corgy-w commented on issue #7390: URL: https://github.com/apache/seatunnel/issues/7390#issuecomment-2287948924 assign to me, I'm almost done, forgot to comment last night 🎑 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [PR] [Feature][Spark] Support multiple tables read and write [seatunnel]

2024-08-13 Thread via GitHub
Hisoka-X merged PR #7283: URL: https://github.com/apache/seatunnel/pull/7283 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [I] [Feature][Spark] Support multiple tables read and write [seatunnel]

2024-08-13 Thread via GitHub
Hisoka-X closed issue #7009: [Feature][Spark] Support multiple tables read and write URL: https://github.com/apache/seatunnel/issues/7009 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [Feature][Spark] Support multiple tables read and write [seatunnel]

2024-08-13 Thread via GitHub
Carl-Zhou-CN commented on code in PR #7283: URL: https://github.com/apache/seatunnel/pull/7283#discussion_r1716342045 ## seatunnel-core/seatunnel-core-starter/src/main/java/org/apache/seatunnel/core/starter/execution/PluginUtil.java: ## @@ -98,10 +104,11 @@ public static SourceT

Re: [PR] [Feature][Spark] Support multiple tables read and write [seatunnel]

2024-08-13 Thread via GitHub
Hisoka-X commented on code in PR #7283: URL: https://github.com/apache/seatunnel/pull/7283#discussion_r1716340494 ## seatunnel-core/seatunnel-core-starter/src/main/java/org/apache/seatunnel/core/starter/execution/PluginUtil.java: ## @@ -98,10 +104,11 @@ public static SourceTable

Re: [PR] [Feature][Spark] Support multiple tables read and write [seatunnel]

2024-08-13 Thread via GitHub
Carl-Zhou-CN commented on code in PR #7283: URL: https://github.com/apache/seatunnel/pull/7283#discussion_r1716338879 ## seatunnel-core/seatunnel-core-starter/src/main/java/org/apache/seatunnel/core/starter/execution/PluginUtil.java: ## @@ -98,10 +104,11 @@ public static SourceT

(seatunnel) branch dev updated (464da8fb9b -> 40c5f313eb)

2024-08-13 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 464da8fb9b [Fix][Connector-V2] Fix doris primary key order and fields order are inconsistent (#7377) add 40c5f

Re: [PR] [Hotfix][MySQL-CDC] Fix ArrayIndexOutOfBoundsException in mysql binlog read [seatunnel]

2024-08-13 Thread via GitHub
wuchunfu merged PR #7381: URL: https://github.com/apache/seatunnel/pull/7381 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [I] [Bug] [MySQL-CDC] throw java.lang.ArrayIndexOutOfBoundsException [seatunnel]

2024-08-13 Thread via GitHub
wuchunfu closed issue #7380: [Bug] [MySQL-CDC] throw java.lang.ArrayIndexOutOfBoundsException URL: https://github.com/apache/seatunnel/issues/7380 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [Feature][Spark] Support multiple tables read and write [seatunnel]

2024-08-13 Thread via GitHub
Hisoka-X commented on code in PR #7283: URL: https://github.com/apache/seatunnel/pull/7283#discussion_r1716249464 ## seatunnel-core/seatunnel-core-starter/src/main/java/org/apache/seatunnel/core/starter/execution/PluginUtil.java: ## @@ -98,10 +104,11 @@ public static SourceTable

Re: [I] [Bug] [mysql cdc] can't read data from mysql cdc source [seatunnel]

2024-08-13 Thread via GitHub
Yuuurj commented on issue #5831: URL: https://github.com/apache/seatunnel/issues/5831#issuecomment-2287753772 @avatarTaier @wilsonfu88 How did you solve this problem -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[I] [Bug] [SqlServer-CDC] STREAMING job with "startup.mode = earliest" failed [seatunnel]

2024-08-13 Thread via GitHub
xiaohundun opened a new issue, #7398: URL: https://github.com/apache/seatunnel/issues/7398 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [I] [Bug] [mysql cdc] can't read data from mysql cdc source,Both v2.3.3 and v2.3.4 tested the same and reported errors [seatunnel]

2024-08-13 Thread via GitHub
Yuuurj commented on issue #6434: URL: https://github.com/apache/seatunnel/issues/6434#issuecomment-2287744049 > v2.3.5dev 测试成功 How did you solve the same problem? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[I] [Bug] [Oracle-CDC] Get error: ClasspathURLStreamHandlerProvider not found in version 2.3.6 [seatunnel]

2024-08-13 Thread via GitHub
alvinkam opened a new issue, #7397: URL: https://github.com/apache/seatunnel/issues/7397 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] [Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on connector [seatunnel]

2024-08-13 Thread via GitHub
corgy-w commented on issue #5651: URL: https://github.com/apache/seatunnel/issues/5651#issuecomment-2287715973 assgin me iot source&sink, thanks :> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] [Feature][Prometheus] Support Prometheus connector source/sink [seatunnel]

2024-08-13 Thread via GitHub
corgy-w commented on issue #7201: URL: https://github.com/apache/seatunnel/issues/7201#issuecomment-2287714549 > hi,@hailin0,for writer,I haven't found a good way. use pushgateway or vm writer?for pushgateway,it cannot take timestamp Any progress? We're adding to that as well

Re: [PR] [Improvement] jdbc support dialect.name to choose dialect. [seatunnel]

2024-08-13 Thread via GitHub
Hisoka-X commented on code in PR #7294: URL: https://github.com/apache/seatunnel/pull/7294#discussion_r1716220243 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/dialect/mysql/MySqlDialectFactory.java: ## @@ -39,6 +

Re: [I] [Bug] [MySQL-CDC] throw java.lang.ArrayIndexOutOfBoundsException [seatunnel]

2024-08-13 Thread via GitHub
nmz0324 commented on issue #7380: URL: https://github.com/apache/seatunnel/issues/7380#issuecomment-2287690387 还没有 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

Re: [I] [Bug] [MySQL-CDC] throw java.lang.ArrayIndexOutOfBoundsException [seatunnel]

2024-08-13 Thread via GitHub
tyx-away commented on issue #7380: URL: https://github.com/apache/seatunnel/issues/7380#issuecomment-2287683762 解决了吗? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] [Feature][CDC] Support Cassandra cdc connector source [seatunnel]

2024-08-13 Thread via GitHub
github-actions[bot] commented on issue #7196: URL: https://github.com/apache/seatunnel/issues/7196#issuecomment-2287491569 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][pinecone] Support pinecone connector source/sink [seatunnel]

2024-08-13 Thread via GitHub
github-actions[bot] commented on issue #7202: URL: https://github.com/apache/seatunnel/issues/7202#issuecomment-2287491379 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][Weaviate] Support weaviate connector source/sink [seatunnel]

2024-08-13 Thread via GitHub
github-actions[bot] commented on issue #7192: URL: https://github.com/apache/seatunnel/issues/7192#issuecomment-2287491712 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][Etcd] Support etcd connector source/sink [seatunnel]

2024-08-13 Thread via GitHub
github-actions[bot] commented on issue #7193: URL: https://github.com/apache/seatunnel/issues/7193#issuecomment-2287491622 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

2024-08-13 Thread via GitHub
github-actions[bot] commented on issue #7197: URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-2287491507 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][CDC] Support oceanbase cdc connector source [seatunnel]

2024-08-13 Thread via GitHub
github-actions[bot] commented on issue #7198: URL: https://github.com/apache/seatunnel/issues/7198#issuecomment-2287491440 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [PR] [Improvement][Seatunnel-web] Add support to execute seatunnel-web REST API e2e [seatunnel-web]

2024-08-13 Thread via GitHub
arshadmohammad commented on PR #180: URL: https://github.com/apache/seatunnel-web/pull/180#issuecomment-2287054866 Added 31 test cases also. All are passing ![image](https://github.com/user-attachments/assets/0f335966-5dcf-4a91-9a2e-e0642e0c457f) -- This is an automated message fro

[PR] [Improvement][Seatunnel-web] Add support to execute seatunnel-web REST API e2e [seatunnel-web]

2024-08-13 Thread via GitHub
arshadmohammad opened a new pull request, #180: URL: https://github.com/apache/seatunnel-web/pull/180 Added to support run test cases in live seatunnel and seatunnel-web. Please go through seatunnel-web-it/README.md to know how to run these integration tests. ## Purpose of this p

Re: [I] JVM Memory Increase in Seatunnel [seatunnel]

2024-08-13 Thread via GitHub
shrikhaparul commented on issue #6786: URL: https://github.com/apache/seatunnel/issues/6786#issuecomment-2286784465 please re-open the above issue...not yet resolved -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] Unable to execute jdbc json config in version 2.3.4 which can be run on old version 2.3.3... [seatunnel]

2024-08-13 Thread via GitHub
shrikhaparul closed issue #7394: Unable to execute jdbc json config in version 2.3.4 which can be run on old version 2.3.3... URL: https://github.com/apache/seatunnel/issues/7394 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [I] Unable to execute jdbc json config in version 2.3.4 which can be run on old version 2.3.3...Getting Failed to get driver instance [seatunnel]

2024-08-13 Thread via GitHub
shrikhaparul commented on issue #7395: URL: https://github.com/apache/seatunnel/issues/7395#issuecomment-2286781828 IS this a bugor am I doing something wrong -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[I] Unable to execute jdbc json config in version 2.3.4 which can be run on old version 2.3.3...Getting Failed to get driver instance [seatunnel]

2024-08-13 Thread via GitHub
shrikhaparul opened a new issue, #7395: URL: https://github.com/apache/seatunnel/issues/7395 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happe

[I] Unable to execute jdbc json config in version 2.3.4 which can be run on old version 2.3.3... [seatunnel]

2024-08-13 Thread via GitHub
shrikhaparul opened a new issue, #7394: URL: https://github.com/apache/seatunnel/issues/7394 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happe

Re: [PR] [Feature][Rabbitmq] Allow configuration of queue durability and deletion policy [seatunnel]

2024-08-13 Thread via GitHub
zqr10159 commented on PR #7365: URL: https://github.com/apache/seatunnel/pull/7365#issuecomment-2286524305 Sorry, I don't know how to fix this. I created a new branch and rolled back all my code, but still the local test doesn't pass, can you give me some guidance, thank you very much!

[I] [Feature][Module Name] MySQL CDC 总是报错 Generate Splits for table xx.xx error [seatunnel]

2024-08-13 Thread via GitHub
inuex opened a new issue, #7393: URL: https://github.com/apache/seatunnel/issues/7393 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ###

Re: [PR] [Fix][Connector-V2] Fix doris primary key order and fields order are inconsistent [seatunnel]

2024-08-13 Thread via GitHub
hailin0 merged PR #7377: URL: https://github.com/apache/seatunnel/pull/7377 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Feature][Connector-V2] add Aliyun SLS connector #3733 (#7348)

2024-08-13 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 527c7c7b5f [Feature][Connector-V2] add Aliyun S

Re: [PR] [Feature][Connector-V2] add Aliyun SLS connector #3733 [seatunnel]

2024-08-13 Thread via GitHub
hailin0 merged PR #7348: URL: https://github.com/apache/seatunnel/pull/7348 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Bug][Seatunnel-web] Jwt Algorithm is hardcoded. Use the configured j… [seatunnel-web]

2024-08-13 Thread via GitHub
arshadmohammad commented on PR #179: URL: https://github.com/apache/seatunnel-web/pull/179#issuecomment-2286328724 nice catch @BilwaST -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[I] [Bug] [spark] The op field conflicts with the internal field of the Seatunnel Spark engine and cannot be read from the data source. [seatunnel]

2024-08-13 Thread via GitHub
lizc9 opened a new issue, #7392: URL: https://github.com/apache/seatunnel/issues/7392 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Feature][Rabbitmq] Allow configuration of queue durability and deletion policy [seatunnel]

2024-08-13 Thread via GitHub
Hisoka-X commented on PR #7365: URL: https://github.com/apache/seatunnel/pull/7365#issuecomment-2286241975 please fix ci -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] [Bug][Seatunnel-web] Jwt Algorithm is hardcoded. Use the configured j… [seatunnel-web]

2024-08-13 Thread via GitHub
BilwaST opened a new pull request, #179: URL: https://github.com/apache/seatunnel-web/pull/179 …wt algorithm ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new

Re: [I] [Bug] [MySQL-CDC] throw java.lang.ArrayIndexOutOfBoundsException [seatunnel]

2024-08-13 Thread via GitHub
nmz0324 commented on issue #7380: URL: https://github.com/apache/seatunnel/issues/7380#issuecomment-2285901609 Boss, can you provide a fixed jar package? I am currently experiencing the same problem! -- This is an automated message from the Apache Git Service. To respond to the message, p

[PR] [Improve][Connector-V2] Remove system table limit [seatunnel]

2024-08-13 Thread via GitHub
Hisoka-X opened a new pull request, #7391: URL: https://github.com/apache/seatunnel/pull/7391 ### Purpose of this pull request This PR remove system table limit in catalog implement. So user can read data from system table. ### Does this PR introduce _any_ user-faci

Re: [I] [Bug] [Sink JDBC ] 使用 sink-jdbc到postgresql 自动建表时,提示 ERROR: database "postgres" already exists [seatunnel]

2024-08-13 Thread via GitHub
NookVoive commented on issue #7386: URL: https://github.com/apache/seatunnel/issues/7386#issuecomment-2285852263 根据我自己排查的原因,以及基于其他人协助下,初步定位到问题原因在于: 1. 在生成建表语句前,会先进行判断 database 是否存在,而判断时会把查询到的 database 列表过滤掉系统 database 如:postgres,pg_catalog 等。这就导致会认为,数据库:postgres 不存在,进而认为需要先创建 database。

[I] [Feature][Connector-V2] Fake Source support produce vector data [seatunnel]

2024-08-13 Thread via GitHub
Hisoka-X opened a new issue, #7390: URL: https://github.com/apache/seatunnel/issues/7390 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

(seatunnel) branch dev updated: [Fix][Zeta] Fix task can not end cause by lock metrics failed (#7357)

2024-08-13 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 6a7df83b3e [Fix][Zeta] Fix task can not end cause b

Re: [PR] [Fix][Zeta] Fix task can not end cause by lock metrics failed [seatunnel]

2024-08-13 Thread via GitHub
Hisoka-X merged PR #7357: URL: https://github.com/apache/seatunnel/pull/7357 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [Feature][Connector-V2][OceanBase] Support vector types on OceanBase [seatunnel]

2024-08-13 Thread via GitHub
Hisoka-X commented on PR #7375: URL: https://github.com/apache/seatunnel/pull/7375#issuecomment-2285667476 Could you add a test case for insert/read vector into/from oceanbase? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[PR] [Improve][Connector-V2] Close all ResultSet after used [seatunnel]

2024-08-13 Thread via GitHub
Hisoka-X opened a new pull request, #7389: URL: https://github.com/apache/seatunnel/pull/7389 ### Purpose of this pull request This PR try to close all jdbc ResultSet after used. Reduce database resource usage. ### Does this PR introduce _any_ user-facing change?