[PR] [Feature][web datasource-postgresql-cdc] support web add pg cdc dadasource [seatunnel-web]

2024-08-19 Thread via GitHub
fanxishu opened a new pull request, #188: URL: https://github.com/apache/seatunnel-web/pull/188 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary package

(seatunnel) branch dev updated: [Improve][Connector-V2] Remove system table limit (#7391)

2024-08-19 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new adf888e008 [Improve][Connector-V2] Remove syste

Re: [PR] [Improve][Connector-V2] Remove system table limit [seatunnel]

2024-08-19 Thread via GitHub
hailin0 merged PR #7391: URL: https://github.com/apache/seatunnel/pull/7391 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

[I] [Feature][web datasource-postgresql-cdc] support web add pg cdc dadasource [seatunnel]

2024-08-19 Thread via GitHub
fanxishu opened a new issue, #7437: URL: https://github.com/apache/seatunnel/issues/7437 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Feature][Connector-V2][OceanBase] Support vector types on OceanBase [seatunnel]

2024-08-19 Thread via GitHub
Hisoka-X commented on PR #7375: URL: https://github.com/apache/seatunnel/pull/7375#issuecomment-2298020671 Please merge from dev then use fake source to produce vector data to write into oceanbase -- This is an automated message from the Apache Git Service. To respond to the message, plea

Re: [PR] [Feature][Connector-V2][OceanBase] Support vector types on OceanBase [seatunnel]

2024-08-19 Thread via GitHub
xxsc0529 commented on PR #7375: URL: https://github.com/apache/seatunnel/pull/7375#issuecomment-2298007359 > Thanks @xxsc0529 ! How about waiting #7401 be merged to replace milvus in test case? @Hisoka-X this #7401 is merged -- This is an automated message from the Apache Git Servi

Re: [PR] [Bug][Connector-v2][KafkaSource]Fix the abnormal exit of KafkaConsumerThread. [seatunnel]

2024-08-19 Thread via GitHub
Hisoka-X commented on code in PR #7273: URL: https://github.com/apache/seatunnel/pull/7273#discussion_r1722664368 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/source/KafkaConsumerThread.java: ## @@ -58,8 +61,7 @@ public

(seatunnel) branch st-metrics deleted (was 0567e2af27)

2024-08-19 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a change to branch st-metrics in repository https://gitbox.apache.org/repos/asf/seatunnel.git was 0567e2af27 [Core][Metrics] Add Seatunnel Metrics module (#2888) This change permanently discards the follo

(seatunnel) branch document_restructure deleted (was 03f8c53098)

2024-08-19 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a change to branch document_restructure in repository https://gitbox.apache.org/repos/asf/seatunnel.git was 03f8c53098 [Feature][Docs] Refactor documents structure (#4730) This change permanently discards

[I] [Feature][Module Name] Feature title你好,随着databend的使用越来越广泛,是否可以增加databend的连接器 [seatunnel]

2024-08-19 Thread via GitHub
cabbage18 opened a new issue, #7436: URL: https://github.com/apache/seatunnel/issues/7436 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Improve][Document] Update the guide and add example [seatunnel]

2024-08-19 Thread via GitHub
Hisoka-X commented on PR #7388: URL: https://github.com/apache/seatunnel/pull/7388#issuecomment-2297884843 Please follow the guide to open github action on your fork repository. Thanks ![image](https://github.com/user-attachments/assets/f6376d42-fcbb-431a-aa3e-884967d62e71) -- Th

(seatunnel) branch dev updated (2130e0d5ad -> 6937d10ac3)

2024-08-19 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 2130e0d5ad [Fix] Fix oracle sample data from column error (#7340) add 6937d10ac3 [Feature][Connector-V2] Fake

Re: [PR] [Feature][Connector-V2] Fake Source support produce vector data [seatunnel]

2024-08-19 Thread via GitHub
hailin0 merged PR #7401: URL: https://github.com/apache/seatunnel/pull/7401 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Feature][Connector-V2] Fake Source support produce vector data [seatunnel]

2024-08-19 Thread via GitHub
corgy-w commented on code in PR #7401: URL: https://github.com/apache/seatunnel/pull/7401#discussion_r1722629010 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/type/VectorType.java: ## @@ -30,8 +30,8 @@ public class VectorType implements SeaTunnelDataType { p

[PR] [Improve] Update snapshot version to 2.3.8 [seatunnel]

2024-08-19 Thread via GitHub
wuchunfu opened a new pull request, #7435: URL: https://github.com/apache/seatunnel/pull/7435 ### Purpose of this pull request Update snapshot version to 2.3.8 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested?

Re: [I] [Bug] [woker] disk io full cause by Initialized new cluster connection [seatunnel]

2024-08-19 Thread via GitHub
jianchengwang commented on issue #7434: URL: https://github.com/apache/seatunnel/issues/7434#issuecomment-2297855439 I use DolphinScheduler to execute seatunnel job -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

(seatunnel) branch dev updated: [Fix] Fix oracle sample data from column error (#7340)

2024-08-19 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 2130e0d5ad [Fix] Fix oracle sample data from co

Re: [PR] [Fix] Fix oracle sample data from column error [seatunnel]

2024-08-19 Thread via GitHub
hailin0 merged PR #7340: URL: https://github.com/apache/seatunnel/pull/7340 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Feature][Connector-V2] Fake Source support produce vector data [seatunnel]

2024-08-19 Thread via GitHub
hailin0 commented on code in PR #7401: URL: https://github.com/apache/seatunnel/pull/7401#discussion_r1722612280 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/type/VectorType.java: ## @@ -30,8 +30,8 @@ public class VectorType implements SeaTunnelDataType { p

(seatunnel) branch dev updated: [Improve][Connector-V2]Support multi-table sink feature for email (#7368)

2024-08-19 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new c880b7aa4d [Improve][Connector-V2]Support multi

Re: [PR] [Improve][Connector-V2]Support multi-table sink feature for email [seatunnel]

2024-08-19 Thread via GitHub
hailin0 merged PR #7368: URL: https://github.com/apache/seatunnel/pull/7368 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated (ac87ba0bbe -> 287badd667)

2024-08-19 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from ac87ba0bbe [Improve] Update pull request template and github action guide (#7376) add 287badd667 [Fix][Seat

Re: [PR] [Improve][MySQL-CDC] Support 8.4+ versions [seatunnel]

2024-08-19 Thread via GitHub
hailin0 commented on PR #7432: URL: https://github.com/apache/seatunnel/pull/7432#issuecomment-2297849956 please add seatunnel e2e testcase for `connector-cdc-mysql`? https://github.com/apache/seatunnel/tree/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-cdc-mysql-e2e -- Th

Re: [I] [Bug][Seatunnel-core]There is a syntax error in the execution script on Windows [seatunnel]

2024-08-19 Thread via GitHub
hailin0 closed issue #7422: [Bug][Seatunnel-core]There is a syntax error in the execution script on Windows URL: https://github.com/apache/seatunnel/issues/7422 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] [Fix][Seatunnel-core]Fix syntax error in the execution script on Windows [seatunnel]

2024-08-19 Thread via GitHub
hailin0 merged PR #7423: URL: https://github.com/apache/seatunnel/pull/7423 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

[I] [Bug] [woker] disk io full cause by Initialized new cluster connection [seatunnel]

2024-08-19 Thread via GitHub
jianchengwang opened a new issue, #7434: URL: https://github.com/apache/seatunnel/issues/7434 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happ

Re: [PR] [Feature] add dockerfile [seatunnel]

2024-08-19 Thread via GitHub
liunaijie commented on code in PR #7346: URL: https://github.com/apache/seatunnel/pull/7346#discussion_r1722552542 ## .github/workflows/publish-docker.yaml: ## @@ -36,11 +37,24 @@ jobs: permissions: contents: read packages: write -timeout-minutes: 30 +

Re: [I] [Bug] [spark] The op field conflicts with the internal field of the Seatunnel Spark engine and cannot be read from the data source. [seatunnel]

2024-08-19 Thread via GitHub
lizc9 commented on issue #7392: URL: https://github.com/apache/seatunnel/issues/7392#issuecomment-2296404452 > hi , @lizc9 Previously op was a reserved field, but now it is open and you can refer to the latest dev Thanks, may I ask in which Seatunnel version this feature will be relea

Re: [I] [Bug] [spark] The op field conflicts with the internal field of the Seatunnel Spark engine and cannot be read from the data source. [seatunnel]

2024-08-19 Thread via GitHub
lizc9 commented on issue #7392: URL: https://github.com/apache/seatunnel/issues/7392#issuecomment-2296395264 > Can you provide a message data case? I'll follow up. kafka key: ``` { "id": "c-ecaae896-0bb8-3a37-a142-ef8b7e662900" } ``` kafka content: ```json {

Re: [PR] [Feature][Connector-V2] Fake Source support produce vector data [seatunnel]

2024-08-19 Thread via GitHub
corgy-w commented on code in PR #7401: URL: https://github.com/apache/seatunnel/pull/7401#discussion_r1721570110 ## seatunnel-connectors-v2/connector-milvus/src/main/java/org/apache/seatunnel/connectors/seatunnel/milvus/convert/MilvusConvertUtils.java: ## @@ -320,6 +325,13 @@ pu

Re: [PR] [Improve][Connector-V2]Support multi-table sink feature for email [seatunnel]

2024-08-19 Thread via GitHub
Hisoka-X commented on PR #7368: URL: https://github.com/apache/seatunnel/pull/7368#issuecomment-2296223306 Thanks @corgy-w ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [Feature][Connector-V2] Fake Source support produce vector data [seatunnel]

2024-08-19 Thread via GitHub
Hisoka-X commented on code in PR #7401: URL: https://github.com/apache/seatunnel/pull/7401#discussion_r1721531479 ## seatunnel-connectors-v2/connector-milvus/src/main/java/org/apache/seatunnel/connectors/seatunnel/milvus/sink/batch/MilvusBufferBatchWriter.java: ## @@ -29,7 +29,8

Re: [PR] [Fix][connector-cdc-mysql]MySqlConnectionUtils MySQL8.4 binlog相关语句变更问题 [seatunnel]

2024-08-19 Thread via GitHub
lilanlong commented on PR #7432: URL: https://github.com/apache/seatunnel/pull/7432#issuecomment-2296106267 > @lilanlong Could you please add e2e? seatunnel我做了MySQL8.4的支持,本地做了测试,但是debezium我看了源码,MySQL8.4应该还不支持。 -- This is an automated message from the Apache Git Service. To respond t

[PR] [Feature][Connector-V2] Support opengauss-cdc [seatunnel]

2024-08-19 Thread via GitHub
dailai opened a new pull request, #7433: URL: https://github.com/apache/seatunnel/pull/7433 ### Purpose of this pull request Link issue #7410 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Ch

Re: [I] [Bug] [sink elasticsearch] the savemode of sink-es conficts with es automatically creating indexes based on templates [seatunnel]

2024-08-19 Thread via GitHub
jw-itq commented on issue #7430: URL: https://github.com/apache/seatunnel/issues/7430#issuecomment-2296032481 > Hi @jw-itq , the error message is `Illegal character in path at index 17: /test_${index_key}`. it mens the index name not replace well. > > savemode function is execute befo

Re: [I] [Bug] [doris-source-connectors] [2.3.5] DorisConnectorException with datetime field in doris source [seatunnel]

2024-08-19 Thread via GitHub
liugddx commented on issue #7405: URL: https://github.com/apache/seatunnel/issues/7405#issuecomment-2296022553 Currently, doris 2.1.x has an 8-hour time difference when querying time type data. I will fix this issue after https://github.com/apache/doris/pull/38215 is fixed. -- This is an

Re: [I] [Bug] [Console] console can not suport 2.3.6 [seatunnel]

2024-08-19 Thread via GitHub
chaos-cn commented on issue #7378: URL: https://github.com/apache/seatunnel/issues/7378#issuecomment-2296012698 Seatunnel 2.3.6 JDK 1.8 我遇到过类似的问题 目前问题解决了,具体原因未深入研究 我是在lib目录下放了一个第三方的 带有完整依赖的 一个富客户端jdbc jar包,剔除后就正常了 -- This is an automated message from the Apache Git Service. To respon

Re: [I] [Bug] [doris-source-connectors] [2.3.5] DorisConnectorException with datetime field in doris source [seatunnel]

2024-08-19 Thread via GitHub
luzongzhu commented on issue #7405: URL: https://github.com/apache/seatunnel/issues/7405#issuecomment-2296006585 +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [PR] [Fix][connector-cdc-mysql]MySqlConnectionUtils MySQL8.4 binlog相关语句变更问题 [seatunnel]

2024-08-19 Thread via GitHub
wuchunfu commented on PR #7432: URL: https://github.com/apache/seatunnel/pull/7432#issuecomment-2296006435 @lilanlong Could you please add e2e? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] [Fix][connector-cdc-mysql]MySqlConnectionUtils MySQL8.4 binlog相关语句变更问题 [seatunnel]

2024-08-19 Thread via GitHub
lilanlong opened a new pull request, #7432: URL: https://github.com/apache/seatunnel/pull/7432 ### Purpose of this pull request [Fix][connector-cdc-mysql]MySqlConnectionUtils MySQL8.4 binlog相关语句变更问题 https://github.com/apache/seatunnel/issues/7416 ### Does this PR introduce _a

Re: [PR] [Fix][connector-cdc-mysql]MySqlConnectionUtils MySQL8.4 binlog相关语句变更问题 [seatunnel]

2024-08-19 Thread via GitHub
lilanlong closed pull request #7431: [Fix][connector-cdc-mysql]MySqlConnectionUtils MySQL8.4 binlog相关语句变更问题 URL: https://github.com/apache/seatunnel/pull/7431 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[PR] [Fix][connector-cdc-mysql]MySqlConnectionUtils MySQL8.4 binlog相关语句变更问题 [seatunnel]

2024-08-19 Thread via GitHub
lilanlong opened a new pull request, #7431: URL: https://github.com/apache/seatunnel/pull/7431 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

Re: [I] [Bug] [sink elasticsearch] the savemode of sink-es conficts with es automatically creating indexes based on templates [seatunnel]

2024-08-19 Thread via GitHub
liunaijie commented on issue #7430: URL: https://github.com/apache/seatunnel/issues/7430#issuecomment-2295943644 Hi @jw-itq , the error message is `Illegal character in path at index 17: /test_${index_key}`. it mens the index name not replace well. savemode function is execute before

Re: [PR] [Improve][feature] Add JobInstance Delete [seatunnel-web]

2024-08-19 Thread via GitHub
arshadmohammad commented on PR #161: URL: https://github.com/apache/seatunnel-web/pull/161#issuecomment-2295923833 @Jetiaime are you still working on this PR? can you please rebase this PR with latest code -- This is an automated message from the Apache Git Service. To respond to the mess

Re: [I] [Bug] [Seatunnel-web] Create log directory if it does not exist. [seatunnel]

2024-08-19 Thread via GitHub
Hisoka-X closed issue #7428: [Bug] [Seatunnel-web] Create log directory if it does not exist. URL: https://github.com/apache/seatunnel/issues/7428 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the