[PR] [Hotfix][Connector-V2][kafka]Kafka consumer group automatically commits offset logic error fix [seatunnel]

2024-06-07 Thread via GitHub
zhangshenghang opened a new pull request, #6961: URL: https://github.com/apache/seatunnel/pull/6961 ### Purpose of this pull request Kafka consumer group automatically commits offset logic error fix. When Kafka Source Options sets `commit_on_checkpoint` to `true`, Checkpoint is

[I] [Bug] [SQLServer CDC2 Doris] field uses the keyword [seatunnel]

2024-06-07 Thread via GitHub
trhlxc opened a new issue, #6962: URL: https://github.com/apache/seatunnel/issues/6962 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[I] [Bug] [SQLServer CDC2Doris] Data write error [seatunnel]

2024-06-07 Thread via GitHub
trhlxc opened a new issue, #6964: URL: https://github.com/apache/seatunnel/issues/6964 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[I] [Bug] [SQLServer CDC2Doris] Data write error [seatunnel]

2024-06-07 Thread via GitHub
trhlxc opened a new issue, #6963: URL: https://github.com/apache/seatunnel/issues/6963 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Feature][Transform-V2 Filter] support exclude columns in the filter transform [seatunnel]

2024-06-07 Thread via GitHub
Hisoka-X commented on PR #6960: URL: https://github.com/apache/seatunnel/pull/6960#issuecomment-2154718068 cc @hailin0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] [Feature][Transform-V2 Filter] support exclude columns in the filter transform [seatunnel]

2024-06-07 Thread via GitHub
Hisoka-X commented on code in PR #6960: URL: https://github.com/apache/seatunnel/pull/6960#discussion_r1631122440 ## seatunnel-transforms-v2/src/main/java/org/apache/seatunnel/transform/filter/FilterFieldTransform.java: ## @@ -35,20 +35,25 @@ import lombok.extern.slf4j.Slf4j;

Re: [PR] [Improve][Paimon] Add check for the base type between source and sink before write. [seatunnel]

2024-06-07 Thread via GitHub
Hisoka-X commented on code in PR #6953: URL: https://github.com/apache/seatunnel/pull/6953#discussion_r1631142981 ## seatunnel-connectors-v2/connector-paimon/src/main/java/org/apache/seatunnel/connectors/seatunnel/paimon/utils/RowConverter.java: ## @@ -462,4 +470,24 @@ public st

Re: [PR] [Improve][Connector-V2] Improve the paimon source [seatunnel]

2024-06-07 Thread via GitHub
Hisoka-X commented on PR #6887: URL: https://github.com/apache/seatunnel/pull/6887#issuecomment-2154766402 Could you take a look? @zhilinli123 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [Improve] Make ClickhouseFileSinker support tables containing materialized columns [seatunnel]

2024-06-07 Thread via GitHub
ddna1021 commented on PR #6956: URL: https://github.com/apache/seatunnel/pull/6956#issuecomment-2154786219 > LGTM. However, according to the community principles, can you provide a screenshot of the successful operation after the change? Of course, this is necessary, but my company ha

Re: [PR] [Feature][Transform-V2 Filter] support exclude columns in the filter transform [seatunnel]

2024-06-07 Thread via GitHub
hailin0 commented on code in PR #6960: URL: https://github.com/apache/seatunnel/pull/6960#discussion_r1631165462 ## docs/en/transform-v2/filter.md: ## @@ -43,6 +48,21 @@ transform { } ``` +Or we can delete the field named `age` by adding a `Filter` Transform with the mode f

Re: [PR] [Hotfix][Connector-V2][kafka]Kafka consumer group automatically commits offset logic error fix [seatunnel]

2024-06-07 Thread via GitHub
hailin0 merged PR #6961: URL: https://github.com/apache/seatunnel/pull/6961 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Hotfix][Connector-V2][kafka]Kafka consumer group automatically commits offset logic error fix (#6961)

2024-06-07 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 181f01ee52 [Hotfix][Connector-V2][kafka]Kafka c

Re: [PR] [Improve] Make ClickhouseFileSinker support tables containing materialized columns [seatunnel]

2024-06-07 Thread via GitHub
hailin0 merged PR #6956: URL: https://github.com/apache/seatunnel/pull/6956 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Improve] Make ClickhouseFileSinker support tables containing materialized columns (#6956)

2024-06-07 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 87c6adcc2e [Improve] Make ClickhouseFileSinker

Re: [PR] [Improve][Zeta] Move SaveMode behavior to master [seatunnel]

2024-06-07 Thread via GitHub
hailin0 commented on code in PR #6843: URL: https://github.com/apache/seatunnel/pull/6843#discussion_r1631288971 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/sink/SaveModeExecuteLocation.java: ## @@ -0,0 +1,23 @@ +/* + * Licensed to the Apache Software Foundation (ASF

Re: [PR] [Improve][Zeta] Move SaveMode behavior to master [seatunnel]

2024-06-07 Thread via GitHub
hailin0 commented on code in PR #6843: URL: https://github.com/apache/seatunnel/pull/6843#discussion_r1631316446 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/master/JobMaster.java: ## @@ -333,6 +361,30 @@ public void run() {

Re: [I] [Bug] [OSS Checkpoint] OSS checkpoint not working [seatunnel]

2024-06-07 Thread via GitHub
github-actions[bot] commented on issue #6779: URL: https://github.com/apache/seatunnel/issues/6779#issuecomment-2155721411 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][Catalog] Catalog API Upgrade Feature [seatunnel]

2024-06-07 Thread via GitHub
github-actions[bot] commented on issue #6774: URL: https://github.com/apache/seatunnel/issues/6774#issuecomment-2155721431 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Feature][Connector-V2] Dependency conflicts exist in connector-cdc-sqlserver and connector-maxcompute. [seatunnel]

2024-06-07 Thread via GitHub
github-actions[bot] commented on issue #6772: URL: https://github.com/apache/seatunnel/issues/6772#issuecomment-2155721437 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][Catalog] Catalog API Upgrade Feature [seatunnel]

2024-06-07 Thread via GitHub
github-actions[bot] closed issue #6774: [Feature][Catalog] Catalog API Upgrade Feature URL: https://github.com/apache/seatunnel/issues/6774 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif