[PR] Fix the NullPointerException that occurs when I use checkpoints for task recovery [seatunnel]

2024-06-12 Thread via GitHub
weipengfei-sj opened a new pull request, #6974: URL: https://github.com/apache/seatunnel/pull/6974 Fix the NullPointerException that occurs when I use checkpoints for task recovery #6898 ### Purpose of this pull request ### Does this PR introduce _any_ user-

Re: [PR] [Improve][File-Connector] Support write fixed/timestamp as int96 of parquet [seatunnel]

2024-06-12 Thread via GitHub
hailin0 commented on PR #6971: URL: https://github.com/apache/seatunnel/pull/6971#issuecomment-2162321726 cc @Hisoka-X @TyrantLucifer @wuchunfu ci is passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [I] [Bug] Run SeaTunnel on spark-operator failed [seatunnel]

2024-06-12 Thread via GitHub
zhang5059T commented on issue #6970: URL: https://github.com/apache/seatunnel/issues/6970#issuecomment-2162561089 The problem has been found. It is caused by my own unfamiliarity with the CR of the spark-operator, resulting in the jar not being passed to the spark cluster. This problem can

Re: [I] [Bug] Run SeaTunnel on spark-operator failed [seatunnel]

2024-06-12 Thread via GitHub
zhang5059T closed issue #6970: [Bug] Run SeaTunnel on spark-operator failed URL: https://github.com/apache/seatunnel/issues/6970 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[PR] [Improve] refactor clickhouse connector, using Factory to create source/sink [seatunnel]

2024-06-12 Thread via GitHub
liunaijie opened a new pull request, #6975: URL: https://github.com/apache/seatunnel/pull/6975 ### Purpose of this pull request refactor clickhouse connector, using Factory to create source/sink ### Does this PR introduce _any_ user-facing change? no

Re: [PR] [Improve][Connector-V2] Support schema evolution for mysql-cdc and mysql-jdbc [seatunnel]

2024-06-12 Thread via GitHub
hailin0 commented on code in PR #6929: URL: https://github.com/apache/seatunnel/pull/6929#discussion_r1636215575 ## seatunnel-connectors-v2/connector-cdc/connector-cdc-base/src/main/java/org/apache/seatunnel/connectors/cdc/base/schema/AbstractSchemaChangeResolver.java: ## @@ -0,

[PR] [Hotfix][Zeta]Fix Metrics lost data bug [seatunnel]

2024-06-12 Thread via GitHub
EricJoy2048 opened a new pull request, #6976: URL: https://github.com/apache/seatunnel/pull/6976 ### Purpose of this pull request Fix the bug where metrics data will be lost in the case of SavePoint. ### Does this PR introduce _any_ user-facing change?

Re: [PR] Fix the NullPointerException that occurs when I use checkpoints for task recovery [seatunnel]

2024-06-12 Thread via GitHub
Hisoka-X commented on PR #6974: URL: https://github.com/apache/seatunnel/pull/6974#issuecomment-2162887450 Could you add a test case for this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [Paimon]support projection for paimon source [seatunnel]

2024-06-12 Thread via GitHub
hailin0 commented on PR #6343: URL: https://github.com/apache/seatunnel/pull/6343#issuecomment-2163309106 this pr https://github.com/apache/seatunnel/pull/6887 is merged @TaoZex -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [PR] [Connector]Add druid sink connector [seatunnel]

2024-06-12 Thread via GitHub
hailin0 commented on PR #6346: URL: https://github.com/apache/seatunnel/pull/6346#issuecomment-2163311748 > > @TaoZex why close this pr > > [apache/druid#16501](https://github.com/apache/druid/issues/16501) There is a bug in Druid's official docker. After I fix this bug for druid, I w

Re: [I] 增加atlas hook监听插件 [seatunnel]

2024-06-12 Thread via GitHub
github-actions[bot] commented on issue #6845: URL: https://github.com/apache/seatunnel/issues/6845#issuecomment-2164133415 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] When extracting hive data to mysql, the parallelism parameter setting is invalid. [seatunnel]

2024-06-12 Thread via GitHub
github-actions[bot] commented on issue #6830: URL: https://github.com/apache/seatunnel/issues/6830#issuecomment-2164133432 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [Connector-JDBC] Table structure synchronization [seatunnel]

2024-06-12 Thread via GitHub
github-actions[bot] closed issue #6799: [Bug] [Connector-JDBC] Table structure synchronization URL: https://github.com/apache/seatunnel/issues/6799 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [I] [Bug] [Connector-JDBC] Table structure synchronization [seatunnel]

2024-06-12 Thread via GitHub
github-actions[bot] commented on issue #6799: URL: https://github.com/apache/seatunnel/issues/6799#issuecomment-2164133476 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] Why email not have corresponding e2e test [seatunnel]

2024-06-12 Thread via GitHub
github-actions[bot] closed issue #6798: Why email not have corresponding e2e test URL: https://github.com/apache/seatunnel/issues/6798 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [I] Why email not have corresponding e2e test [seatunnel]

2024-06-12 Thread via GitHub
github-actions[bot] commented on issue #6798: URL: https://github.com/apache/seatunnel/issues/6798#issuecomment-2164133492 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] When extracting hive data to mysql, the parallelism parameter setting is invalid. [seatunnel]

2024-06-12 Thread via GitHub
luckyliush closed issue #6830: When extracting hive data to mysql, the parallelism parameter setting is invalid. URL: https://github.com/apache/seatunnel/issues/6830 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [Improve][File-Connector] Support write fixed/timestamp as int96 of parquet [seatunnel]

2024-06-12 Thread via GitHub
EricJoy2048 merged PR #6971: URL: https://github.com/apache/seatunnel/pull/6971 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seat

[PR] [Hotfix][Seatunnel-engine] Fix the close task exception during Full incremental switching [seatunnel]

2024-06-12 Thread via GitHub
dailai opened a new pull request, #6977: URL: https://github.com/apache/seatunnel/pull/6977 ### Purpose of this pull request Fix the close task exception during Full incremental switching. ### Does this PR introduce _any_ user-facing change? ### Ho

[I] [Feature][Connector-v2] Paimon connector support S3 filesystem [seatunnel]

2024-06-12 Thread via GitHub
MirrerZu opened a new issue, #6978: URL: https://github.com/apache/seatunnel/issues/6978 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] [Bug] [Connector-V2-Paimon] Data changes are lost when sinking into Paimon using batch mode. [seatunnel]

2024-06-12 Thread via GitHub
MirrerZu closed issue #6831: [Bug] [Connector-V2-Paimon] Data changes are lost when sinking into Paimon using batch mode. URL: https://github.com/apache/seatunnel/issues/6831 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [PR] [Hotfix][Seatunnel-engine] Fix the close task exception during Full incremental switching [seatunnel]

2024-06-12 Thread via GitHub
dailai commented on PR #6977: URL: https://github.com/apache/seatunnel/pull/6977#issuecomment-2164262813 When I used this pr to test the schema change using multi-parallel degree tasks, I found that the schema change during the full incremental switch of cdc tasks would result in the follow

Re: [PR] [Hotfix][Seatunnel-engine] Fix the close task exception during Full incremental switching [seatunnel]

2024-06-12 Thread via GitHub
dailai commented on PR #6977: URL: https://github.com/apache/seatunnel/pull/6977#issuecomment-2164265664 After the modification, the tests are normal for many times. You can also see the effect in logs. ![截屏2024-06-13 11 00 21](https://github.com/apache/seatunnel/assets/18141150/e924

Re: [PR] [Hotfix][Zeta]Fix Metrics lost data bug [seatunnel]

2024-06-12 Thread via GitHub
hailin0 merged PR #6976: URL: https://github.com/apache/seatunnel/pull/6976 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: Fix Metrics lost data bug (#6976)

2024-06-12 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 09a15adb0a Fix Metrics lost data bug (#6976) 09

Re: [PR] [Improve][File Connector]Improve xml read code & fix can not use true for a boolean option [seatunnel]

2024-06-12 Thread via GitHub
EricJoy2048 commented on PR #6930: URL: https://github.com/apache/seatunnel/pull/6930#issuecomment-2164269908 > Please add test case. done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] [Feature][Transform-V2 Filter] support exclude columns in the filter transform [seatunnel]

2024-06-12 Thread via GitHub
hailin0 commented on code in PR #6960: URL: https://github.com/apache/seatunnel/pull/6960#discussion_r1637438341 ## docs/zh/transform-v2/filter.md: ## @@ -31,14 +38,26 @@ | Kin Dom | 20 | 123 | | Joy Dom | 20 | 123 | -我们想要删除字段 `age`,我们可以像这样添加 `Filter` 转换 +我们想要删除字段 `age

(seatunnel-web) 01/02: [maven-release-plugin] prepare release 1.0.1

2024-06-12 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch 1.0.1-release in repository https://gitbox.apache.org/repos/asf/seatunnel-web.git commit 5fadf90344a6bf73b2e9355ed1cfad9400638e94 Author: Jia Fan AuthorDate: Thu Jun 13 11:05:17 2024 +0800 [

(seatunnel-web) branch 1.0.1-release created (now ee20a017)

2024-06-12 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a change to branch 1.0.1-release in repository https://gitbox.apache.org/repos/asf/seatunnel-web.git at ee20a017 [maven-release-plugin] prepare for next development iteration This branch includes the followi

(seatunnel-web) 02/02: [maven-release-plugin] prepare for next development iteration

2024-06-12 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch 1.0.1-release in repository https://gitbox.apache.org/repos/asf/seatunnel-web.git commit ee20a017f97e0973a65da250315325f8b0d7f635 Author: Jia Fan AuthorDate: Thu Jun 13 11:05:17 2024 +0800 [

(seatunnel-web) annotated tag 1.0.1 updated (5fadf903 -> 7bd02fe0)

2024-06-12 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a change to annotated tag 1.0.1 in repository https://gitbox.apache.org/repos/asf/seatunnel-web.git *** WARNING: tag 1.0.1 was modified! *** from 5fadf903 (commit) to 7bd02fe0 (tag) tagging 5fadf90344a6

Re: [PR] [Improve][File Connector]Improve xml read code & fix can not use true for a boolean option [seatunnel]

2024-06-12 Thread via GitHub
EricJoy2048 commented on PR #6930: URL: https://github.com/apache/seatunnel/pull/6930#issuecomment-2164287781 > @EricJoy2048 Please add description https://private-user-images.githubusercontent.com/14371345/335615766-0292dd1a-face-4773-8257-2270593c6834.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6Ikp

Re: [PR] [Improve][Zeta] Move SaveMode behavior to master [seatunnel]

2024-06-12 Thread via GitHub
EricJoy2048 merged PR #6843: URL: https://github.com/apache/seatunnel/pull/6843 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seat

(seatunnel) branch dev updated: [Improve][Zeta] Move SaveMode behavior to master (#6843)

2024-06-12 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 80cf91318d [Improve][Zeta] Move SaveMode behavi

Re: [PR] [bugfix][connector-mongodb] fix mongodb null value write [seatunnel]

2024-06-12 Thread via GitHub
Hisoka-X merged PR #6967: URL: https://github.com/apache/seatunnel/pull/6967 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

(seatunnel) branch dev updated: [bugfix][connector-mongodb] fix mongodb null value write (#6967)

2024-06-12 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new c5ecda50f8 [bugfix][connector-mongodb] fix mongodb

Re: [PR] [Hotfix][Seatunnel-engine] Fix the close task exception during Full incremental switching [seatunnel]

2024-06-12 Thread via GitHub
hailin0 commented on PR #6977: URL: https://github.com/apache/seatunnel/pull/6977#issuecomment-2164410774 The PR that caused this issue https://github.com/apache/seatunnel/pull/6389/files https://github.com/apache/seatunnel/assets/14371345/a5f5da76-0138-4d3c-86fe-8b514995ca9f";>

Re: [PR] [Hotfix][Seatunnel-engine] Fix the close task exception during Full incremental switching [seatunnel]

2024-06-12 Thread via GitHub
hailin0 commented on code in PR #6977: URL: https://github.com/apache/seatunnel/pull/6977#discussion_r1637585517 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/task/flow/SourceFlowLifeCycle.java: ## @@ -310,6 +310,13 @@ public void t

Re: [PR] [Hotfix][Seatunnel-engine] Fix the close task exception during Full incremental switching [seatunnel]

2024-06-12 Thread via GitHub
dailai commented on code in PR #6977: URL: https://github.com/apache/seatunnel/pull/6977#discussion_r1637588091 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/task/flow/SourceFlowLifeCycle.java: ## @@ -310,6 +310,13 @@ public void tr

Re: [PR] [Hotfix][Seatunnel-engine] Fix the close task exception during Full incremental switching [seatunnel]

2024-06-12 Thread via GitHub
hailin0 commented on code in PR #6977: URL: https://github.com/apache/seatunnel/pull/6977#discussion_r1637589366 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/task/flow/SourceFlowLifeCycle.java: ## @@ -311,10 +311,10 @@ public void

Re: [PR] [Improve][Connector-V2] Support schema evolution for mysql-cdc and mysql-jdbc [seatunnel]

2024-06-12 Thread via GitHub
dailai commented on code in PR #6929: URL: https://github.com/apache/seatunnel/pull/6929#discussion_r1637596682 ## seatunnel-connectors-v2/connector-cdc/connector-cdc-base/src/main/java/org/apache/seatunnel/connectors/cdc/base/schema/AbstractSchemaChangeResolver.java: ## @@ -0,0

Re: [PR] [Improve] refactor clickhouse connector, using Factory to create source/sink [seatunnel]

2024-06-12 Thread via GitHub
EricJoy2048 commented on code in PR #6975: URL: https://github.com/apache/seatunnel/pull/6975#discussion_r1637599917 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/sink/file/ClickhouseFileSinkFactory.java: ## @@

Re: [PR] [Hotfix][Zeta] Fix job crash when schema changing on multiple parallel readers [seatunnel]

2024-06-12 Thread via GitHub
hailin0 merged PR #6977: URL: https://github.com/apache/seatunnel/pull/6977 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated (c5ecda50f8 -> 1f331451da)

2024-06-12 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from c5ecda50f8 [bugfix][connector-mongodb] fix mongodb null value write (#6967) add 1f331451da [Hotfix][Zeta] Fi

svn commit: r69692 - /dev/seatunnel/seatunnel-web/1.0.1/

2024-06-12 Thread fanjia
Author: fanjia Date: Thu Jun 13 06:40:01 2024 New Revision: 69692 Log: release seatunnel web 1.0.1 Added: dev/seatunnel/seatunnel-web/1.0.1/ dev/seatunnel/seatunnel-web/1.0.1/apache-seatunnel-web-1.0.1-bin.tar.gz (with props) dev/seatunnel/seatunnel-web/1.0.1/apache-seatunnel-web-1

Re: [PR] [Improve] refactor clickhouse connector, using Factory to create source/sink [seatunnel]

2024-06-12 Thread via GitHub
Carl-Zhou-CN commented on code in PR #6975: URL: https://github.com/apache/seatunnel/pull/6975#discussion_r1637649181 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/source/ClickhouseSourceFactory.java: ## @@ -37

Re: [PR] [Improve] refactor clickhouse connector, using Factory to create source/sink [seatunnel]

2024-06-12 Thread via GitHub
Carl-Zhou-CN commented on code in PR #6975: URL: https://github.com/apache/seatunnel/pull/6975#discussion_r1637649181 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/source/ClickhouseSourceFactory.java: ## @@ -37

Re: [PR] [Improve] refactor clickhouse connector, using Factory to create source/sink [seatunnel]

2024-06-12 Thread via GitHub
Carl-Zhou-CN commented on code in PR #6975: URL: https://github.com/apache/seatunnel/pull/6975#discussion_r1637657380 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/source/ClickhouseSourceFactory.java: ## @@ -37

Re: [PR] [Improve] refactor clickhouse connector, using Factory to create source/sink [seatunnel]

2024-06-12 Thread via GitHub
Carl-Zhou-CN commented on PR #6975: URL: https://github.com/apache/seatunnel/pull/6975#issuecomment-2164708143 Close when this pr merges https://github.com/apache/seatunnel/pull/6416 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G