Re: [PR] [Hotfix][Zeta] Fix taskgroup failed log lost [seatunnel]

2024-07-22 Thread via GitHub
EricJoy2048 commented on code in PR #7241: URL: https://github.com/apache/seatunnel/pull/7241#discussion_r1686061964 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/dag/physical/PhysicalVertex.java: ## @@ -485,6 +485,8 @@ private void

[PR] [bug][paimon-connector] The isNullable attribute is true when the primary key field in the Paimon table converts the Column object. [seatunnel]

2024-07-22 Thread via GitHub
hawk9821 opened a new pull request, #7242: URL: https://github.com/apache/seatunnel/pull/7242 …imon table converts the Column object. #7231 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this p

Re: [I] [Feature][Prometheus] Support Prometheus connector source/sink [seatunnel]

2024-07-22 Thread via GitHub
CosmosNi commented on issue #7201: URL: https://github.com/apache/seatunnel/issues/7201#issuecomment-2242259275 hi,@hailin0 ,I am confused whether to put this module under the http module or to build a separate module.can you give me a good suggestion.I plan to use http base to achieve.

Re: [PR] [Hotfix][E2E] Fix zeta e2e error [seatunnel]

2024-07-22 Thread via GitHub
HESMINEWITCH commented on PR #7074: URL: https://github.com/apache/seatunnel/pull/7074#issuecomment-2242261539 Can someone with pure intentions help True (A) I 2.0 please. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [PR] [bug][paimon-connector] The isNullable attribute is true when the primary key field in the Paimon table converts the Column object. [seatunnel]

2024-07-22 Thread via GitHub
Hisoka-X commented on PR #7242: URL: https://github.com/apache/seatunnel/pull/7242#issuecomment-2242306431 cc @dailai and @TaoZex as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [PR] [Feature][Zeta engine] Added the metrics information of table statistics in multi-table mode [seatunnel]

2024-07-22 Thread via GitHub
Hisoka-X commented on code in PR #7212: URL: https://github.com/apache/seatunnel/pull/7212#discussion_r1686116520 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/task/SeaTunnelSourceCollector.java: ## @@ -77,17 +88,26 @@ public SeaTun

Re: [PR] [bug][paimon-connector] The isNullable attribute is true when the primary key field in the Paimon table converts the Column object. [seatunnel]

2024-07-22 Thread via GitHub
dailai commented on PR #7242: URL: https://github.com/apache/seatunnel/pull/7242#issuecomment-2242332524 Please change the title of this pr named "[Improve][Connector-V2] Add the nullable attribute of the field for paimon" -- This is an automated message from the Apache Git Service. To re

Re: [I] [Feature][Connector-V2] Support multi-table sink feature [seatunnel]

2024-07-22 Thread via GitHub
skyoct commented on issue #5652: URL: https://github.com/apache/seatunnel/issues/5652#issuecomment-2242346236 @Hisoka-X I would like to try DingTalk -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

(seatunnel) branch dev updated: The isNullable attribute is true when the primary key field in the Paimon table converts the Column object. #7231 (#7242)

2024-07-22 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new b0fe432e99 The isNullable attribute is true whe

Re: [PR] [Improve][Connector-V2] Add the nullable attribute of the field for paimon [seatunnel]

2024-07-22 Thread via GitHub
hailin0 merged PR #7242: URL: https://github.com/apache/seatunnel/pull/7242 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [I] [Bug] [Paimon] The isNullable attribute is true when the primary key field in the Paimon table converts the Column object. [seatunnel]

2024-07-22 Thread via GitHub
hailin0 closed issue #7231: [Bug] [Paimon] The isNullable attribute is true when the primary key field in the Paimon table converts the Column object. URL: https://github.com/apache/seatunnel/issues/7231 -- This is an automated message from the Apache Git Service. To respond to the message, p

[PR] [Improve][Core] Move MultiTableSink to seatunnel-api module [seatunnel]

2024-07-22 Thread via GitHub
Hisoka-X opened a new pull request, #7243: URL: https://github.com/apache/seatunnel/pull/7243 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list * [

Re: [I] [Bug] [Sink Clickhouse] Cannot set null to non-nullable column [seatunnel]

2024-07-22 Thread via GitHub
shinnieJames commented on issue #5569: URL: https://github.com/apache/seatunnel/issues/5569#issuecomment-2242604657 use sql transform set default value for non-nullable column -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [PR] [Hotfix][Zeta] Fix taskgroup failed log lost [seatunnel]

2024-07-22 Thread via GitHub
EricJoy2048 commented on code in PR #7241: URL: https://github.com/apache/seatunnel/pull/7241#discussion_r1686421409 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/dag/physical/PhysicalVertex.java: ## @@ -485,6 +485,8 @@ private void

[I] [Feature][Connector-V2][Iceberg] Support Iceberg Kerberos [seatunnel]

2024-07-22 Thread via GitHub
luzongzhu opened a new issue, #7244: URL: https://github.com/apache/seatunnel/issues/7244 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

[PR] [Feature][Connector-V2][Iceberg] Support Iceberg Kerberos [seatunnel]

2024-07-22 Thread via GitHub
luzongzhu opened a new pull request, #7245: URL: https://github.com/apache/seatunnel/pull/7245 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list *

Re: [I] [Feature][Connector-V2][Iceberg] Support Iceberg Kerberos [seatunnel]

2024-07-22 Thread via GitHub
luzongzhu closed issue #7244: [Feature][Connector-V2][Iceberg] Support Iceberg Kerberos URL: https://github.com/apache/seatunnel/issues/7244 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] [Feature][Connector-V2][Iceberg] Support Iceberg Kerberos [seatunnel]

2024-07-22 Thread via GitHub
luzongzhu commented on issue #7244: URL: https://github.com/apache/seatunnel/issues/7244#issuecomment-2242858282 [Feature][Connector-V2][Iceberg] Support Iceberg Kerberos [#7245](https://github.com/apache/seatunnel/pull/7245) -- This is an automated message from the Apache Git Service

[PR] [Feature][Connector-V2][Iceberg] Support Iceberg Kerberos [seatunnel]

2024-07-22 Thread via GitHub
luzongzhu opened a new pull request, #7246: URL: https://github.com/apache/seatunnel/pull/7246 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list *

Re: [PR] [Feature][Connector-V2][Iceberg] Support Iceberg Kerberos [seatunnel]

2024-07-22 Thread via GitHub
luzongzhu closed pull request #7245: [Feature][Connector-V2][Iceberg] Support Iceberg Kerberos URL: https://github.com/apache/seatunnel/pull/7245 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] [Feature][Memcached] Support Memcached connector source/sink [seatunnel]

2024-07-22 Thread via GitHub
asapekia commented on issue #7200: URL: https://github.com/apache/seatunnel/issues/7200#issuecomment-2242926581 Hi @hailin0 , Yes i was doing the local setup for this project. Will try to close this by coming weekend. Is it okay? -- This is an automated message from the Apache Git Service

Re: [PR] [Improve][CI] Fix the problem of OutOfMemoryError when the test case [seatunnel]

2024-07-22 Thread via GitHub
liugddx closed pull request #7222: [Improve][CI] Fix the problem of OutOfMemoryError when the test case URL: https://github.com/apache/seatunnel/pull/7222 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [I] [Feature][Prometheus] Support Prometheus connector source/sink [seatunnel]

2024-07-22 Thread via GitHub
hailin0 commented on issue #7201: URL: https://github.com/apache/seatunnel/issues/7201#issuecomment-2243129050 > hi,@hailin0 ,I am confused whether to put this module under the http module or to build a separate module.can you give me a good suggestion.I plan to use http base to achieve.

Re: [PR] [Feature][Connector-V2] Support multi-table sink feature for HBase [seatunnel]

2024-07-22 Thread via GitHub
hailin0 commented on PR #7169: URL: https://github.com/apache/seatunnel/pull/7169#issuecomment-2243149512 @BruceWong96 I found a duplicate PR, here https://github.com/apache/seatunnel/pull/6969/ -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [Feature][Connector Hive] support hive savemode [seatunnel]

2024-07-22 Thread via GitHub
hailin0 commented on PR #6842: URL: https://github.com/apache/seatunnel/pull/6842#issuecomment-2243163077 > waitting for this pr merged #7131 @liunaijie this pr is merged -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] [Feature][Connector Hive] support hive savemode [seatunnel]

2024-07-22 Thread via GitHub
hailin0 commented on code in PR #6842: URL: https://github.com/apache/seatunnel/pull/6842#discussion_r1686697627 ## docs/zh/connector-v2/sink/Hive.md: ## @@ -0,0 +1,522 @@ +# Hive + +> Hive 数据接收器 + +## 支持的版本 + +已经验证的版本 : +- 2.3.9 +- 3.1.1 + +# 使用依赖 + +当你使用Spark/Flink时, 你需要保证已经与H

Re: [PR] [Feature][Connector Hive] support hive savemode [seatunnel]

2024-07-22 Thread via GitHub
hailin0 commented on code in PR #6842: URL: https://github.com/apache/seatunnel/pull/6842#discussion_r1686697627 ## docs/zh/connector-v2/sink/Hive.md: ## @@ -0,0 +1,522 @@ +# Hive + +> Hive 数据接收器 + +## 支持的版本 + +已经验证的版本 : +- 2.3.9 +- 3.1.1 + +# 使用依赖 + +当你使用Spark/Flink时, 你需要保证已经与H

Re: [PR] [Feature][Connector-V2] [Hudi]Add hudi sink connector [seatunnel]

2024-07-22 Thread via GitHub
dengc367 commented on code in PR #4405: URL: https://github.com/apache/seatunnel/pull/4405#discussion_r1686855749 ## seatunnel-connectors-v2/connector-hudi/src/main/java/org/apache/seatunnel/connectors/seatunnel/hudi/source/HudiSource.java: ## @@ -1,164 +0,0 @@ -/* Review Comme

Re: [I] [Bug] [Redis Sink] cluster mode has some issue [seatunnel]

2024-07-22 Thread via GitHub
github-actions[bot] closed issue #6984: [Bug] [Redis Sink] cluster mode has some issue URL: https://github.com/apache/seatunnel/issues/6984 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [I] The cluster has 4 machines, but the job only has one master server and one slave server to process jobs. What is the reason [seatunnel]

2024-07-22 Thread via GitHub
github-actions[bot] closed issue #6979: The cluster has 4 machines, but the job only has one master server and one slave server to process jobs. What is the reason URL: https://github.com/apache/seatunnel/issues/6979 -- This is an automated message from the Apache Git Service. To respond to

Re: [I] The cluster has 4 machines, but the job only has one master server and one slave server to process jobs. What is the reason [seatunnel]

2024-07-22 Thread via GitHub
github-actions[bot] commented on issue #6979: URL: https://github.com/apache/seatunnel/issues/6979#issuecomment-2244033861 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] [Redis Sink] cluster mode has some issue [seatunnel]

2024-07-22 Thread via GitHub
github-actions[bot] commented on issue #6984: URL: https://github.com/apache/seatunnel/issues/6984#issuecomment-2244033843 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

[PR] [improve] Handle user privacy when submitting a task print configuration logs [seatunnel]

2024-07-22 Thread via GitHub
hawk9821 opened a new pull request, #7247: URL: https://github.com/apache/seatunnel/pull/7247 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list * [

Re: [PR] [Feature][Zeta engine] Added the metrics information of table statistics in multi-table mode [seatunnel]

2024-07-22 Thread via GitHub
hawk9821 commented on code in PR #7212: URL: https://github.com/apache/seatunnel/pull/7212#discussion_r1687278788 ## .github/workflows/backend.yml: ## @@ -313,7 +313,7 @@ jobs: - name: run updated modules integration test (part-1) if: needs.changes.outputs.api ==

(seatunnel) branch dev updated: [Hotfix][Zeta] Fix taskgroup failed log lost (#7241)

2024-07-22 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new fe0c477b74 [Hotfix][Zeta] Fix taskgroup failed log

Re: [PR] [Hotfix][Zeta] Fix taskgroup failed log lost [seatunnel]

2024-07-22 Thread via GitHub
Hisoka-X merged PR #7241: URL: https://github.com/apache/seatunnel/pull/7241 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [I] [Bug] [Zeta] TaskGroup Failed MSG lost when job restore time more than one [seatunnel]

2024-07-22 Thread via GitHub
Hisoka-X closed issue #7239: [Bug] [Zeta] TaskGroup Failed MSG lost when job restore time more than one URL: https://github.com/apache/seatunnel/issues/7239 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [Feature][Zeta engine] Added the metrics information of table statistics in multi-table mode [seatunnel]

2024-07-22 Thread via GitHub
hawk9821 commented on code in PR #7212: URL: https://github.com/apache/seatunnel/pull/7212#discussion_r1687297882 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/task/SeaTunnelSourceCollector.java: ## @@ -77,17 +88,26 @@ public SeaTun

Re: [PR] [Feature][Connector-V2] Support multi-table sink feature for HBase [seatunnel]

2024-07-22 Thread via GitHub
BruceWong96 commented on PR #7169: URL: https://github.com/apache/seatunnel/pull/7169#issuecomment-2244130804 > @BruceWong96 I found a duplicate PR, here #6969, This is the correct way to code, you can use it as a reference for learning > > @TaoZex @BruceWong96 Are you willing to coll

Re: [PR] [Feature][Connector-V2] Support multi-table sink feature for HBase [seatunnel]

2024-07-22 Thread via GitHub
TaoZex commented on PR #7169: URL: https://github.com/apache/seatunnel/pull/7169#issuecomment-2244157116 > > @BruceWong96 I found a duplicate PR, here #6969, This is the correct way to code, you can use it as a reference for learning > > @TaoZex @BruceWong96 Are you willing to collaborate

Re: [PR] [Hbase] Support Hbase multi-table sink [seatunnel]

2024-07-22 Thread via GitHub
TaoZex closed pull request #6969: [Hbase] Support Hbase multi-table sink URL: https://github.com/apache/seatunnel/pull/6969 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [I] [Bug] [CDC] mysql cdc to paimon [seatunnel]

2024-07-22 Thread via GitHub
LoseYSelf commented on issue #7208: URL: https://github.com/apache/seatunnel/issues/7208#issuecomment-2244190155 In newest seatunnel branch,paimon version is 0.7.0-incubating,but PrimaryKeyFileStoreTable is not a public class -- This is an automated message from the Apache Git Service. To

[PR] [Improve][Connector-v2] Optimize the select count for jdbc-oracle and oracle-cdc [seatunnel]

2024-07-22 Thread via GitHub
dailai opened a new pull request, #7248: URL: https://github.com/apache/seatunnel/pull/7248 ### Purpose of this pull request Add select count rather then analysis table which is used to get the total rows of the table for the jdbc-oracle in chunk split stage and oracle-cdc in

[I] [Feature][Hudi Sink] Hudi sink supports catalog and typeconverter features. [seatunnel]

2024-07-22 Thread via GitHub
liugddx opened a new issue, #7249: URL: https://github.com/apache/seatunnel/issues/7249 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

Re: [PR] [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc [seatunnel]

2024-07-22 Thread via GitHub
Carl-Zhou-CN commented on PR #7248: URL: https://github.com/apache/seatunnel/pull/7248#issuecomment-2244337206 good job -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] [Improve][Core] Move MultiTableSink to seatunnel-api module [seatunnel]

2024-07-22 Thread via GitHub
Carl-Zhou-CN merged PR #7243: URL: https://github.com/apache/seatunnel/pull/7243 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@sea

(seatunnel) branch dev updated: [Improve][Core] Move MultiTableSink to seatunnel-api module (#7243)

2024-07-22 Thread zhouyao2023
This is an automated email from the ASF dual-hosted git repository. zhouyao2023 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new cc5949988b [Improve][Core] Move MultiTableSink