[seatunnel] branch dev updated (9fb5499295 -> 7f75a8eafd)

2023-10-24 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 9fb5499295 [Bugfix][Connector-v2] fix file sink `isPartitionFieldWriteInFile` occurred exception when no columns are

Re: [PR] [Feature] [Connector-V2] Add connector amazonsqs [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X merged PR #5367: URL: https://github.com/apache/seatunnel/pull/5367 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [I] [Bug] [Rest-API] submit job api has some issue [seatunnel]

2023-10-24 Thread via GitHub
QiuZiXian commented on issue #5699: URL: https://github.com/apache/seatunnel/issues/5699#issuecomment-1778613857 #5691 has been fixed? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [I] [Bug] [Rest-API] submit job api has some issue [seatunnel]

2023-10-24 Thread via GitHub
QiuZiXian commented on issue #5699: URL: https://github.com/apache/seatunnel/issues/5699#issuecomment-1778611141 see #5691 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [bugfix][FileBase]update optimize hive add kerberos auth [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on code in PR #5372: URL: https://github.com/apache/seatunnel/pull/5372#discussion_r1371204988 ## seatunnel-connectors-v2/connector-hive/src/main/java/org/apache/seatunnel/connectors/seatunnel/hive/utils/HiveMetaStoreProxy.java: ## @@ -53,7 +55,22 @@ private Hi

Re: [PR] [Improve] Added Table of Contents and FAQs to README [seatunnel]

2023-10-24 Thread via GitHub
adarsh-jha-dev commented on PR #5693: URL: https://github.com/apache/seatunnel/pull/5693#issuecomment-1778579815 > rebase on dev so you can resolve conflict. (Or merge from dev). Done. -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] [Feature][formats][ogg] Support read ogg format message #4201 [seatunnel]

2023-10-24 Thread via GitHub
zhilinli123 commented on PR #4225: URL: https://github.com/apache/seatunnel/pull/4225#issuecomment-1778563242 PTAL: @hailin0 @Hisoka-X -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] [Improve] Added Table of Contents and FAQs to README [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on PR #5693: URL: https://github.com/apache/seatunnel/pull/5693#issuecomment-1778546860 rebase on dev so you can resolve conflict. (Or merge from dev). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [Docs][Connector-V2] Reconstruct the Socket Source and SftpFile connector document [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on PR #5386: URL: https://github.com/apache/seatunnel/pull/5386#issuecomment-1778488465 Please fix the conflict -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] [Feature][connector-v2][PostgreSQL CDC]Support source PostgreSQL CDC [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on code in PR #5417: URL: https://github.com/apache/seatunnel/pull/5417#discussion_r1371128648 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-cdc-postgres-e2e/src/test/java/org/apache/seatunnel/e2e/connector/cdc/postgres/PostgresCDCIT.java: ## @@ -0,0 +1

Re: [PR] [Feature][Kudu] Refactor Kudu functionality and Sink support CDC data. [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on code in PR #5437: URL: https://github.com/apache/seatunnel/pull/5437#discussion_r1371120945 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-kudu-e2e/src/test/java/org/apache/seatunnel/e2e/connector/kudu/KuduCDCSinkIT.java: ## @@ -0,0 +1,277 @@ +/* + *

Re: [PR] [Feature][Kudu] Refactor Kudu functionality and Sink support CDC data. [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on PR #5437: URL: https://github.com/apache/seatunnel/pull/5437#issuecomment-1778479565 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

Re: [PR] [Feature][Zeta] add from_unixtime function [seatunnel]

2023-10-24 Thread via GitHub
chovy-3012 commented on PR #5462: URL: https://github.com/apache/seatunnel/pull/5462#issuecomment-1778475640 Retried more than 10 times , still failed. Error messages show `no space left on device` , any suggestions? error message as below: ```shell [INFO] Running org.apa

Re: [PR] [Hotfix][Zeta] Fix the problem of unstable job status [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on PR #5450: URL: https://github.com/apache/seatunnel/pull/5450#issuecomment-1778475108 > LGTM if test passed. +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [PR] [Feature][Zeta] add from_unixtime function [seatunnel]

2023-10-24 Thread via GitHub
hailin0 closed pull request #5462: [Feature][Zeta] add from_unixtime function URL: https://github.com/apache/seatunnel/pull/5462 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [Feature][Transform-V2][SqlTransform] Support Not Like Expression [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on PR #5456: URL: https://github.com/apache/seatunnel/pull/5456#issuecomment-1778473304 Does anyone want to continue completing this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] [Feature][Flink] Add external configuration parameters [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on PR #5480: URL: https://github.com/apache/seatunnel/pull/5480#issuecomment-1778470599 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

Re: [PR] [Feature][doc][Connector-V2][SqlServer] Add SqlServer connector documentation [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on code in PR #5498: URL: https://github.com/apache/seatunnel/pull/5498#discussion_r1371113059 ## docs/en/connector-v2/source/SqlServer-CDC.md: ## @@ -16,201 +20,175 @@ describes how to setup the SqlServer CDC connector to run SQL queries against Sq - [x] [pa

[seatunnel] branch dev updated: [Bugfix][Connector-v2] fix file sink `isPartitionFieldWriteInFile` occurred exception when no columns are given (#5508)

2023-10-24 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 9fb5499295 [Bugfix][Connector-v2] fix file sink

Re: [PR] [Bugfix][Connector-v2] fix file sink `isPartitionFieldWriteInFile` occurred exception when no columns are given [seatunnel]

2023-10-24 Thread via GitHub
hailin0 merged PR #5508: URL: https://github.com/apache/seatunnel/pull/5508 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Improve] Added Table of Contents and FAQs to README [seatunnel]

2023-10-24 Thread via GitHub
adarsh-jha-dev commented on PR #5693: URL: https://github.com/apache/seatunnel/pull/5693#issuecomment-1778466680 > Could you rebase on dev? We add a new part for SeaTunnel web project. it is already having the base branch : dev, do i need to change that? If yes, then to which branch?

Re: [PR] [Feature][HiveSink] Support for HIVE collection data types. [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on PR #5514: URL: https://github.com/apache/seatunnel/pull/5514#issuecomment-1778464367 Please fix code conflict -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [Catalog][DM][Improve] dm catalog and dm auto create table and auto create table add constraintKey [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on code in PR #5572: URL: https://github.com/apache/seatunnel/pull/5572#discussion_r1371107114 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/catalog/dm/DamengCatalog.java: ## @@ -46,14 +46,19 @@ public cl

Re: [PR] [Improve] Added Table of Contents and FAQs to README [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on PR #5693: URL: https://github.com/apache/seatunnel/pull/5693#issuecomment-1778461450 Could you rebase on dev? We add a new part for SeaTunnel web project. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [PR] [Improve] Introduce SeaTunnel web project in README.md [seatunnel]

2023-10-24 Thread via GitHub
hailin0 merged PR #5634: URL: https://github.com/apache/seatunnel/pull/5634 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

[seatunnel] branch dev updated: [Improve] Introduce SeaTunnel web project in README.md (#5634)

2023-10-24 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 2d715662b4 [Improve] Introduce SeaTunnel web pr

Re: [PR] [feature][Transform] Transform supports multi-table scenarios [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on PR #5646: URL: https://github.com/apache/seatunnel/pull/5646#issuecomment-1778459676 check ci error -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[seatunnel] branch dev updated: [improve][Connector-V2][http] improve http e2e test (#5655)

2023-10-24 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new f5867adcaa [improve][Connector-V2][http] improv

Re: [PR] [improve][Connector-V2][http] improve http e2e test [seatunnel]

2023-10-24 Thread via GitHub
hailin0 merged PR #5655: URL: https://github.com/apache/seatunnel/pull/5655 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [improve][catalog-postgres] Improve get column sql compatibility [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on PR #5664: URL: https://github.com/apache/seatunnel/pull/5664#issuecomment-1778456153 https://github.com/apache/seatunnel/assets/14371345/73bb84b7-e941-4346-b62d-c6e86123a7f4";> -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] [Zeta][Tool] Move `generate_client_protocol.sh` to engine module [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on PR #5667: URL: https://github.com/apache/seatunnel/pull/5667#issuecomment-1778455413 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[seatunnel] branch dev updated (75b814bc3d -> 83082b2be8)

2023-10-24 Thread liugddx
This is an automated email from the ASF dual-hosted git repository. liugddx pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 75b814bc3d [improve][connector-v2][sqlserver-cdc]Unified sqlserver TypeUtils type conversion mode (#5668) add 8

Re: [PR] [Improve] Change class name of `AbstractJobEnvironment` implement [seatunnel]

2023-10-24 Thread via GitHub
liugddx merged PR #5671: URL: https://github.com/apache/seatunnel/pull/5671 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [I] 运行2.3.3版本,官方文档快速开始 报错找不到FakeSource,其他插件也是找不到 [seatunnel]

2023-10-24 Thread via GitHub
AsLightJava commented on issue #5464: URL: https://github.com/apache/seatunnel/issues/5464#issuecomment-1778449659 please give me your config and path picture ---Original--- From: ***@***.***> Sent at: 2023年10月25日(Wed) Noon11:24 To: ***@***.***>; Cc: ***@***.**@

[seatunnel] branch dev updated: [improve][connector-v2][sqlserver-cdc]Unified sqlserver TypeUtils type conversion mode (#5668)

2023-10-24 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 75b814bc3d [improve][connector-v2][sqlserver-cd

Re: [PR] [improve][connector-v2][sqlserver-cdc]Unified sqlserver TypeUtils type conversion mode [seatunnel]

2023-10-24 Thread via GitHub
hailin0 merged PR #5668: URL: https://github.com/apache/seatunnel/pull/5668 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [I] 运行2.3.3版本,官方文档快速开始 报错找不到FakeSource,其他插件也是找不到 [seatunnel]

2023-10-24 Thread via GitHub
qinlz-1 commented on issue #5464: URL: https://github.com/apache/seatunnel/issues/5464#issuecomment-1778444662 @AsLightJava I did not change the apache-seatunnel-2.3.3 directory name -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

Re: [PR] [Feature][Jdbc] Support read multiple tables [seatunnel]

2023-10-24 Thread via GitHub
hailin0 merged PR #5581: URL: https://github.com/apache/seatunnel/pull/5581 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [I] [Feature][Connector] JDBC source supports multi-table reading in one task [seatunnel]

2023-10-24 Thread via GitHub
hailin0 closed issue #5482: [Feature][Connector] JDBC source supports multi-table reading in one task URL: https://github.com/apache/seatunnel/issues/5482 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [I] [Feature][Jdbc] Support auto split for jdbc source [seatunnel]

2023-10-24 Thread via GitHub
hailin0 closed issue #5675: [Feature][Jdbc] Support auto split for jdbc source URL: https://github.com/apache/seatunnel/issues/5675 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] [Feature][Mongodb-CDC]Add multi-table e2e testcase [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on PR #5685: URL: https://github.com/apache/seatunnel/pull/5685#issuecomment-1778433902 https://github.com/apache/seatunnel/assets/14371345/a433e577-a902-468f-885a-8d4c469a45a1";> -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] [Feature][Flink] Add external configuration parameters [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on PR #5480: URL: https://github.com/apache/seatunnel/pull/5480#issuecomment-1778425390 @TyrantLucifer Could you take a look again? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[I] [Bug] [Rest-API] submit job api has some issue [seatunnel]

2023-10-24 Thread via GitHub
liunaijie opened a new issue, #5699: URL: https://github.com/apache/seatunnel/issues/5699 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Feature][Flink] Add external configuration parameters [seatunnel]

2023-10-24 Thread via GitHub
zhilinli123 commented on PR #5480: URL: https://github.com/apache/seatunnel/pull/5480#issuecomment-1778413537 PTAL: @Hisoka-X -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[PR] [Improve][Engine] Adjust the sleep mode of flink and spark engine to be consistent with zeta [seatunnel]

2023-10-24 Thread via GitHub
happyboy1024 opened a new pull request, #5698: URL: https://github.com/apache/seatunnel/pull/5698 ### Purpose of this pull request Adjust the sleep mode of flink and spark engine to be consistent with zeta. ### Does this PR introduce _any_ user-facing change?

Re: [I] checkpoint timeout [seatunnel]

2023-10-24 Thread via GitHub
liugddx commented on issue #: URL: https://github.com/apache/seatunnel/issues/#issuecomment-1778383400 Refer to https://github.com/apache/seatunnel/issues/5694. Try to use the latest code. -- This is an automated message from the Apache Git Service. To respond to the message, plea

Re: [PR] [Feature-WIP][Connector-V2][Doris] Add Doris ConnectorV2 Source [seatunnel]

2023-10-24 Thread via GitHub
EricJoy2048 commented on code in PR #5086: URL: https://github.com/apache/seatunnel/pull/5086#discussion_r1371040893 ## seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/source/DorisSourceState.java: ## @@ -0,0 +1,34 @@ +/* + * Licensed

Re: [I] org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/0:0:0:0:0:0:0:1:8081[Bug] [Module Name] Bug title [seatunnel]

2023-10-24 Thread via GitHub
wachoo commented on issue #5689: URL: https://github.com/apache/seatunnel/issues/5689#issuecomment-1778374561 We should start the flink cluster firstly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/0:0:0:0:0:0:0:1:8081[Bug] [Module Name] Bug title [seatunnel]

2023-10-24 Thread via GitHub
wachoo closed issue #5689: org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/0:0:0:0:0:0:0:1:8081[Bug] [Module Name] Bug title URL: https://github.com/apache/seatunnel/issues/5689 -- This is an automated message from the

Re: [I] org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/0:0:0:0:0:0:0:1:8081[Bug] [Module Name] Bug title [seatunnel]

2023-10-24 Thread via GitHub
wachoo commented on issue #5689: URL: https://github.com/apache/seatunnel/issues/5689#issuecomment-1778372555 > if you need run with flink engine, you need > > 1. start seatunnel cluster ( the `./bin/seatunnel-cluster.sh -d` command you run ) > 2. start the flink cluster ( cd flink

Re: [PR] [Fix] Fix log error when multi-table sink close [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on code in PR #5683: URL: https://github.com/apache/seatunnel/pull/5683#discussion_r1371010590 ## seatunnel-connectors-v2/connector-common/src/main/java/org/apache/seatunnel/connectors/seatunnel/common/multitablesink/MultiTableSinkWriter.java: ## @@ -243,4 +24

Re: [PR] [Feature-WIP][Connector-V2][Doris] Add Doris ConnectorV2 Source [seatunnel]

2023-10-24 Thread via GitHub
EricJoy2048 commented on code in PR #5086: URL: https://github.com/apache/seatunnel/pull/5086#discussion_r1371010948 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-doris-e2e/src/test/resources/doris_source_and_sink.conf: ## @@ -0,0 +1,67 @@ +# +# Licensed to the Apache So

Re: [I] checkpoint timeout [seatunnel]

2023-10-24 Thread via GitHub
SamealD commented on issue #: URL: https://github.com/apache/seatunnel/issues/#issuecomment-1778362209 I have the same question. When I synchronize a big table, I set checkpoint.timeout = a verg big number, It still get an error said CheckpointException: Checkpoint expired before co

Re: [PR] [Feature-WIP][Connector-V2][Doris] Add Doris ConnectorV2 Source [seatunnel]

2023-10-24 Thread via GitHub
EricJoy2048 commented on code in PR #5086: URL: https://github.com/apache/seatunnel/pull/5086#discussion_r1371007928 ## seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/source/DorisSourceFactory.java: ## @@ -0,0 +1,52 @@ +/* + * License

Re: [PR] [Fix] Fix log error when multi-table sink close [seatunnel]

2023-10-24 Thread via GitHub
ruanwenjun commented on code in PR #5683: URL: https://github.com/apache/seatunnel/pull/5683#discussion_r1371009888 ## seatunnel-connectors-v2/connector-common/src/main/java/org/apache/seatunnel/connectors/seatunnel/common/multitablesink/MultiTableSinkWriter.java: ## @@ -243,4 +

Re: [I] [Bug] [seatunnel engine] rest-api post task always fail [seatunnel]

2023-10-24 Thread via GitHub
liunaijie commented on issue #5691: URL: https://github.com/apache/seatunnel/issues/5691#issuecomment-1778360272 I check the code, it's a bug, we will fix it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] [Fix] Fix log error when multi-table sink close [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on code in PR #5683: URL: https://github.com/apache/seatunnel/pull/5683#discussion_r1371001712 ## seatunnel-connectors-v2/connector-common/src/main/java/org/apache/seatunnel/connectors/seatunnel/common/multitablesink/MultiTableSinkWriter.java: ## @@ -243,4 +24

Re: [I] org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/0:0:0:0:0:0:0:1:8081[Bug] [Module Name] Bug title [seatunnel]

2023-10-24 Thread via GitHub
liunaijie commented on issue #5689: URL: https://github.com/apache/seatunnel/issues/5689#issuecomment-1778344572 if you need run with flink engine, you need 1. start seatunnel cluster ( the `./bin/seatunnel-cluster.sh -d` you run ) 2. start the flink cluster ( cd flink home, run `./bin

Re: [I] [Bug] [Module Name] Bug title [seatunnel]

2023-10-24 Thread via GitHub
yjm12333 closed issue #5696: [Bug] [Module Name] Bug title URL: https://github.com/apache/seatunnel/issues/5696 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [I] [Feature][seatunnel-transforms-v2][Sql] use the built-in visitor mode of `jsqlparse` [seatunnel]

2023-10-24 Thread via GitHub
github-actions[bot] commented on issue #5524: URL: https://github.com/apache/seatunnel/issues/5524#issuecomment-1778272019 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [mongodb-cdc] seatunnel-2.3.3 [Unsupported operation] - Unable to convert to from nullable value null [seatunnel]

2023-10-24 Thread via GitHub
github-actions[bot] commented on issue #5471: URL: https://github.com/apache/seatunnel/issues/5471#issuecomment-1778272137 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [PR] [Feature] [Connector-V2] Add connector amazonsqs [seatunnel]

2023-10-24 Thread via GitHub
HaoXuAI commented on PR #5367: URL: https://github.com/apache/seatunnel/pull/5367#issuecomment-1778193700 > I believe the error came from constructor > > ``` > Caused by: org.apache.seatunnel.common.utils.SeaTunnelException: java.lang.NullPointerException >at org.apache.sea

Re: [PR] [ST-Engine][Design] Optimize SeaTunnel Zeta engine Jar package upload logic [seatunnel]

2023-10-24 Thread via GitHub
lianghuan-xatu commented on code in PR #5542: URL: https://github.com/apache/seatunnel/pull/5542#discussion_r1370773603 ## seatunnel-engine/seatunnel-engine-server/src/test/java/org/apache/seatunnel/engine/server/ConnectorPackageServiceTest.java: ## @@ -0,0 +1,406 @@ +/* + * Lic

Re: [PR] [ST-Engine][Design] Optimize SeaTunnel Zeta engine Jar package upload logic [seatunnel]

2023-10-24 Thread via GitHub
lianghuan-xatu commented on code in PR #5542: URL: https://github.com/apache/seatunnel/pull/5542#discussion_r1370768256 ## seatunnel-e2e/seatunnel-engine-e2e/connector-seatunnel-e2e-base/src/test/java/org/apache/seatunnel/engine/e2e/ConnectorPackageServiceIT.java: ## @@ -0,0 +1,

Re: [PR] [ST-Engine][Design] Optimize SeaTunnel Zeta engine Jar package upload logic [seatunnel]

2023-10-24 Thread via GitHub
lianghuan-xatu commented on code in PR #5542: URL: https://github.com/apache/seatunnel/pull/5542#discussion_r1370765470 ## seatunnel-engine/seatunnel-engine-client/src/main/java/org/apache/seatunnel/engine/client/job/ConnectorPackageClient.java: ## @@ -0,0 +1,149 @@ +/* + * Lice

Re: [I] [Bug] [Module Name] Bug title [seatunnel]

2023-10-24 Thread via GitHub
zhilinli123 commented on issue #5696: URL: https://github.com/apache/seatunnel/issues/5696#issuecomment-1777459906 Please provide SqlServer& Click house DDL along with your.conf configuration file, which needs to be supplemented in more detail to facilitate problem locating -- This i

Re: [PR] [ST-Engine][Design] Optimize SeaTunnel Zeta engine Jar package upload logic [seatunnel]

2023-10-24 Thread via GitHub
lianghuan-xatu commented on code in PR #5542: URL: https://github.com/apache/seatunnel/pull/5542#discussion_r1370354186 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/CoordinatorService.java: ## @@ -259,6 +259,20 @@ private void rest

Re: [PR] [ST-Engine][Design] Optimize SeaTunnel Zeta engine Jar package upload logic [seatunnel]

2023-10-24 Thread via GitHub
lianghuan-xatu commented on code in PR #5542: URL: https://github.com/apache/seatunnel/pull/5542#discussion_r1370332332 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/rest/RestHttpPostCommandProcessor.java: ## @@ -96,6 +96,7 @@ priva

Re: [PR] [ST-Engine][Design] Optimize SeaTunnel Zeta engine Jar package upload logic [seatunnel]

2023-10-24 Thread via GitHub
lianghuan-xatu commented on code in PR #5542: URL: https://github.com/apache/seatunnel/pull/5542#discussion_r1370307858 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/SeaTunnelServer.java: ## @@ -253,4 +257,63 @@ private void printEx

Re: [PR] [ST-Engine][Design] Optimize SeaTunnel Zeta engine Jar package upload logic [seatunnel]

2023-10-24 Thread via GitHub
lianghuan-xatu commented on code in PR #5542: URL: https://github.com/apache/seatunnel/pull/5542#discussion_r1370274833 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/task/TaskGroupImmutableInformation.java: ## @@ -40,6 +41,8 @@ publ

Re: [PR] [Feature][Transform] add JsonPath transform [seatunnel]

2023-10-24 Thread via GitHub
TyrantLucifer commented on code in PR #5632: URL: https://github.com/apache/seatunnel/pull/5632#discussion_r1370150187 ## seatunnel-transforms-v2/src/main/java/org/apache/seatunnel/transform/jsonpath/JsonPathTransform.java: ## @@ -0,0 +1,171 @@ +/* + * Licensed to the Apache Sof

[PR] [Improve][E2E][Jdbc] Enable IT case for Oceanbase Mysql mode [seatunnel]

2023-10-24 Thread via GitHub
whhe opened a new pull request, #5697: URL: https://github.com/apache/seatunnel/pull/5697 ### Purpose of this pull request Enable IT case for Oceanbase Mysql mode with latest docker image. ### Does this PR introduce _any_ user-facing change? No.

Re: [PR] [Feature][Mongodb-CDC]Add multi-table e2e testcase [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on PR #5685: URL: https://github.com/apache/seatunnel/pull/5685#issuecomment-1777150134 Please check ci errors -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] [Feature][Jdbc] Support read multiple tables [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on code in PR #5581: URL: https://github.com/apache/seatunnel/pull/5581#discussion_r1370108115 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/catalog/AbstractJdbcCatalog.java: ## @@ -158,7 +155,10 @@ publi

Re: [PR] [Bugfix][Zeta] Fix the checkpoint be blocked with long time [seatunnel]

2023-10-24 Thread via GitHub
hailin0 merged PR #5695: URL: https://github.com/apache/seatunnel/pull/5695 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

[seatunnel] branch dev updated: [Bugfix][Zeta] Fix the checkpoint be blocked with long time (#5695)

2023-10-24 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new a1d13b9157 [Bugfix][Zeta] Fix the checkpoint be

Re: [PR] [Improve] Added Table of Contents and FAQs to README [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on PR #5693: URL: https://github.com/apache/seatunnel/pull/5693#issuecomment-1777080970 cc @EricJoy2048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [Improve] Added Table of Contents and FAQs to README [seatunnel]

2023-10-24 Thread via GitHub
adarsh-jha-dev commented on PR #5693: URL: https://github.com/apache/seatunnel/pull/5693#issuecomment-1777075819 > Thanks @adarsh-jha-dev , Could you fix the CI error? Hey @Hisoka-X , I have resolved that CI error, you can proceed further. -- This is an automated message from the A

Re: [PR] [improve][connector-v2][sqlserver-cdc]Unified sqlserver TypeUtils type conversion mode [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on PR #5668: URL: https://github.com/apache/seatunnel/pull/5668#issuecomment-1777071274 cc @hailin0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] [Bugfix][Zeta] Fix the checkpoint be blocked with long time [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on PR #5695: URL: https://github.com/apache/seatunnel/pull/5695#issuecomment-1777049789 cc @hailin0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] [ST-Engine][Design] Optimize SeaTunnel Zeta engine Jar package upload logic [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on PR #5542: URL: https://github.com/apache/seatunnel/pull/5542#issuecomment-1777048926 @TyrantLucifer I think you should take a look too. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] [ST-Engine][Design] Optimize SeaTunnel Zeta engine Jar package upload logic [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on code in PR #5542: URL: https://github.com/apache/seatunnel/pull/5542#discussion_r136130 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/SeaTunnelServer.java: ## @@ -253,4 +257,63 @@ private void printExecutio

Re: [PR] [Improve] Added Table of Contents and FAQs to README [seatunnel]

2023-10-24 Thread via GitHub
adarsh-jha-dev commented on PR #5693: URL: https://github.com/apache/seatunnel/pull/5693#issuecomment-1777017881 > Thanks @adarsh-jha-dev , Could you fix the CI error? yeah sure, on it -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] [Improve] Added Table of Contents and FAQs to README [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on PR #5693: URL: https://github.com/apache/seatunnel/pull/5693#issuecomment-1776994824 Thanks @adarsh-jha-dev , Could you fix the CI error? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[seatunnel] branch dependabot/maven/seatunnel-connectors-v2/connector-iceberg/org.apache.avro-avro-1.11.3 deleted (was 9fa985f377)

2023-10-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/seatunnel-connectors-v2/connector-iceberg/org.apache.avro-avro-1.11.3 in repository https://gitbox.apache.org/repos/asf/seatunnel.git was 9fa985f377 Bump org.apache.avr

[seatunnel] branch dev updated (bb791a6d9e -> 13753a927b)

2023-10-24 Thread liugddx
This is an automated email from the ASF dual-hosted git repository. liugddx pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from bb791a6d9e [Dependency]Bump org.apache.avro:avro (#5583) add 13753a927b [Dependency]Bump org.apache.avro:avro in

Re: [PR] Bump org.apache.avro:avro from 1.10.2 to 1.11.3 in connector-iceberg [seatunnel]

2023-10-24 Thread via GitHub
liugddx merged PR #5582: URL: https://github.com/apache/seatunnel/pull/5582 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

[seatunnel] branch dev updated (eeff242828 -> bb791a6d9e)

2023-10-24 Thread liugddx
This is an automated email from the ASF dual-hosted git repository. liugddx pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from eeff242828 [Feature][Spark] Support flow control in Spark (#5510) add bb791a6d9e [Dependency]Bump org.apache.avr

[seatunnel] branch dependabot/maven/seatunnel-connectors-v2/connector-cdc/connector-cdc-mongodb/org.apache.avro-avro-1.11.3 deleted (was 6a08321dac)

2023-10-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/seatunnel-connectors-v2/connector-cdc/connector-cdc-mongodb/org.apache.avro-avro-1.11.3 in repository https://gitbox.apache.org/repos/asf/seatunnel.git was 6a08321dac B

Re: [PR] Bump org.apache.avro:avro from 1.11.1 to 1.11.3 in connector-cdc-mongodb [seatunnel]

2023-10-24 Thread via GitHub
liugddx merged PR #5583: URL: https://github.com/apache/seatunnel/pull/5583 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Bugfix][Zeta] Fix the checkpoint be blocked with long time [seatunnel]

2023-10-24 Thread via GitHub
happyboy1024 commented on PR #5695: URL: https://github.com/apache/seatunnel/pull/5695#issuecomment-1776962248 > Could you retry the failed CI? > You missed these. ![image](https://user-images.githubusercontent.com/32387433/277631749-8215a9c6-93d1-4a9a-8a1e-89aea50b8ba8.png)

Re: [PR] [Bugfix][Zeta] Fix the checkpoint be blocked with long time [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on PR #5695: URL: https://github.com/apache/seatunnel/pull/5695#issuecomment-1776952971 You missed these. ![image](https://github.com/apache/seatunnel/assets/32387433/8215a9c6-93d1-4a9a-8a1e-89aea50b8ba8) -- This is an automated message from the Apache Git Servic

Re: [PR] [Bugfix][Zeta] Fix the checkpoint be blocked with long time [seatunnel]

2023-10-24 Thread via GitHub
happyboy1024 commented on PR #5695: URL: https://github.com/apache/seatunnel/pull/5695#issuecomment-1776950522 > Could you retry the failed CI? PTAL, I have retried the failed CI. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [PR] [Bugfix][Zeta] Fix the checkpoint be blocked with long time [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on PR #5695: URL: https://github.com/apache/seatunnel/pull/5695#issuecomment-1776909029 Could you retry the failed CI? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] [Bug] [seatunnel engine] rest-api post task always fail [seatunnel]

2023-10-24 Thread via GitHub
QiuZiXian commented on issue #5691: URL: https://github.com/apache/seatunnel/issues/5691#issuecomment-1776891624 > what's your question? and is this duplicate with #5686 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [I] [Bug] [seatunnel engine] rest-api post task always fail [seatunnel]

2023-10-24 Thread via GitHub
QiuZiXian commented on issue #5691: URL: https://github.com/apache/seatunnel/issues/5691#issuecomment-1776891070 I have closed #5686,my question is : Running Command directly by linux shell ./bin/seatunnel.sh --config ./config/v2.batch.config.template -e local can success. but us

Re: [PR] [Feature][Jdbc] Support read multiple tables [seatunnel]

2023-10-24 Thread via GitHub
Hisoka-X commented on code in PR #5581: URL: https://github.com/apache/seatunnel/pull/5581#discussion_r1369862378 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/catalog/AbstractJdbcCatalog.java: ## @@ -158,7 +155,10 @@ publ

[I] [Bug] [Module Name] Bug title [seatunnel]

2023-10-24 Thread via GitHub
yjm12333 opened a new issue, #5696: URL: https://github.com/apache/seatunnel/issues/5696 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[PR] [Bugfix][Zeta] Fix the checkpoint be blocked with long time [seatunnel]

2023-10-24 Thread via GitHub
happyboy1024 opened a new pull request, #5695: URL: https://github.com/apache/seatunnel/pull/5695 ### Purpose of this pull request Fix the checkpoint be blocked with long time. #5694 ### Does this PR introduce _any_ user-facing change? ### How was thi

Re: [PR] [Feature][Jdbc] Support read multiple tables [seatunnel]

2023-10-24 Thread via GitHub
hailin0 commented on code in PR #5581: URL: https://github.com/apache/seatunnel/pull/5581#discussion_r1369861920 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/configuration/util/ConfigUtil.java: ## @@ -83,6 +83,12 @@ public static T convertValue(Object rawValue, Optio

  1   2   >