Re: [PR] [Feature][Zeta] Add tag to node used to filter worker when submit job [seatunnel]

2024-06-24 Thread via GitHub
liunaijie commented on code in PR #7045: URL: https://github.com/apache/seatunnel/pull/7045#discussion_r1650559302 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/resourcemanager/AbstractResourceManager.java: ## @@ -129,9 +131,45 @@ p

Re: [PR] [Feature][Zeta] Add tag to node used to filter worker when submit job [seatunnel]

2024-06-24 Thread via GitHub
liunaijie commented on code in PR #7045: URL: https://github.com/apache/seatunnel/pull/7045#discussion_r1650557945 ## seatunnel-engine/seatunnel-engine-common/src/main/resources/hazelcast.yaml: ## @@ -39,3 +39,10 @@ hazelcast: hazelcast.tcp.join.port.try.count: 30 haze

Re: [PR] [Feature][Zeta] Add tag to node used to filter worker when submit job [seatunnel]

2024-06-24 Thread via GitHub
liunaijie commented on code in PR #7045: URL: https://github.com/apache/seatunnel/pull/7045#discussion_r1650562213 ## docs/en/seatunnel-engine/resource-manager.md: ## @@ -0,0 +1,81 @@ +--- + +sidebar_position: 9 Review Comment: done -- This is an automated message from t

Re: [PR] [Feature][Zeta] Add tag to node used to filter worker when submit job [seatunnel]

2024-06-24 Thread via GitHub
liunaijie commented on code in PR #7045: URL: https://github.com/apache/seatunnel/pull/7045#discussion_r1650565261 ## docs/images/architecture_diagram.png: ## Review Comment: move image folder from `docs/en/images` to `docs/images` -- This is an automated message from t

Re: [PR] [Feature][Zeta] Add tag to node used to filter worker when submit job [seatunnel]

2024-06-24 Thread via GitHub
liunaijie commented on PR #7045: URL: https://github.com/apache/seatunnel/pull/7045#issuecomment-2185918830 The tag filter can also apply to task level, but for now not implement this. -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[I] [Question] Synchronizing data from PostgreSQL to MySQL with error: not a valid URL [seatunnel]

2024-06-24 Thread via GitHub
xjdAlan opened a new issue, #7051: URL: https://github.com/apache/seatunnel/issues/7051 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[PR] [Feature][Elasticsearch] Support multi-table sink write #7041 [seatunnel]

2024-06-24 Thread via GitHub
CosmosNi opened a new pull request, #7052: URL: https://github.com/apache/seatunnel/pull/7052 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list * [

[PR] [Improve][Engine] Support custom job id for rest-api named submit-job [seatunnel]

2024-06-24 Thread via GitHub
dailai opened a new pull request, #7053: URL: https://github.com/apache/seatunnel/pull/7053 ### Purpose of this pull request For issue #6968 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check l

Re: [PR] [Improve][Engine] Support custom job id for rest-api named submit-job [seatunnel]

2024-06-24 Thread via GitHub
dailai commented on PR #7053: URL: https://github.com/apache/seatunnel/pull/7053#issuecomment-2186047991 @Hisoka-X @hailin0 PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] [Improve][Connector-V2] Support schema evolution for mysql-cdc and mysql-jdbc [seatunnel]

2024-06-24 Thread via GitHub
dailai commented on code in PR #6929: URL: https://github.com/apache/seatunnel/pull/6929#discussion_r1650692278 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/event/AlterTableColumnEvent.java: ## @@ -19,10 +19,15 @@ import org.apache.seatunnel.api.table.catalog

Re: [PR] [Improve][Engine] Support custom job id for rest-api named submit-job [seatunnel]

2024-06-24 Thread via GitHub
Hisoka-X commented on code in PR #7053: URL: https://github.com/apache/seatunnel/pull/7053#discussion_r1650719723 ## seatunnel-e2e/seatunnel-engine-e2e/connector-seatunnel-e2e-base/src/test/java/org/apache/seatunnel/engine/e2e/RestHttpPostApiIT.java: ## @@ -0,0 +1,85 @@ +/* + *

Re: [PR] [Feature][Elasticsearch] Support multi-table sink write #7041 [seatunnel]

2024-06-24 Thread via GitHub
CosmosNi commented on PR #7052: URL: https://github.com/apache/seatunnel/pull/7052#issuecomment-2186085325 @iture123 @TyrantLucifer @Hisoka-X PTAL,thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] [Improve][Engine] Support custom job id for rest-api named submit-job [seatunnel]

2024-06-24 Thread via GitHub
Hisoka-X commented on code in PR #7053: URL: https://github.com/apache/seatunnel/pull/7053#discussion_r1650719723 ## seatunnel-e2e/seatunnel-engine-e2e/connector-seatunnel-e2e-base/src/test/java/org/apache/seatunnel/engine/e2e/RestHttpPostApiIT.java: ## @@ -0,0 +1,85 @@ +/* + *

Re: [PR] [Improve][Engine] Support custom job id for rest-api named submit-job [seatunnel]

2024-06-24 Thread via GitHub
Hisoka-X commented on code in PR #7053: URL: https://github.com/apache/seatunnel/pull/7053#discussion_r1650719723 ## seatunnel-e2e/seatunnel-engine-e2e/connector-seatunnel-e2e-base/src/test/java/org/apache/seatunnel/engine/e2e/RestHttpPostApiIT.java: ## @@ -0,0 +1,85 @@ +/* + *

Re: [PR] [Feature][Elasticsearch] Support multi-table sink write #7041 [seatunnel]

2024-06-24 Thread via GitHub
Hisoka-X commented on code in PR #7052: URL: https://github.com/apache/seatunnel/pull/7052#discussion_r1650727992 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-elasticsearch-e2e/src/test/java/org/apache/seatunnel/e2e/connector/elasticsearch/ElasticsearchIT.java: ## @@ -2

Re: [PR] [Feature][Zeta] Add tag to node used to filter worker when submit job [seatunnel]

2024-06-24 Thread via GitHub
Hisoka-X commented on code in PR #7045: URL: https://github.com/apache/seatunnel/pull/7045#discussion_r1650745838 ## docs/sidebars.js: ## @@ -178,7 +178,8 @@ const sidebars = { "seatunnel-engine/checkpoint-storage", "seatunnel-engine/rest-api",

Re: [PR] [Feature][Elasticsearch] Support multi-table sink write #7041 [seatunnel]

2024-06-24 Thread via GitHub
CosmosNi commented on code in PR #7052: URL: https://github.com/apache/seatunnel/pull/7052#discussion_r1650792426 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-elasticsearch-e2e/src/test/java/org/apache/seatunnel/e2e/connector/elasticsearch/ElasticsearchIT.java: ## @@ -2

Re: [PR] [Feature][Elasticsearch] Support multi-table sink write #7041 [seatunnel]

2024-06-24 Thread via GitHub
Hisoka-X commented on code in PR #7052: URL: https://github.com/apache/seatunnel/pull/7052#discussion_r1650810550 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-elasticsearch-e2e/src/test/java/org/apache/seatunnel/e2e/connector/elasticsearch/ElasticsearchIT.java: ## @@ -2

[I] Extract hive specified partition data and report error [seatunnel]

2024-06-24 Thread via GitHub
luckyliush opened a new issue, #7054: URL: https://github.com/apache/seatunnel/issues/7054 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [I] MongoDB - Sink - PluginIdentifier not found [seatunnel]

2024-06-24 Thread via GitHub
a11dev commented on issue #6800: URL: https://github.com/apache/seatunnel/issues/6800#issuecomment-2186515460 Hi Jia, I resumed my seatunnel tests. Still trying to sync mongo from oracle cdc. Firstly as written apache seatunnel documentation is pointing to a wrong maven reposi

Re: [I] MongoDB - Sink - PluginIdentifier not found [seatunnel]

2024-06-24 Thread via GitHub
a11dev commented on issue #6800: URL: https://github.com/apache/seatunnel/issues/6800#issuecomment-2186565101 Sorry... I did! the basic transfer is working now, no help needed on this topic. Sorry I disturbed you! Is there a way to update a collection in order to perform a dernoma

Re: [PR] [Feature][Elasticsearch] Support multi-table sink write #7041 [seatunnel]

2024-06-24 Thread via GitHub
hailin0 merged PR #7052: URL: https://github.com/apache/seatunnel/pull/7052 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Feature][Elasticsearch] Support multi-table sink write #7041 (#7052)

2024-06-24 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 45653e1d22 [Feature][Elasticsearch] Support mul

Re: [PR] [Hotfix][Hive]Fix hive load hive_site_path and hdfs_site_path too late [seatunnel]

2024-06-24 Thread via GitHub
hailin0 merged PR #7017: URL: https://github.com/apache/seatunnel/pull/7017 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: Fix hive load hive_site_path and hdfs_site_path too late (#7017)

2024-06-24 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new e2578a5b4d Fix hive load hive_site_path and hdf

Re: [I] [Bug] [Hive Connector] hive_site_path and hdfs_site_path config loading too late [seatunnel]

2024-06-24 Thread via GitHub
hailin0 closed issue #7016: [Bug] [Hive Connector] hive_site_path and hdfs_site_path config loading too late URL: https://github.com/apache/seatunnel/issues/7016 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] [Feature][connector][kafka] Support read Maxwell format message from kafka #4415 [seatunnel]

2024-06-24 Thread via GitHub
hailin0 commented on code in PR #4428: URL: https://github.com/apache/seatunnel/pull/4428#discussion_r1651114547 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-kafka-e2e/src/test/java/org/apache/seatunnel/e2e/connector/kafka/KafkaFormatIT.java: ## @@ -418,6 +425,26 @@ pub

(seatunnel) branch dev updated: [fix] revert IMAP cache data field type to compatible with old version (#7001)

2024-06-24 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 165bfaea55 [fix] revert IMAP cache data field type

(seatunnel) branch dev updated: [Improve][Engine] Support custom job id for rest-api named submit-job (#7053)

2024-06-24 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 77f61408b7 [Improve][Engine] Support custom job

(seatunnel) branch dev updated: [Hotfix][MySQL-CDC] Fix read gbk varchar chinese garbled characters (#7046)

2024-06-24 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 4e4d2b8ee5 [Hotfix][MySQL-CDC] Fix read gbk var