Re: [PR] [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc [seatunnel]

2024-07-24 Thread via GitHub
dailai commented on code in PR #7248: URL: https://github.com/apache/seatunnel/pull/7248#discussion_r1689257444 ## docs/en/connector-v2/source/Oracle-CDC.md: ## @@ -270,6 +272,44 @@ source { } ``` +> Use the select count(*) instead of analysis table for count table rows in

Re: [PR] [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc [seatunnel]

2024-07-24 Thread via GitHub
dailai commented on code in PR #7248: URL: https://github.com/apache/seatunnel/pull/7248#discussion_r1689264580 ## seatunnel-connectors-v2/connector-cdc/connector-cdc-oracle/src/main/java/org/apache/seatunnel/connectors/seatunnel/cdc/oracle/utils/OracleUtils.java: ## @@ -81,27 +

Re: [PR] [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc [seatunnel]

2024-07-24 Thread via GitHub
Carl-Zhou-CN commented on code in PR #7248: URL: https://github.com/apache/seatunnel/pull/7248#discussion_r1689272732 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/config/JdbcSourceOptions.java: ## @@ -93,4 +93,16 @@ publi

Re: [PR] [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc [seatunnel]

2024-07-24 Thread via GitHub
dailai commented on code in PR #7248: URL: https://github.com/apache/seatunnel/pull/7248#discussion_r1689277289 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/config/JdbcSourceOptions.java: ## @@ -93,4 +93,16 @@ public inte

[I] [Bug][Generate Sink SQL]重复插入数据,关闭hadoop环境,提示hadoop.home.dir are unset [seatunnel]

2024-07-24 Thread via GitHub
friendLive opened a new issue, #7253: URL: https://github.com/apache/seatunnel/issues/7253 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

[PR] [Feature][Jdbc] Support hive compatibleMode add inceptor dialect [seatunnel]

2024-07-24 Thread via GitHub
Xuzhengz opened a new pull request, #7254: URL: https://github.com/apache/seatunnel/pull/7254 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list * [

Re: [PR] [Feature][Jdbc] Support hive compatibleMode add inceptor dialect [seatunnel]

2024-07-24 Thread via GitHub
Xuzhengz closed pull request #7254: [Feature][Jdbc] Support hive compatibleMode add inceptor dialect URL: https://github.com/apache/seatunnel/pull/7254 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[I] [Bug] [seatunnel-translation-flink] Seatunnel Flink translation doesn't support 1.19.1 [seatunnel]

2024-07-24 Thread via GitHub
litiliu opened a new issue, #7255: URL: https://github.com/apache/seatunnel/issues/7255 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[I] [Feature][Catalog] Catalog table not found or library not found error message enhanced [seatunnel]

2024-07-24 Thread via GitHub
Carl-Zhou-CN opened a new issue, #7256: URL: https://github.com/apache/seatunnel/issues/7256 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] [Improve][Catalog] Catalog table not found or library not found error message enhanced [seatunnel]

2024-07-24 Thread via GitHub
Carl-Zhou-CN commented on issue #7256: URL: https://github.com/apache/seatunnel/issues/7256#issuecomment-2247356569 https://github.com/apache/seatunnel/issues/6680 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] [Feature][doc] Add how docker quick start [seatunnel]

2024-07-24 Thread via GitHub
tcodehuber commented on issue #1622: URL: https://github.com/apache/seatunnel/issues/1622#issuecomment-2247455106 Has this issue been finished yet? I am glad to submit a PR. @zhongjiajie -- This is an automated message from the Apache Git Service. To respond to the message, please log on

(seatunnel) 01/01: [Release][2.3.6][release-note] Add release-note

2024-07-24 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch 2.3.6-release in repository https://gitbox.apache.org/repos/asf/seatunnel.git commit b42aa79c783f164472b88d779fdc4b9279a94f34 Author: Jia Fan AuthorDate: Wed Jul 24 20:48:38 2024 +0800 [Rele

(seatunnel) branch 2.3.6-release created (now b42aa79c78)

2024-07-24 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a change to branch 2.3.6-release in repository https://gitbox.apache.org/repos/asf/seatunnel.git at b42aa79c78 [Release][2.3.6][release-note] Add release-note This branch includes the following new commits:

[PR] [Fix][Dist] Remove aws jar dependency in release package [seatunnel]

2024-07-24 Thread via GitHub
Hisoka-X opened a new pull request, #7257: URL: https://github.com/apache/seatunnel/pull/7257 ### Purpose of this pull request Remove aws jar dependency in release package, we only include necessary jar in release package. Also it let release build failed. ![image](https://git

Re: [PR] [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc [seatunnel]

2024-07-24 Thread via GitHub
hailin0 commented on code in PR #7248: URL: https://github.com/apache/seatunnel/pull/7248#discussion_r1689814240 ## docs/en/connector-v2/source/Oracle-CDC.md: ## @@ -270,6 +272,44 @@ source { } ``` +> Use the select count(*) instead of analysis table for count table rows in

Re: [PR] [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc [seatunnel]

2024-07-24 Thread via GitHub
hailin0 commented on code in PR #7248: URL: https://github.com/apache/seatunnel/pull/7248#discussion_r1689814240 ## docs/en/connector-v2/source/Oracle-CDC.md: ## @@ -270,6 +272,44 @@ source { } ``` +> Use the select count(*) instead of analysis table for count table rows in

Re: [PR] [Improve][API] Make sure the table name in TablePath not be null [seatunnel]

2024-07-24 Thread via GitHub
Hisoka-X commented on PR #7252: URL: https://github.com/apache/seatunnel/pull/7252#issuecomment-2248037933 cc @hailin0 @hawk9821 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc [seatunnel]

2024-07-24 Thread via GitHub
dailai commented on code in PR #7248: URL: https://github.com/apache/seatunnel/pull/7248#discussion_r1690611233 ## docs/en/connector-v2/source/Oracle-CDC.md: ## @@ -270,6 +272,44 @@ source { } ``` +> Use the select count(*) instead of analysis table for count table rows in

Re: [PR] [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc [seatunnel]

2024-07-24 Thread via GitHub
dailai commented on code in PR #7248: URL: https://github.com/apache/seatunnel/pull/7248#discussion_r1690611233 ## docs/en/connector-v2/source/Oracle-CDC.md: ## @@ -270,6 +272,44 @@ source { } ``` +> Use the select count(*) instead of analysis table for count table rows in

Re: [I] [Feature][ConnectorV2] new option for determining split owners [seatunnel]

2024-07-24 Thread via GitHub
github-actions[bot] commented on issue #7043: URL: https://github.com/apache/seatunnel/issues/7043#issuecomment-2249109922 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][Connector-File] Support user configure date/time/datetime format [seatunnel]

2024-07-24 Thread via GitHub
github-actions[bot] closed issue #6995: [Feature][Connector-File] Support user configure date/time/datetime format URL: https://github.com/apache/seatunnel/issues/6995 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [I] [Feature][Connector-V2] Support multi-table for sink Kafka [seatunnel]

2024-07-24 Thread via GitHub
github-actions[bot] closed issue #6994: [Feature][Connector-V2] Support multi-table for sink Kafka URL: https://github.com/apache/seatunnel/issues/6994 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [I] [Feature][Connector-V2] Support multi-table for sink Kafka [seatunnel]

2024-07-24 Thread via GitHub
github-actions[bot] commented on issue #6994: URL: https://github.com/apache/seatunnel/issues/6994#issuecomment-2249109976 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Feature][Connector-File] Support user configure date/time/datetime format [seatunnel]

2024-07-24 Thread via GitHub
github-actions[bot] commented on issue #6995: URL: https://github.com/apache/seatunnel/issues/6995#issuecomment-2249109960 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] [engine] MultipleTableJobConfigParser error [seatunnel]

2024-07-24 Thread via GitHub
github-actions[bot] closed issue #6993: [Bug] [engine] MultipleTableJobConfigParser error URL: https://github.com/apache/seatunnel/issues/6993 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [I] [Bug] [engine] MultipleTableJobConfigParser error [seatunnel]

2024-07-24 Thread via GitHub
github-actions[bot] commented on issue #6993: URL: https://github.com/apache/seatunnel/issues/6993#issuecomment-2249109986 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Feature][Connector-File] Support user configure date/time/datetime format [seatunnel]

2024-07-24 Thread via GitHub
Hisoka-X commented on issue #6995: URL: https://github.com/apache/seatunnel/issues/6995#issuecomment-2249128216 Hi @FuYouJ , any update for this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[PR] [Bug] [connector-cdc-oracle] fix issue 6680: Oracle CDC : Can not find catalog table with factoryId [Oracle] [seatunnel]

2024-07-24 Thread via GitHub
NeoGitCrt1 opened a new pull request, #7258: URL: https://github.com/apache/seatunnel/pull/7258 fix issue 6680: Oracle CDC : Can not find catalog table with factoryId [Oracle] tested in 2.3.5 [issue 6680](https://github.com/apache/seatunnel/issues/6680) -- This is an automated m

[I] CDC的场景式是否支持MySQL的分库分表 [seatunnel]

2024-07-24 Thread via GitHub
0Freesky0 opened a new issue, #7260: URL: https://github.com/apache/seatunnel/issues/7260 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc [seatunnel]

2024-07-24 Thread via GitHub
hailin0 merged PR #7248: URL: https://github.com/apache/seatunnel/pull/7248 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc (#7248)

2024-07-24 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 0d08b20061 [Improve][Connector-v2] Optimize the

[PR] [Improve][Connector-v2] Optimize the way of databases and tables are checked for existence [seatunnel]

2024-07-24 Thread via GitHub
dailai opened a new pull request, #7261: URL: https://github.com/apache/seatunnel/pull/7261 ### Purpose of this pull request 1. Overwrite the method named databaseExists and tableExists for MysqlCatalog、OracleCatalog、PostgresCatalog and SqlserverCatalog. This is because t

[PR] [Feature][Jdbc] Support hive compatibleMode add inceptor dialect [seatunnel]

2024-07-24 Thread via GitHub
Xuzhengz opened a new pull request, #7262: URL: https://github.com/apache/seatunnel/pull/7262 add hive compatibleMode,support inceptor read and writer. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] [Improve][Connector-v2] Optimize the way of databases and tables are checked for existence [seatunnel]

2024-07-24 Thread via GitHub
dailai commented on PR #7261: URL: https://github.com/apache/seatunnel/pull/7261#issuecomment-2249229589 1. Mysql ![mysql_catalog](https://github.com/user-attachments/assets/7f8e73dc-85c6-401c-b690-aa3a19987beb) 2. Oracle ![oracle_catalog](https://github.com/user-attachments/as

Re: [PR] [Fix][Dist] Remove aws jar dependency in release package [seatunnel]

2024-07-24 Thread via GitHub
liugddx merged PR #7257: URL: https://github.com/apache/seatunnel/pull/7257 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Fix][Dist] Remove aws jar dependency in release package (#7257)

2024-07-24 Thread liugddx
This is an automated email from the ASF dual-hosted git repository. liugddx pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 876d2f08d2 [Fix][Dist] Remove aws jar dependency i

(seatunnel) 01/01: [Release][2.3.6][release-note] Add release-note

2024-07-24 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch 2.3.6-release in repository https://gitbox.apache.org/repos/asf/seatunnel.git commit 85134cdfcab92987e19d3b5590c7bc639616a4cc Author: Jia Fan AuthorDate: Thu Jul 25 10:29:46 2024 +0800 [Rele

(seatunnel) branch 2.3.6-release updated (b42aa79c78 -> 85134cdfca)

2024-07-24 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a change to branch 2.3.6-release in repository https://gitbox.apache.org/repos/asf/seatunnel.git discard b42aa79c78 [Release][2.3.6][release-note] Add release-note add 0d08b20061 [Improve][Connector-v2] Optim

Re: [PR] [Feature] [Activemq] Added activemq sink [seatunnel]

2024-07-24 Thread via GitHub
Hisoka-X commented on code in PR #7251: URL: https://github.com/apache/seatunnel/pull/7251#discussion_r1690714434 ## seatunnel-connectors-v2/connector-activemq/src/main/java/org/apache/seatunnel/connectors/seatunnel/activemq/sink/ActivemqSink.java: ## @@ -0,0 +1,80 @@ +/* + * Li

Re: [PR] [Bug] [connector-cdc-oracle] fix issue 6680: Oracle CDC : Can not find catalog table with factoryId [Oracle] [seatunnel]

2024-07-24 Thread via GitHub
Hisoka-X commented on PR #7258: URL: https://github.com/apache/seatunnel/pull/7258#issuecomment-2249259382 Thanks @NeoGitCrt1 contribute! Please follow the guide to open CI on your fork repository. ![image](https://github.com/user-attachments/assets/75000b31-1920-4ffa-b772-f4be936294aa)

(seatunnel) branch 2.3.6-release updated: prepare release 2.3.6

2024-07-24 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch 2.3.6-release in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/2.3.6-release by this push: new 69fe65b093 prepare release 2.3.

(seatunnel) branch 2.3.6-release updated (69fe65b093 -> 5866bb2690)

2024-07-24 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a change to branch 2.3.6-release in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 69fe65b093 prepare release 2.3.6 new 4afc289b15 [maven-release-plugin] prepare release 2.3.6 new 5

(seatunnel) 02/02: [maven-release-plugin] prepare for next development iteration

2024-07-24 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch 2.3.6-release in repository https://gitbox.apache.org/repos/asf/seatunnel.git commit 5866bb26908e968bdd16489b7ac49d7182ada2e0 Author: Jia Fan AuthorDate: Thu Jul 25 11:21:46 2024 +0800 [mave

(seatunnel) annotated tag 2.3.6 updated (4afc289b15 -> f08f4d04bf)

2024-07-24 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a change to annotated tag 2.3.6 in repository https://gitbox.apache.org/repos/asf/seatunnel.git *** WARNING: tag 2.3.6 was modified! *** from 4afc289b15 (commit) to f08f4d04bf (tag) tagging 4afc289b158a

[I] [Bug] [Seatunnel Zeta] Job status SCHEDULED [seatunnel]

2024-07-24 Thread via GitHub
sdvdxl opened a new issue, #7263: URL: https://github.com/apache/seatunnel/issues/7263 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[PR] [improve][Transform] DynamicCompile improve transform [seatunnel]

2024-07-24 Thread via GitHub
jacky opened a new pull request, #7264: URL: https://github.com/apache/seatunnel/pull/7264 ### Purpose of this pull request Refactoring some code and adding the path attribute ### Does this PR introduce _any_ user-facing change? ### How

Re: [PR] [improve][Transform] DynamicCompile improve transform [seatunnel]

2024-07-24 Thread via GitHub
jacky commented on code in PR #7264: URL: https://github.com/apache/seatunnel/pull/7264#discussion_r1690895481 ## seatunnel-e2e/seatunnel-e2e-common/src/test/java/org/apache/seatunnel/e2e/common/container/TestContainer.java: ## @@ -55,4 +55,6 @@ default Container.ExecRes