Re: [PR] [Bug] [connector-jdbc] Nullable Column source have null data could be unexpected results. [seatunnel]

2023-10-26 Thread via GitHub
mosence commented on PR #5560: URL: https://github.com/apache/seatunnel/pull/5560#issuecomment-1782393752 > BTW, we should make sure #5734 be merged ASAP. Yeah, I agree for you. The data consistency of integrated tools is quite important. -- This is an automated message from the Apac

Re: [I] checkpoint timeout [seatunnel]

2023-10-26 Thread via GitHub
happyboy1024 commented on issue #: URL: https://github.com/apache/seatunnel/issues/#issuecomment-1782392137 > > Refer to #5694. Try to use the latest code. > > I use the latest code and recompile, it still occur timeout error You can try to set the 'partition_column' and

Re: [PR] [Bug] [connector-jdbc] Nullable Column source have null data could be unexpected results. [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on PR #5560: URL: https://github.com/apache/seatunnel/pull/5560#issuecomment-1782388331 BTW, we should make sure #5734 be merged ASAP. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [Bug] [connector-jdbc] Nullable Column source have null data could be unexpected results. [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on PR #5560: URL: https://github.com/apache/seatunnel/pull/5560#issuecomment-1782378845 Waiting CI pass -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [I] [Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on connector [seatunnel]

2023-10-26 Thread via GitHub
chl-wxp commented on issue #5651: URL: https://github.com/apache/seatunnel/issues/5651#issuecomment-1782374012 Please assign me (S3Redshift sink,S3File sink) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] [Bug] [connector-jdbc] Nullable Column source have null data could be unexpected results. [seatunnel]

2023-10-26 Thread via GitHub
mosence commented on code in PR #5560: URL: https://github.com/apache/seatunnel/pull/5560#discussion_r1374125329 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/utils/JdbcUtils.java: ## @@ -0,0 +1,155 @@ +/* + * Licensed to

Re: [PR] [Bug] [connector-jdbc] Nullable Column source have null data could be unexpected results. [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on code in PR #5560: URL: https://github.com/apache/seatunnel/pull/5560#discussion_r1374123956 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/utils/JdbcUtils.java: ## @@ -0,0 +1,155 @@ +/* + * Licensed to

Re: [PR] [Bug] [connector-jdbc] Nullable Column source have null data could be unexpected results. [seatunnel]

2023-10-26 Thread via GitHub
mosence commented on PR #5560: URL: https://github.com/apache/seatunnel/pull/5560#issuecomment-1782366780 > Could you push the test case code? So that we can find the problem with you. I add test case code in PR #5734. -- This is an automated message from the Apache Git Service. To

[PR] [Test][e2e] Jdbc test need some case checking data consistency. [seatunnel]

2023-10-26 Thread via GitHub
mosence opened a new pull request, #5734: URL: https://github.com/apache/seatunnel/pull/5734 ### Purpose of this pull request Base on PR #5560 add e2e test case. Issues #5623 . ### Does this PR introduce _any_ user-facing change? ### How was this p

Re: [I] [Bug] [seatunnel engine] rest-api post task always fail [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X closed issue #5691: [Bug] [seatunnel engine] rest-api post task always fail URL: https://github.com/apache/seatunnel/issues/5691 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [I] [Bug] [Zeta Engine] the checkpoint lock cause checkpoint-flow blocking with long time [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on issue #5694: URL: https://github.com/apache/seatunnel/issues/5694#issuecomment-1782365116 Fixed by #5695 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [I] [Bug] [Zeta Engine] the checkpoint lock cause checkpoint-flow blocking with long time [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X closed issue #5694: [Bug] [Zeta Engine] the checkpoint lock cause checkpoint-flow blocking with long time URL: https://github.com/apache/seatunnel/issues/5694 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [I] [Bug] [seatunnel engine] rest-api post task always fail [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on issue #5691: URL: https://github.com/apache/seatunnel/issues/5691#issuecomment-1782364588 Fixed by https://github.com/apache/seatunnel/pull/5702 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] [Bug] [Rest-API] submit job api has some issue [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on issue #5699: URL: https://github.com/apache/seatunnel/issues/5699#issuecomment-1782364408 > #5691 has been fixed? @QiuZiXian It should be fixed by #5702 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[seatunnel] branch dev updated: [Improve] Added Table of Contents and FAQs to README (#5693)

2023-10-26 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new a8f6b18588 [Improve] Added Table of Contents an

Re: [PR] [Improve] Added Table of Contents and FAQs to README [seatunnel]

2023-10-26 Thread via GitHub
hailin0 merged PR #5693: URL: https://github.com/apache/seatunnel/pull/5693 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

[seatunnel] branch dev updated: [BUG][Connector-V2][Jdbc] support postgresql xml type (#5724)

2023-10-26 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 5f5d4da13f [BUG][Connector-V2][Jdbc] support po

Re: [I] [BUG][Connector-V2][Jdbc] not support postgresql xml type [seatunnel]

2023-10-26 Thread via GitHub
hailin0 closed issue #5733: [BUG][Connector-V2][Jdbc] not support postgresql xml type URL: https://github.com/apache/seatunnel/issues/5733 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] [BUG][Connector-V2][Jdbc] support postgresql xml type [seatunnel]

2023-10-26 Thread via GitHub
hailin0 merged PR #5724: URL: https://github.com/apache/seatunnel/pull/5724 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [BUG][Connector-V2][Jdbc] support postgresql xml type [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on PR #5724: URL: https://github.com/apache/seatunnel/pull/5724#issuecomment-1782356141 Thanks @jacky -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] [BUG][Connector-V2][Jdbc] support postgresql xml type [seatunnel]

2023-10-26 Thread via GitHub
jacky commented on PR #5724: URL: https://github.com/apache/seatunnel/pull/5724#issuecomment-1782350280 > Thanks for fix bug @jacky . Would you mind add some comment for this PR to make sure reviewer know it what want to do? ok > Thanks for fix bug @jackyss

[I] [BUG][Connector-V2][Jdbc] not support postgresql xml type [seatunnel]

2023-10-26 Thread via GitHub
jacky opened a new issue, #5733: URL: https://github.com/apache/seatunnel/issues/5733 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happ

Re: [PR] [feature][connector-jdbc]Add Save Mode function and Connector-JDBC (MySQL) connector has been realized [seatunnel]

2023-10-26 Thread via GitHub
hailin0 commented on code in PR #5663: URL: https://github.com/apache/seatunnel/pull/5663#discussion_r1374106896 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-7/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/JdbcMysqlSaveModeHandler

[seatunnel] branch dev updated (879c2aa07c -> 55aca8e47d)

2023-10-26 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 879c2aa07c [Improve][E2E][Jdbc] Enable IT case for Oceanbase Mysql mode (#5697) add 55aca8e47d [Improve] load dr

Re: [PR] [Improve][E2E][Jdbc] Load driver class from url on demand [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X merged PR #5712: URL: https://github.com/apache/seatunnel/pull/5712 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [BUG][Connector-V2][Jdbc] support postgresql xml type [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on PR #5724: URL: https://github.com/apache/seatunnel/pull/5724#issuecomment-1782330702 Thanks for fix bug @jacky . Would you mind add some comment for this PR to make sure reviewer know it what want to do? ![image](https://github.com/apache/seatunnel/assets/3

[seatunnel] branch dev updated (9980aa44d2 -> 879c2aa07c)

2023-10-26 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 9980aa44d2 [Fix][Rest-API] fix submit job api (#5702) add 879c2aa07c [Improve][E2E][Jdbc] Enable IT case for Oc

Re: [PR] [Improve][E2E][Jdbc] Enable IT case for Oceanbase Mysql mode [seatunnel]

2023-10-26 Thread via GitHub
wuchunfu merged PR #5697: URL: https://github.com/apache/seatunnel/pull/5697 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [feature][connector-jdbc]Add Save Mode function and Connector-JDBC (MySQL) connector has been realized [seatunnel]

2023-10-26 Thread via GitHub
chl-wxp commented on code in PR #5663: URL: https://github.com/apache/seatunnel/pull/5663#discussion_r1374048315 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-7/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/JdbcMysqlSaveModeHandler

Re: [PR] [Fix] Fix PG will not create index when using auto create table [seatunnel]

2023-10-26 Thread via GitHub
whhe commented on code in PR #5721: URL: https://github.com/apache/seatunnel/pull/5721#discussion_r1374045067 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/catalog/psql/PostgresCatalog.java: ## @@ -186,8 +188,44 @@ protect

Re: [PR] [Improve][E2E][Jdbc] Load driver class from url on demand [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on code in PR #5712: URL: https://github.com/apache/seatunnel/pull/5712#discussion_r1374040560 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-common/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/AbstractJdbcIT.java: ##

Re: [PR] [Improve][E2E][Jdbc] Enable IT case for Oceanbase Mysql mode [seatunnel]

2023-10-26 Thread via GitHub
whhe commented on PR #5697: URL: https://github.com/apache/seatunnel/pull/5697#issuecomment-1782242496 Test passed after increasing the startup timeout and reducing the disk usage, PTAL @Hisoka-X @wuchunfu -- This is an automated message from the Apache Git Service. To respond to the mes

Re: [PR] [Feature][Oracle] Support XMLTYPE data integration #5716 [seatunnel]

2023-10-26 Thread via GitHub
SimonChou12138 commented on PR #5723: URL: https://github.com/apache/seatunnel/pull/5723#issuecomment-1782241362 > Could you add a e2e test case for this feature? Sure. I'll add one later -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [Improve][E2E][Jdbc] Load driver class from url on demand [seatunnel]

2023-10-26 Thread via GitHub
whhe commented on code in PR #5712: URL: https://github.com/apache/seatunnel/pull/5712#discussion_r1374039161 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-common/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/AbstractJdbcIT.java: ##

Re: [PR] [Feature][Oracle] Support XMLTYPE data integration #5716 [seatunnel]

2023-10-26 Thread via GitHub
SimonChou12138 commented on PR #5723: URL: https://github.com/apache/seatunnel/pull/5723#issuecomment-1782236007 @Hisoka-X Hello guys, can you help review this code? This checks has been cancelled. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [I] [Feature][Http] Http paramter support custom encryption [seatunnel]

2023-10-26 Thread via GitHub
xiaofan2022 commented on issue #5563: URL: https://github.com/apache/seatunnel/issues/5563#issuecomment-1782233898 #5727 I understand when configuration file encryption, I want http components can customize parameter encryption for oauth auth -- This is an automated message from the Apach

Re: [PR] [Improve][E2E][Jdbc] Load driver class from url on demand [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on code in PR #5712: URL: https://github.com/apache/seatunnel/pull/5712#discussion_r1374033255 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-common/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/AbstractJdbcIT.java: ##

Re: [PR] [Catalog][DM][Improve] dm catalog and dm auto create table and auto create table add constraintKey [seatunnel]

2023-10-26 Thread via GitHub
whhe commented on code in PR #5572: URL: https://github.com/apache/seatunnel/pull/5572#discussion_r1374029457 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/catalog/AbstractJdbcCreateTableSqlBuilder.java: ## @@ -0,0 +1,43 @

Re: [PR] [Feature][Http] Http paramter support custom encryption [seatunnel]

2023-10-26 Thread via GitHub
zhibinF commented on PR #5727: URL: https://github.com/apache/seatunnel/pull/5727#issuecomment-1782210327 Let me check it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] [feature][connector-jdbc]Add Save Mode function and Connector-JDBC (MySQL) connector has been realized [seatunnel]

2023-10-26 Thread via GitHub
chl-wxp commented on code in PR #5663: URL: https://github.com/apache/seatunnel/pull/5663#discussion_r1374017763 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-7/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/JdbcMysqlSaveModeHandler

Re: [PR] [Improve][E2E][Jdbc] Load driver class from url on demand [seatunnel]

2023-10-26 Thread via GitHub
whhe commented on code in PR #5712: URL: https://github.com/apache/seatunnel/pull/5712#discussion_r1374016364 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-common/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/AbstractJdbcIT.java: ##

Re: [PR] [Improve][E2E][Jdbc] Load driver class from url on demand [seatunnel]

2023-10-26 Thread via GitHub
whhe commented on code in PR #5712: URL: https://github.com/apache/seatunnel/pull/5712#discussion_r1374016364 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-common/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/AbstractJdbcIT.java: ##

Re: [PR] [Feature][Http] Http paramter support custom encryption [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on PR #5727: URL: https://github.com/apache/seatunnel/pull/5727#issuecomment-1782203067 Please resolve conflict. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] [Feature][Http] Http paramter support custom encryption [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on PR #5727: URL: https://github.com/apache/seatunnel/pull/5727#issuecomment-1782201567 cc @liugddx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [I] [Feature][Doris] Support multi-table source read [seatunnel]

2023-10-26 Thread via GitHub
hailin0 commented on issue #5731: URL: https://github.com/apache/seatunnel/issues/5731#issuecomment-1782197455 @CodingGPT Please comment this issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] [Feature][Connector-V2] Support multi-table source feature [seatunnel]

2023-10-26 Thread via GitHub
hailin0 commented on issue #5677: URL: https://github.com/apache/seatunnel/issues/5677#issuecomment-1782196786 > [Feature][Kudu] Support multi-table source read #5714 @CodingGPT Please comment this issue https://github.com/apache/seatunnel/issues/5731 -- This is an automated

[seatunnel] branch dev updated: [Fix][Rest-API] fix submit job api (#5702)

2023-10-26 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 9980aa44d2 [Fix][Rest-API] fix submit job api (#570

Re: [I] [Bug] [Rest-API] submit job api has some issue [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X closed issue #5699: [Bug] [Rest-API] submit job api has some issue URL: https://github.com/apache/seatunnel/issues/5699 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [Fix][Rest-API] fix submit job api [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X merged PR #5702: URL: https://github.com/apache/seatunnel/pull/5702 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [feature][connector-jdbc]Add Save Mode function and Connector-JDBC (MySQL) connector has been realized [seatunnel]

2023-10-26 Thread via GitHub
chl-wxp commented on code in PR #5663: URL: https://github.com/apache/seatunnel/pull/5663#discussion_r1374009095 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-7/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/JdbcMysqlSaveModeHandler

Re: [PR] [feature][connector-jdbc]Add Save Mode function and Connector-JDBC (MySQL) connector has been realized [seatunnel]

2023-10-26 Thread via GitHub
chl-wxp commented on code in PR #5663: URL: https://github.com/apache/seatunnel/pull/5663#discussion_r1374008742 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/sink/JdbcSinkFactory.java: ## @@ -89,38 +96,87 @@ private Reado

Re: [PR] [BUG][Connector-V2] Iceberg source lost data with parallelism option [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on PR #5732: URL: https://github.com/apache/seatunnel/pull/5732#issuecomment-1782191707 @ic4y -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[PR] [BUG][Connector-V2] Iceberg source lost data with parallelism option [seatunnel]

2023-10-26 Thread via GitHub
kangdw0x80 opened a new pull request, #5732: URL: https://github.com/apache/seatunnel/pull/5732 ### Purpose of this pull request Fix https://github.com/apache/seatunnel/issues/5661 ### Does this PR introduce _any_ user-facing change? No ### How was

[I] [Feature][Doris] Support multi-table source read [seatunnel]

2023-10-26 Thread via GitHub
hailin0 opened a new issue, #5731: URL: https://github.com/apache/seatunnel/issues/5731 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

[I] [Feature][Schema] Support configure multiple schema for one source. [seatunnel]

2023-10-26 Thread via GitHub
ruanwenjun opened a new issue, #5730: URL: https://github.com/apache/seatunnel/issues/5730 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] checkpoint timeout [seatunnel]

2023-10-26 Thread via GitHub
SamealD commented on issue #: URL: https://github.com/apache/seatunnel/issues/#issuecomment-1782179088 > Refer to #5694. Try to use the latest code. I use the latest code and recompile, it still occur timeout error -- This is an automated message from the Apache Git Service.

[PR] [BUG][Connector-V2][Iceberg] Iceberg source connector lost data with … [seatunnel]

2023-10-26 Thread via GitHub
kangdw0x80 opened a new pull request, #5729: URL: https://github.com/apache/seatunnel/pull/5729 ### Purpose of this pull request Fix https://github.com/apache/seatunnel/issues/5661 ### Does this PR introduce _any_ user-facing change? No ### How was

Re: [PR] [BUG][Connector-V2][Iceberg] Iceberg source connector lost data with … [seatunnel]

2023-10-26 Thread via GitHub
kangdw0x80 closed pull request #5729: [BUG][Connector-V2][Iceberg] Iceberg source connector lost data with … URL: https://github.com/apache/seatunnel/pull/5729 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] [Improve][E2E][Jdbc] Load driver class from url on demand [seatunnel]

2023-10-26 Thread via GitHub
Hisoka-X commented on code in PR #5712: URL: https://github.com/apache/seatunnel/pull/5712#discussion_r1373994787 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-common/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/AbstractJdbcIT.java: ##

Re: [I] [Bug] [Iceberg] Iceberg Source use multiple parallelism encountering lost data [seatunnel]

2023-10-26 Thread via GitHub
kangdw0x80 commented on issue #5661: URL: https://github.com/apache/seatunnel/issues/5661#issuecomment-1782165775 It is a bug. Iceberg Connector assign files to multiple reader with path information (in addPendingSplits function) - (https://github.com/apache/seatunnel/blob/dev/seatun

[seatunnel] branch dev updated: [Fix] Fix MultiTableSink return committer but sink do not support (#5710)

2023-10-26 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new c413040a6e [Fix] Fix MultiTableSink return commit

Re: [PR] [Fix] Fix MultiTableSink return committer but sink do not support [seatunnel]

2023-10-26 Thread via GitHub
wuchunfu merged PR #5710: URL: https://github.com/apache/seatunnel/pull/5710 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [I] [Bug] [connector-file-sftp] run on flink cannot assign instance of java.lang.invoke.SerializedLambda [seatunnel]

2023-10-26 Thread via GitHub
github-actions[bot] closed issue #5473: [Bug] [connector-file-sftp] run on flink cannot assign instance of java.lang.invoke.SerializedLambda URL: https://github.com/apache/seatunnel/issues/5473 -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [I] [Bug] [SqlserverCDC Source] Sqlserver CDC Don't support SqlSever type 'varbinary' yet, jdbcType:'-3'. [seatunnel]

2023-10-26 Thread via GitHub
github-actions[bot] commented on issue #5544: URL: https://github.com/apache/seatunnel/issues/5544#issuecomment-1782108196 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [Phoenix] Phoenix2doirs-batch [seatunnel]

2023-10-26 Thread via GitHub
github-actions[bot] commented on issue #5553: URL: https://github.com/apache/seatunnel/issues/5553#issuecomment-1782108167 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [connector-file-sftp] run on flink cannot assign instance of java.lang.invoke.SerializedLambda [seatunnel]

2023-10-26 Thread via GitHub
github-actions[bot] commented on issue #5473: URL: https://github.com/apache/seatunnel/issues/5473#issuecomment-1782108279 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Feature][Hive] support rcfile [seatunnel]

2023-10-26 Thread via GitHub
melin commented on issue #5711: URL: https://github.com/apache/seatunnel/issues/5711#issuecomment-1781367728 > orc file? No, RCFILE: https://cwiki.apache.org/confluence/display/Hive/RCFile -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [Feature][Http] Http paramter support custom encryption [seatunnel]

2023-10-26 Thread via GitHub
zhibinF commented on PR #5727: URL: https://github.com/apache/seatunnel/pull/5727#issuecomment-1781350069 @liugddx @xiaofan2022 PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[PR] [Feature][Http] Http paramter support custom encryption [seatunnel]

2023-10-26 Thread via GitHub
zhibinF opened a new pull request, #5727: URL: https://github.com/apache/seatunnel/pull/5727 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list * [

Re: [PR] [Spark streaming] fix spark streaming [seatunnel]

2023-10-26 Thread via GitHub
laglangyue closed pull request #4713: [Spark streaming] fix spark streaming URL: https://github.com/apache/seatunnel/pull/4713 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [I] [Feature][Hive] support rcfile [seatunnel]

2023-10-26 Thread via GitHub
laglangyue commented on issue #5711: URL: https://github.com/apache/seatunnel/issues/5711#issuecomment-1781342275 orc file? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] [Feature][Connector-V2] Support multi-table source feature [seatunnel]

2023-10-26 Thread via GitHub
CodingGPT commented on issue #5677: URL: https://github.com/apache/seatunnel/issues/5677#issuecomment-1781334442 doris starrocks please assign to me, tks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [Core][Spark] remove duplicate properties,and add OriginalParameters [seatunnel]

2023-10-26 Thread via GitHub
laglangyue commented on PR #5226: URL: https://github.com/apache/seatunnel/pull/5226#issuecomment-1781328059 > Please merge dev branch into your branch and trigger CI/CD. BTW, remove master/deploy-mode/name config from command class it's not right, because it has two-layer analysis.

Re: [PR] [improve] improve datasource class load [seatunnel-web]

2023-10-26 Thread via GitHub
FlechazoW commented on code in PR #141: URL: https://github.com/apache/seatunnel-web/pull/141#discussion_r1373329441 ## seatunnel-datasource/seatunnel-datasource-client/src/main/java/org/apache/seatunnel/datasource/AbstractDataSourceClient.java: ## @@ -126,27 +133,28 @@ public L

Re: [PR] [Improve][Engine] Adjust the sleep mode of flink and spark engine to be consistent with zeta [seatunnel]

2023-10-26 Thread via GitHub
hailin0 commented on PR #5698: URL: https://github.com/apache/seatunnel/pull/5698#issuecomment-1781228980 LGTM cc @EricJoy2048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[I] [Feature][Connector-V2] Support multi-table sink feature for hdfs file [seatunnel]

2023-10-26 Thread via GitHub
dengd1937 opened a new issue, #5726: URL: https://github.com/apache/seatunnel/issues/5726 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] [Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on HdfsFile [seatunnel]

2023-10-26 Thread via GitHub
dengd1937 commented on issue #5725: URL: https://github.com/apache/seatunnel/issues/5725#issuecomment-1781133777 link issue [5651](https://github.com/apache/seatunnel/issues/5651) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[I] [Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on HdfsFile [seatunnel]

2023-10-26 Thread via GitHub
dengd1937 opened a new issue, #5725: URL: https://github.com/apache/seatunnel/issues/5725 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] [Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on connector [seatunnel]

2023-10-26 Thread via GitHub
dengd1937 commented on issue #5651: URL: https://github.com/apache/seatunnel/issues/5651#issuecomment-1781117666 Please assign me HdfsFile Source and Sink -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [I] [Feature][Connector-V2] Support multi-table sink feature [seatunnel]

2023-10-26 Thread via GitHub
dengd1937 commented on issue #5652: URL: https://github.com/apache/seatunnel/issues/5652#issuecomment-1781115987 Please HdfsFile sink task to me, thx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] [feature][connector-jdbc]Add Save Mode function and Connector-JDBC (MySQL) connector has been realized [seatunnel]

2023-10-26 Thread via GitHub
hailin0 commented on code in PR #5663: URL: https://github.com/apache/seatunnel/pull/5663#discussion_r1373160995 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/sink/JdbcSinkFactory.java: ## @@ -89,38 +96,87 @@ private Reado

Re: [PR] [feature][connector-jdbc]Add Save Mode function and Connector-JDBC (MySQL) connector has been realized [seatunnel]

2023-10-26 Thread via GitHub
hailin0 commented on code in PR #5663: URL: https://github.com/apache/seatunnel/pull/5663#discussion_r1373134482 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-7/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/JdbcMysqlSaveModeHandler

Re: [PR] [feature][connector-jdbc]Add Save Mode function and Connector-JDBC (MySQL) connector has been realized [seatunnel]

2023-10-26 Thread via GitHub
hailin0 commented on code in PR #5663: URL: https://github.com/apache/seatunnel/pull/5663#discussion_r1373125601 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/sink/JdbcSinkFactory.java: ## @@ -164,19 +221,23 @@ public Tabl

[PR] [feature] add mongodb datasource [seatunnel-web]

2023-10-26 Thread via GitHub
XiaoJiang521 opened a new pull request, #143: URL: https://github.com/apache/seatunnel-web/pull/143 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary pack

[PR] Main add doris [seatunnel-web]

2023-10-26 Thread via GitHub
XiaoJiang521 opened a new pull request, #142: URL: https://github.com/apache/seatunnel-web/pull/142 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary pack

[PR] [BUG][Connector-V2][Jdbc] support postgresql xml type [seatunnel]

2023-10-26 Thread via GitHub
jacky opened a new pull request, #5724: URL: https://github.com/apache/seatunnel/pull/5724 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

[PR] [improve] improve datasource class load [seatunnel-web]

2023-10-26 Thread via GitHub
XiaoJiang521 opened a new pull request, #141: URL: https://github.com/apache/seatunnel-web/pull/141 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary pack

Re: [I] [Bug] [RestAPi] Error submitting job [seatunnel]

2023-10-26 Thread via GitHub
Ivan-gfan commented on issue #5584: URL: https://github.com/apache/seatunnel/issues/5584#issuecomment-1780918245 The last time this issue occurred, I rebuilt the latest code and found that it worked, but the same issue occurred again today. It can be used in the morning, and the same

Re: [PR] [feature] add doris mongodb mongodbcdc datasource [seatunnel-web]

2023-10-26 Thread via GitHub
EricJoy2048 commented on PR #138: URL: https://github.com/apache/seatunnel-web/pull/138#issuecomment-1780916199 Please split this big pr. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] [feature] add doris mongodb mongodbcdc datasource [seatunnel-web]

2023-10-26 Thread via GitHub
FlechazoW commented on PR #138: URL: https://github.com/apache/seatunnel-web/pull/138#issuecomment-1780909393 Please add these data sources into the script of download_datasource.sh. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [PR] [fit][seatunnel-app] [seatunnel-web]

2023-10-26 Thread via GitHub
EricJoy2048 commented on code in PR #140: URL: https://github.com/apache/seatunnel-web/pull/140#discussion_r1372977186 ## seatunnel-server/seatunnel-app/src/main/java/org/apache/seatunnel/app/service/impl/JobExecutorServiceImpl.java: ## @@ -120,6 +121,7 @@ public Long executeJob

[PR] [Feature][Oracle] Support XMLTYPE data integration #5716 [seatunnel]

2023-10-26 Thread via GitHub
SimonChou12138 opened a new pull request, #5723: URL: https://github.com/apache/seatunnel/pull/5723 ### Purpose of this pull request Implement Feature https://github.com/apache/seatunnel/issues/5716 ### Does this PR introduce _any_ user-facing change? without

[PR] [fit][seatunnel-app] [seatunnel-web]

2023-10-26 Thread via GitHub
dbac opened a new pull request, #140: URL: https://github.com/apache/seatunnel-web/pull/140 Modify configuration file generation path rules to adapt to windows and linux ![image](https://github.com/apache/seatunnel-web/assets/6942177/2d625586-03d5-417e-95b4-a9a871ea3245) -- Thi

[I] [Bug] [CheckPoint] increase checkpoint timeout [seatunnel]

2023-10-26 Thread via GitHub
EngonVHKxZ opened a new issue, #5722: URL: https://github.com/apache/seatunnel/issues/5722 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

[PR] [Fix] Fix PG will not create index by auto create table [seatunnel]

2023-10-26 Thread via GitHub
ruanwenjun opened a new pull request, #5721: URL: https://github.com/apache/seatunnel/pull/5721 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? Test by UT. ### Check li

Re: [I] [Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on kudu [seatunnel]

2023-10-26 Thread via GitHub
Carl-Zhou-CN commented on issue #5720: URL: https://github.com/apache/seatunnel/issues/5720#issuecomment-1780802668 @Hisoka-X -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [I] [Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on connector [seatunnel]

2023-10-26 Thread via GitHub
Carl-Zhou-CN commented on issue #5651: URL: https://github.com/apache/seatunnel/issues/5651#issuecomment-1780801956 > @Carl-Zhou-CN Could you creata a issue for kudu? done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] [Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on kudu [seatunnel]

2023-10-26 Thread via GitHub
Carl-Zhou-CN commented on issue #5720: URL: https://github.com/apache/seatunnel/issues/5720#issuecomment-1780801314 link #5651 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[I] [Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on kudu [seatunnel]

2023-10-26 Thread via GitHub
Carl-Zhou-CN opened a new issue, #5720: URL: https://github.com/apache/seatunnel/issues/5720 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Improve][E2E][Jdbc] Load driver class from url on demand [seatunnel]

2023-10-26 Thread via GitHub
hailin0 commented on code in PR #5712: URL: https://github.com/apache/seatunnel/pull/5712#discussion_r1372906377 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-common/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/AbstractJdbcIT.java: ###

  1   2   >