[PR] [Feature][Connector] update sqlserver catalog for save mode [seatunnel]

2023-12-25 Thread via GitHub
chl-wxp opened a new pull request, #6086: URL: https://github.com/apache/seatunnel/pull/6086 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list * [

Re: [PR] [Fix] [Connectors-v2-file-ftp] FTP source|sink add ftp connection mode (#6077) [seatunnel]

2023-12-25 Thread via GitHub
CheneyYin commented on PR #6084: URL: https://github.com/apache/seatunnel/pull/6084#issuecomment-1869335609 Maybe we also need to add test cases to verify that the new parameter `active_mode_status` works. -- This is an automated message from the Apache Git Service. To respond to the mes

[PR] [Feature] Support SaveMode on Doris [seatunnel]

2023-12-25 Thread via GitHub
Hisoka-X opened a new pull request, #6085: URL: https://github.com/apache/seatunnel/pull/6085 ### Purpose of this pull request This PR add savemode feature on doris ### Does this PR introduce _any_ user-facing change? no ### How was this patch teste

Re: [I] [OnlineMeeting&Dec.14] SeaTunnel community meeting Topic collection [seatunnel]

2023-12-25 Thread via GitHub
KangTomwk commented on issue #6053: URL: https://github.com/apache/seatunnel/issues/6053#issuecomment-1869334642 Could you please pay attention to this https://github.com/apache/seatunnel/issues/5700 -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [I] [OnlineMeeting&Dec.14] SeaTunnel community meeting Topic collection [seatunnel]

2023-12-25 Thread via GitHub
KangTomwk commented on issue #6053: URL: https://github.com/apache/seatunnel/issues/6053#issuecomment-1869330174 Could you please pay attention to this https://github.com/apache/seatunnel/issues/6053 -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [I] java.util.LinkedHashMap cannot be cast to java.util.ArrayList [seatunnel]

2023-12-25 Thread via GitHub
hailin0 commented on issue #5700: URL: https://github.com/apache/seatunnel/issues/5700#issuecomment-1869328793 > 2.3.3源码执行seatunnel-examples seatunnel-engine-examples遇到了同样的问题 盼望尽快解决 Please add your job config to this issue -- This is an automated message from the Apache Git Service.

[PR] [Fix] [Connectors-v2-file-ftp] FTP source|sink add ftp connection mode (#6077) [seatunnel]

2023-12-25 Thread via GitHub
WilliamTan778 opened a new pull request, #6084: URL: https://github.com/apache/seatunnel/pull/6084 [Fix] [Connectors-v2-file-ftp] FTP source|sink add ftp connection mode (#6077) ### Purpose of this pull request ### Does this PR introduce _any_ user-facing ch

Re: [PR] [Fix] [Connectors-v2-file-ftp] FTP source|sink add ftp connection mode (#6077) [seatunnel]

2023-12-25 Thread via GitHub
WilliamTan778 closed pull request #6083: [Fix] [Connectors-v2-file-ftp] FTP source|sink add ftp connection mode (#6077) URL: https://github.com/apache/seatunnel/pull/6083 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[PR] [Fix] [Connectors-v2-file-ftp] FTP source|sink add ftp connection mode (#6077) [seatunnel]

2023-12-25 Thread via GitHub
WilliamTan778 opened a new pull request, #6083: URL: https://github.com/apache/seatunnel/pull/6083 issues: https://github.com/apache/seatunnel/issues/6077 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change?

Re: [PR] [Improve] improve avro format convert [seatunnel]

2023-12-25 Thread via GitHub
zhilinli123 commented on PR #6082: URL: https://github.com/apache/seatunnel/pull/6082#issuecomment-1869274972 Add end to end data End to end test , refer to checkDebeziumFormat() https://github.com/liunaijie/seatunnel/blob/avro-array/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-ka

[PR] [Improve] improve avro format convert [seatunnel]

2023-12-25 Thread via GitHub
liunaijie opened a new pull request, #6082: URL: https://github.com/apache/seatunnel/pull/6082 ### Purpose of this pull request improve the avro format array convert ### Does this PR introduce _any_ user-facing change? ### How was this patch tested?

Re: [PR] [Feature][Connector] update pgsql catalog for save mode [seatunnel]

2023-12-25 Thread via GitHub
EricJoy2048 commented on code in PR #6080: URL: https://github.com/apache/seatunnel/pull/6080#discussion_r1436247824 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-3/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/JdbcPostgresIT.java:

Re: [I] [Bug] [FTP] FTP SOURCE Unable to return file list under FTP path in the code & FTP SINK NOT CONFIG ROOT PATH [seatunnel]

2023-12-25 Thread via GitHub
WilliamTan778 closed issue #6077: [Bug] [FTP] FTP SOURCE Unable to return file list under FTP path in the code & FTP SINK NOT CONFIG ROOT PATH URL: https://github.com/apache/seatunnel/issues/6077 -- This is an automated message from the Apache Git Service. To respond to the message, please lo

(seatunnel) branch dev updated: [Hotfix][Zeta] Fix zeta scheduler bug (#6050)

2023-12-25 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 5ff4395dbe [Hotfix][Zeta] Fix zeta scheduler bu

Re: [PR] [Hotfix][Zeta] Fix zeta scheduler bug [seatunnel]

2023-12-25 Thread via GitHub
hailin0 merged PR #6050: URL: https://github.com/apache/seatunnel/pull/6050 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Feature][Connector-v2][PulsarSink]Add Pulsar Sink Connector. [seatunnel]

2023-12-25 Thread via GitHub
hailin0 commented on code in PR #4382: URL: https://github.com/apache/seatunnel/pull/4382#discussion_r1436208092 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-pulsar-e2e/src/test/resources/fake_to_pulsar.conf: ## @@ -0,0 +1,66 @@ +# +# Licensed to the Apache Software Fou

Re: [PR] [Feature][Connector] update pgsql catalog for save mode [seatunnel]

2023-12-25 Thread via GitHub
chl-wxp commented on code in PR #6080: URL: https://github.com/apache/seatunnel/pull/6080#discussion_r1436206876 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-3/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/JdbcPostgresIT.java: ###

Re: [PR] [BUG] [FTP] FTP SOURCE Unable to return file list under FTP path in the code & FTP SINK NOT CONFIG ROOT PATH [seatunnel]

2023-12-25 Thread via GitHub
WilliamTan778 closed pull request #6078: [BUG] [FTP] FTP SOURCE Unable to return file list under FTP path in the code & FTP SINK NOT CONFIG ROOT PATH URL: https://github.com/apache/seatunnel/pull/6078 -- This is an automated message from the Apache Git Service. To respond to the message, plea

Re: [PR] [Feature][Connector] update pgsql catalog for save mode [seatunnel]

2023-12-25 Thread via GitHub
hailin0 commented on code in PR #6080: URL: https://github.com/apache/seatunnel/pull/6080#discussion_r1436202388 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-3/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/JdbcPostgresIT.java: ###

Re: [PR] [Feature][Connector-V2][PostgresSql] add JDBC source support string type as partition key [seatunnel]

2023-12-25 Thread via GitHub
hailin0 merged PR #6079: URL: https://github.com/apache/seatunnel/pull/6079 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Feature][Connector-V2][PostgresSql] add JDBC source support string type as partition key (#6079)

2023-12-25 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 3522eb157c [Feature][Connector-V2][PostgresSql]

[I] [Feature][Connector-V2] Some optimization suggestions for JDBC source support for string types as partitioning keys [seatunnel]

2023-12-25 Thread via GitHub
2416210017 opened a new issue, #5432: URL: https://github.com/apache/seatunnel/issues/5432 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Feature][Connector-V2][PostgresSql] add JDBC source support string type as partition key [seatunnel]

2023-12-25 Thread via GitHub
zhilinli123 commented on PR #6079: URL: https://github.com/apache/seatunnel/pull/6079#issuecomment-1869197761 PTAL: @Hisoka-X -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[PR] (feature)(rest api) add get log info api. [seatunnel]

2023-12-25 Thread via GitHub
liugddx opened a new pull request, #6081: URL: https://github.com/apache/seatunnel/pull/6081 ### Purpose of this pull request add get log info api. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested?

Re: [I] [Bug] [connector-kafka] kafka sink error when set semantics = EXACTLY_ONCE [seatunnel]

2023-12-25 Thread via GitHub
github-actions[bot] closed issue #5836: [Bug] [connector-kafka] kafka sink error when set semantics = EXACTLY_ONCE URL: https://github.com/apache/seatunnel/issues/5836 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [I] [Bug] [connector-kafka] kafka sink error when set semantics = EXACTLY_ONCE [seatunnel]

2023-12-25 Thread via GitHub
github-actions[bot] commented on issue #5836: URL: https://github.com/apache/seatunnel/issues/5836#issuecomment-1869164915 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] [connector-file-base] Error "write data to orc file error" will happen in OrcWriteStrategy.class when sink table without partition column [seatunnel]

2023-12-25 Thread via GitHub
github-actions[bot] commented on issue #5863: URL: https://github.com/apache/seatunnel/issues/5863#issuecomment-1869164892 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] [connector-file-base] Error "write data to orc file error" will happen in OrcWriteStrategy.class when sink table without partition column [seatunnel]

2023-12-25 Thread via GitHub
github-actions[bot] closed issue #5863: [Bug] [connector-file-base] Error "write data to orc file error" will happen in OrcWriteStrategy.class when sink table without partition column URL: https://github.com/apache/seatunnel/issues/5863 -- This is an automated message from the Apache Git Ser

[PR] [Feature][Connector] update pgsql catalog for save mode [seatunnel]

2023-12-25 Thread via GitHub
chl-wxp opened a new pull request, #6080: URL: https://github.com/apache/seatunnel/pull/6080 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list * [

Re: [I] [Bug] [connector-cdc-postgres] Table public.postgres_cdc_table_1 does not exist in Catalog Postgres [seatunnel]

2023-12-25 Thread via GitHub
Carl-Zhou-CN commented on issue #6043: URL: https://github.com/apache/seatunnel/issues/6043#issuecomment-1868942247 Using SeaTunnelEngineExample testing requires adding a dependency to the pom ![image](https://github.com/apache/seatunnel/assets/67902676/9a307f0b-b5f0-47a6-b9a6-d79ca1bc121

Re: [I] [Bug] [connector-jdbc] OracleCatalog's SELECT_COLUMNS_SQL_TEMPLATE have some COLUMN_LENGTH issue when the column‘s type is NVARCHAR2 or NCHAR [seatunnel]

2023-12-25 Thread via GitHub
Carl-Zhou-CN commented on issue #6054: URL: https://github.com/apache/seatunnel/issues/6054#issuecomment-1868940368 > > @LoverAndrew hi, are you willing to contribute a pr to fix it? > > Certainly, but I don't know the process of contribute. Could you guide me the process? Of cours

Re: [I] [Bug] [connector-jdbc] OracleCatalog's SELECT_COLUMNS_SQL_TEMPLATE have some COLUMN_LENGTH issue when the column‘s type is NVARCHAR2 or NCHAR [seatunnel]

2023-12-25 Thread via GitHub
Carl-Zhou-CN commented on issue #6054: URL: https://github.com/apache/seatunnel/issues/6054#issuecomment-1868938857 Chinese document reference `https://mp.weixin.qq.com/s/wOVxNjg-tSQeenUY5Sd7kQ` -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [I] [Bug] [connector-cdc-postgres] Table public.postgres_cdc_table_1 does not exist in Catalog Postgres [seatunnel]

2023-12-25 Thread via GitHub
Carl-Zhou-CN commented on issue #6043: URL: https://github.com/apache/seatunnel/issues/6043#issuecomment-1868937224 > Is 2.3.4 going to be updated soon? Do you know if pg-cdc is supported and when? Will be updated recently, pg cdc is in release planning,I updated the pg-cdc code so y

Re: [I] [Bug] [connector-jdbc] OracleCatalog's SELECT_COLUMNS_SQL_TEMPLATE have some COLUMN_LENGTH issue when the column‘s type is NVARCHAR2 or NCHAR [seatunnel]

2023-12-25 Thread via GitHub
Carl-Zhou-CN commented on issue #6054: URL: https://github.com/apache/seatunnel/issues/6054#issuecomment-1868934542 Chinese document reference `https://mp.weixin.qq.com/s/wOVxNjg-tSQeenUY5Sd7kQ` -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [Fix] [Connectors-v2-file-ftp] Unable to return file list under FTP path (#6070) [seatunnel]

2023-12-25 Thread via GitHub
WilliamTan778 closed pull request #6072: [Fix] [Connectors-v2-file-ftp] Unable to return file list under FTP path (#6070) URL: https://github.com/apache/seatunnel/pull/6072 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[PR] [Feature][Connector-V2][PostgresSql] add JDBC source support string type as partition key [seatunnel]

2023-12-25 Thread via GitHub
zhilinli123 opened a new pull request, #6079: URL: https://github.com/apache/seatunnel/pull/6079 …ype as partition key pre pr:https://github.com/apache/seatunnel/pull/4947/files ### Purpose of this pull request ### Does this PR introduce _any_ user-facing chan

Re: [I] [Bug] [connector-cdc-postgres] Table public.postgres_cdc_table_1 does not exist in Catalog Postgres [seatunnel]

2023-12-25 Thread via GitHub
czb2021 commented on issue #6043: URL: https://github.com/apache/seatunnel/issues/6043#issuecomment-1868901097 Is 2.3.4 going to be updated soon? Do you know if pg-cdc is supported and when? -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [I] [Bug] [connector-cdc-postgres] Table public.postgres_cdc_table_1 does not exist in Catalog Postgres [seatunnel]

2023-12-25 Thread via GitHub
czb2021 commented on issue #6043: URL: https://github.com/apache/seatunnel/issues/6043#issuecomment-1868899672 > What version of the code are you using? Use the code of your pg-cdc branch ![微信截图_20231225175715](https://github.com/apache/seatunnel/assets/135789126/65e392e1-8a81-4700

[PR] [BUG] [FTP] FTP SOURCE Unable to return file list under FTP path in the code & FTP SINK NOT CONFIG ROOT PATH [seatunnel]

2023-12-25 Thread via GitHub
WilliamTan778 opened a new pull request, #6078: URL: https://github.com/apache/seatunnel/pull/6078 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

[I] [Bug] [Module Name] Bug title [seatunnel]

2023-12-25 Thread via GitHub
WilliamTan778 opened a new issue, #6077: URL: https://github.com/apache/seatunnel/issues/6077 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happ

Re: [I] [Bug] [FTP SOURCE] FTP SOURCE Unable to return file list under FTP path in the code & FTP SINK NOT CONFIG ROOT PATH [seatunnel]

2023-12-25 Thread via GitHub
WilliamTan778 closed issue #6070: [Bug] [FTP SOURCE] FTP SOURCE Unable to return file list under FTP path in the code & FTP SINK NOT CONFIG ROOT PATH URL: https://github.com/apache/seatunnel/issues/6070 -- This is an automated message from the Apache Git Service. To respond to the message, pl

Re: [I] [Bug] [connectoer v2 sink clickhouse] mysql cdc -> clickhnouse [seatunnel]

2023-12-25 Thread via GitHub
spihiker closed issue #6014: [Bug] [connectoer v2 sink clickhouse] mysql cdc -> clickhnouse URL: https://github.com/apache/seatunnel/issues/6014 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] [Bug] [connectoer v2 sink clickhouse] mysql cdc -> clickhnouse [seatunnel]

2023-12-25 Thread via GitHub
spihiker commented on issue #6014: URL: https://github.com/apache/seatunnel/issues/6014#issuecomment-1868865596 Thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[PR] [Feature][Connectors-v2-Paimon] Support Date&Time Data Type To Be Flink Int [seatunnel]

2023-12-25 Thread via GitHub
SimonChou12138 opened a new pull request, #6076: URL: https://github.com/apache/seatunnel/pull/6076 ### Purpose of this pull request Implement Feature https://github.com/apache/seatunnel/issues/6075 ### Does this PR introduce _any_ user-facing change? without

[I] [Feature][Connectors-v2-Paimon] Support Date&Time Data Type Be Flink Int [seatunnel]

2023-12-25 Thread via GitHub
SimonChou12138 opened a new issue, #6075: URL: https://github.com/apache/seatunnel/issues/6075 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.