Re: [I] [Bug] [zeta] java.lang.OutOfMemoryError: Metaspace [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on issue #4915: URL: https://github.com/apache/seatunnel/issues/4915#issuecomment-1982828303 > @Hisoka-X Yes, it's the same source and sink, but it's divided into 22 tasks to execute, each with a parallelism of 1, such as source mysqltable1 to sink pgtable1 Source mysqlta

Re: [I] [Bug] [zeta] java.lang.OutOfMemoryError: Metaspace [seatunnel]

2024-03-06 Thread via GitHub
W-dragan commented on issue #4915: URL: https://github.com/apache/seatunnel/issues/4915#issuecomment-1982820025 @Hisoka-X Yes, it's the same source and sink, but it's divided into 22 tasks to execute, each with a parallelism of 1, such as source mysqltable1 to sink pgtable1 Source mysqltabl

Re: [I] [Bug] [zeta] java.lang.OutOfMemoryError: Metaspace [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on issue #4915: URL: https://github.com/apache/seatunnel/issues/4915#issuecomment-1982793815 > Due to certain reasons, we can only provide you with partial logs maybe you can do some data desensitization. > Running 22 CDC tasks simultaneously will also generat

Re: [PR] [Fix] Fix spark/flink starter script error on windows [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on PR #6435: URL: https://github.com/apache/seatunnel/pull/6435#issuecomment-1982774286 > I can't find these classes in dev branch of base repo(apache/seatunnel)'s code line, You can search it ![image](https://github.com/apache/seatunnel/assets/32387433/a857f73

[I] [Bug] [Transform v2] java.lang.UnsupportedOperationException: The Factory has not been implemented and the deprecated Plugin will be used. [seatunnel]

2024-03-06 Thread via GitHub
Aiden-Rose opened a new issue, #6465: URL: https://github.com/apache/seatunnel/issues/6465 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [I] [Bug] [zeta] java.lang.OutOfMemoryError: Metaspace [seatunnel]

2024-03-06 Thread via GitHub
W-dragan commented on issue #4915: URL: https://github.com/apache/seatunnel/issues/4915#issuecomment-1982761399 [metaSpace.txt](https://github.com/apache/seatunnel/files/14520524/metaSpace.txt) I currently do not have time to verify and provide you with the logs of the previous batch run

Re: [PR] [Fix] Fix spark/flink starter script error on windows [seatunnel]

2024-03-06 Thread via GitHub
GangLiCN commented on PR #6435: URL: https://github.com/apache/seatunnel/pull/6435#issuecomment-1982759687 > > > > > Please add test in e2e. > > > > > > > > > > > > Hi, please tell me the full detailed steps for "add test in e2e" since I'm fresh on this. > > > > Bases on my und

Re: [I] [Bug] [Postgre CDC] Postgre CDC upsert information where before is null [seatunnel]

2024-03-06 Thread via GitHub
Carl-Zhou-CN commented on issue #6464: URL: https://github.com/apache/seatunnel/issues/6464#issuecomment-1982758052 Shall perform: ALTER TABLE your_table_name REPLICA IDENTITY FULL; https://debezium.io/documentation/reference/connectors/postgresql.html#postgresql-replica-identity -- Th

[I] [Bug] [Postgre CDC] Postgre CDC upsert information where before is null [seatunnel]

2024-03-06 Thread via GitHub
Carl-Zhou-CN opened a new issue, #6464: URL: https://github.com/apache/seatunnel/issues/6464 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happe

Re: [I] SeaTunnel Community Meeting [seatunnel]

2024-03-06 Thread via GitHub
cqutwangyu commented on issue #6457: URL: https://github.com/apache/seatunnel/issues/6457#issuecomment-1982724419 Do you consider implementing the process control of the transform? The current transform can only be executed in order, and you cannot perform different transform logic dynamica

Re: [I] [Bug] [mysql cdc] org.apache.seatunnel.connectors.seatunnel.cdc.mysql.source.MySqlDialect.getPrimaryKey< Error NullPointerException> [seatunnel]

2024-03-06 Thread via GitHub
hailin0 commented on issue #6439: URL: https://github.com/apache/seatunnel/issues/6439#issuecomment-1982626699 Automated tests are running fine, can you test them? https://github.com/apache/seatunnel/blob/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-cdc-mysql-e2e/src/test/ja

Re: [I] [Bug] [Module Name] /bin/sh^M: bad interpreter: No such file or directory [seatunnel]

2024-03-06 Thread via GitHub
Carl-Zhou-CN commented on issue #6403: URL: https://github.com/apache/seatunnel/issues/6403#issuecomment-1982599514 hi @woozhijun ![image](https://github.com/apache/seatunnel/assets/67902676/41123cac-c4fd-4aa3-970d-b9c2c78a1818) I just downloaded it for verification -- This is an a

Re: [I] [Bug] [Module Name] /bin/sh^M: bad interpreter: No such file or directory [seatunnel]

2024-03-06 Thread via GitHub
woozhijun commented on issue #6403: URL: https://github.com/apache/seatunnel/issues/6403#issuecomment-1982577384 @Carl-Zhou-CN Hi, this is url install to same problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] [Feature][Paimon] Support the streaming mode for sink #6342 [seatunnel]

2024-03-06 Thread via GitHub
dailai commented on code in PR #6449: URL: https://github.com/apache/seatunnel/pull/6449#discussion_r1513984812 ## seatunnel-connectors-v2/connector-paimon/src/main/java/org/apache/seatunnel/connectors/seatunnel/paimon/sink/PaimonSink.java: ## @@ -108,43 +104,45 @@ public void p

Re: [PR] [Feature][Kafka] Support multi-table source read [seatunnel]

2024-03-06 Thread via GitHub
zhilinli123 commented on PR #5992: URL: https://github.com/apache/seatunnel/pull/5992#issuecomment-1982484121 PTAL: @Hisoka-X @hailin0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

(seatunnel) branch dev updated: [Hotfix] Fix compile error (#6463)

2024-03-06 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 943bd48449 [Hotfix] Fix compile error (#6463) 9

Re: [PR] [Hotfix] Fix compile error [seatunnel]

2024-03-06 Thread via GitHub
hailin0 merged PR #6463: URL: https://github.com/apache/seatunnel/pull/6463 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Feature][Paimon] Support the streaming mode for sink #6342 [seatunnel]

2024-03-06 Thread via GitHub
dailai commented on code in PR #6449: URL: https://github.com/apache/seatunnel/pull/6449#discussion_r1515589217 ## seatunnel-connectors-v2/connector-paimon/src/main/java/org/apache/seatunnel/connectors/seatunnel/paimon/sink/PaimonSink.java: ## @@ -108,43 +104,45 @@ public void p

[PR] [Hotfix] Fix compile error [seatunnel]

2024-03-06 Thread via GitHub
hailin0 opened a new pull request, #6463: URL: https://github.com/apache/seatunnel/pull/6463 ### Purpose of this pull request Fix compile error ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? ### Check l

Re: [I] [Bug] [mysql cdc] org.apache.seatunnel.connectors.seatunnel.cdc.mysql.source.MySqlDialect.getPrimaryKey< Error NullPointerException> [seatunnel]

2024-03-06 Thread via GitHub
avatarTaier commented on issue #6439: URL: https://github.com/apache/seatunnel/issues/6439#issuecomment-1982408134 @zhilinli123After recompiling and packaging the dev branch in v2.3.5, there was no problem and it could run normally. However, the mysql-cdc function in v2.3.3 and v2.3.4 w

Re: [I] Unable to create a source for identifier 'MySQL-CDC' [seatunnel]

2024-03-06 Thread via GitHub
liunaijie commented on issue #5893: URL: https://github.com/apache/seatunnel/issues/5893#issuecomment-1982333105 @hophiya do you solve this issue? i meet same issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [I] [Feature][Kafka Connector enhancement] Support more deserialization mode in Kafka Source Connector [seatunnel]

2024-03-06 Thread via GitHub
GangLiCN commented on issue #6462: URL: https://github.com/apache/seatunnel/issues/6462#issuecomment-1982296704 More information: No matter you override the property "key.deserializer" ( or "value.deserializer") in job configuration file or not, Kafka Source Connector uses "byt

[I] [Feature][Kafka Connector enhancement] Support more deserialization mode in Kafka Source Connector [seatunnel]

2024-03-06 Thread via GitHub
GangLiCN opened a new issue, #6462: URL: https://github.com/apache/seatunnel/issues/6462 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Fix] Fix spark/flink starter script error on windows [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on PR #6435: URL: https://github.com/apache/seatunnel/pull/6435#issuecomment-1982282908 > > > > Please add test in e2e. > > > > > > > > > Hi, please tell me the full detailed steps for "add test in e2e" since I'm fresh on this. > > > Bases on my understanding

Re: [PR] [Fix] Fix spark/flink starter script error on windows [seatunnel]

2024-03-06 Thread via GitHub
GangLiCN commented on PR #6435: URL: https://github.com/apache/seatunnel/pull/6435#issuecomment-1982278528 > > > Please add test in e2e. > > > > > > Hi, please tell me the full detailed steps for "add test in e2e" since I'm fresh on this. > > Bases on my understanding, it seems

Re: [I] [Bug] [zeta] java.lang.OutOfMemoryError: Metaspace [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on issue #4915: URL: https://github.com/apache/seatunnel/issues/4915#issuecomment-1982251026 Hi @wu-a-ge . We try to fix it with PR #6355. It not including in 2.3.4 but in dev. We will release it in next version. You can try use dev branch to test new feature. It will be

Re: [PR] [Fix] Fix spark/flink starter script error on windows [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on PR #6435: URL: https://github.com/apache/seatunnel/pull/6435#issuecomment-1982247699 > > Please add test in e2e. > > Hi, please tell me the full detailed steps for "add test in e2e" since I'm fresh on this. > > Bases on my understanding, it seems that it's

Re: [I] [Bug] [zeta] java.lang.OutOfMemoryError: Metaspace [seatunnel]

2024-03-06 Thread via GitHub
wu-a-ge commented on issue #4915: URL: https://github.com/apache/seatunnel/issues/4915#issuecomment-1982244765 @W-dragan 你不是之前测试没问题内存溢出问题了么?怎么又出现了?只有靠你了! @Hisoka-X @liugddx From 2.3.2-2.3.4 two versions have not solved this memory overflow problem, this stability will not be solved will

Re: [PR] [Fix] Fix spark/flink starter script error on windows [seatunnel]

2024-03-06 Thread via GitHub
GangLiCN commented on code in PR #6435: URL: https://github.com/apache/seatunnel/pull/6435#discussion_r1515409155 ## seatunnel-core/seatunnel-spark-starter/seatunnel-spark-starter-common/src/main/java/org/apache/seatunnel/core/starter/spark/SparkStarter.java: ## @@ -195,7 +198,3

Re: [PR] [Fix] Fix spark/flink starter script error on windows [seatunnel]

2024-03-06 Thread via GitHub
GangLiCN commented on PR #6435: URL: https://github.com/apache/seatunnel/pull/6435#issuecomment-1982239388 > Please add test in e2e. Hi, please tell me the full detailed steps for "add test in e2e" since I'm fresh on this. Bases on my understanding, it seems that it's unnecessa

[PR] Update README.md for fix the seatunnel.sh cmd [seatunnel-web]

2024-03-06 Thread via GitHub
zhangm365 opened a new pull request, #158: URL: https://github.com/apache/seatunnel-web/pull/158 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary package

(seatunnel) branch dev updated (e1a81ac167 -> ec533ecd9a)

2024-03-06 Thread liugddx
This is an automated email from the ASF dual-hosted git repository. liugddx pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from e1a81ac167 [Hotfix][Zeta] Fix job deadlock when schema change (#6389) add ec533ecd9a Add support for XML file ty

Re: [PR] [Feature][Connector-V2] Add support for XML file type to various file connectors [seatunnel]

2024-03-06 Thread via GitHub
liugddx merged PR #6327: URL: https://github.com/apache/seatunnel/pull/6327 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [I] [Bug] [Module Name] /bin/sh^M: bad interpreter: No such file or directory [seatunnel]

2024-03-06 Thread via GitHub
Carl-Zhou-CN commented on issue #6403: URL: https://github.com/apache/seatunnel/issues/6403#issuecomment-1982224613 > @Carl-Zhou-CN this is download url has not changed for 2.3.4 binary distribution , The re-download is failed. https://seatunnel.apache.org/download @woozhijun hi, The

Re: [I] [Bug] [rest-api] /hazelcast/rest/maps/running-jobs Request failed java.lang.NullPointerException [seatunnel]

2024-03-06 Thread via GitHub
github-actions[bot] commented on issue #6325: URL: https://github.com/apache/seatunnel/issues/6325#issuecomment-1982093786 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [SQLserver CDC] sqlserver jdbc url encrypt=false not work [seatunnel]

2024-03-06 Thread via GitHub
bjdaijun closed issue #6460: [Bug] [SQLserver CDC] sqlserver jdbc url encrypt=false not work URL: https://github.com/apache/seatunnel/issues/6460 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [I] [Bug] [SQLserver CDC] sqlserver jdbc url encrypt=false not work [seatunnel]

2024-03-06 Thread via GitHub
bjdaijun commented on issue #6460: URL: https://github.com/apache/seatunnel/issues/6460#issuecomment-1982076601 It's config error. Need use debezium to config -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[I] [Bug] [Module Name] Bug title [seatunnel]

2024-03-06 Thread via GitHub
seatunneltrailuser opened a new issue, #6461: URL: https://github.com/apache/seatunnel/issues/6461 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What

Re: [PR] [Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on clickhouse connector [seatunnel]

2024-03-06 Thread via GitHub
hailin0 commented on PR #6416: URL: https://github.com/apache/seatunnel/pull/6416#issuecomment-1980867643 https://github.com/apache/seatunnel/assets/14371345/eb652737-614d-4565-bd94-42eb20aa9be9";> -- This is an automated message from the Apache Git Service. To respond to the message,

[PR] Update jdbc-mysql.md [seatunnel-website]

2024-03-06 Thread via GitHub
a110q opened a new pull request, #296: URL: https://github.com/apache/seatunnel-website/pull/296 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

Re: [PR] [Bug][Connector-v2][RedisSink]Fix failures caused by different cluster mode operations. [seatunnel]

2024-03-06 Thread via GitHub
lightzhao closed pull request #5300: [Bug][Connector-v2][RedisSink]Fix failures caused by different cluster mode operations. URL: https://github.com/apache/seatunnel/pull/5300 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [PR] [Feature][Connector-v2]add raw format with KafkaSource [seatunnel]

2024-03-06 Thread via GitHub
lightzhao closed pull request #4844: [Feature][Connector-v2]add raw format with KafkaSource URL: https://github.com/apache/seatunnel/pull/4844 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] [Feature][connector-jdbc] Support PostgreSQL based databases to use Copy statements to accelerate data writing. [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on code in PR #6443: URL: https://github.com/apache/seatunnel/pull/6443#discussion_r1514202881 ## pom.xml: ## @@ -329,6 +330,11 @@ commons-collections4 ${commons-collections4.version} + +

[I] [Bug] [SQLserver CDC] sqlserver jdbc url encrypt=false not work [seatunnel]

2024-03-06 Thread via GitHub
bjdaijun opened a new issue, #6460: URL: https://github.com/apache/seatunnel/issues/6460 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Feature][connector-jdbc] Support PostgreSQL based databases to use Copy statements to accelerate data writing. [seatunnel]

2024-03-06 Thread via GitHub
mosence commented on code in PR #6443: URL: https://github.com/apache/seatunnel/pull/6443#discussion_r1514180127 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/config/JdbcOptions.java: ## @@ -151,6 +151,12 @@ public interfa

Re: [PR] [Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on clickhouse connector [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on PR #6416: URL: https://github.com/apache/seatunnel/pull/6416#issuecomment-1980496937 Please fix CI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] [Feature][Connector-V2][JDBC] Add presto connector [seatunnel]

2024-03-06 Thread via GitHub
qianmoQ opened a new pull request, #3774: URL: https://github.com/apache/seatunnel/pull/3774 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary package add

Re: [PR] [Feature][connector-jdbc] Support PostgreSQL based databases to use Copy statements to accelerate data writing. [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on code in PR #6443: URL: https://github.com/apache/seatunnel/pull/6443#discussion_r1514082295 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/executor/CopyManagerBatchStatementExecutor.java: ## @

Re: [PR] [Doc][Improve]Support Chinese for /seatunnel-engine/rest-api.md and local-mode.md and cluster-mode.md and checkpoint-storage.md [seatunnel]

2024-03-06 Thread via GitHub
dzygoon commented on PR #6445: URL: https://github.com/apache/seatunnel/pull/6445#issuecomment-1980395220 > You can merge from dev to fix dead link because it already be fixed in #6442 done,pls recheck. -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] [Bug][Improve][Connector-v2][ElasticsearchSource] Fix behavior when source empty,Support SourceConfig.SOURCE field empty. [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on PR #6425: URL: https://github.com/apache/seatunnel/pull/6425#issuecomment-1980374367 I think we should add a e2e test case in https://github.com/apache/seatunnel/blob/045d3e3494eac67cef555c190ecb68638d497349/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-elasticsear

Re: [PR] [Feature][connector-jdbc] Support PostgreSQL based databases to use Copy statements to accelerate data writing. [seatunnel]

2024-03-06 Thread via GitHub
mosence commented on code in PR #6443: URL: https://github.com/apache/seatunnel/pull/6443#discussion_r1514076780 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/executor/CopyManagerBatchStatementExecutor.java: ## @@

(seatunnel) branch dev updated: [Hotfix][Zeta] Fix job deadlock when schema change (#6389)

2024-03-06 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new e1a81ac167 [Hotfix][Zeta] Fix job deadlock when sch

Re: [PR] [Hotfix][Zeta] Fix job deadlock when schema change [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X merged PR #6389: URL: https://github.com/apache/seatunnel/pull/6389 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [Feature][Paimon] Support the streaming mode for sink #6342 [seatunnel]

2024-03-06 Thread via GitHub
dailai commented on code in PR #6449: URL: https://github.com/apache/seatunnel/pull/6449#discussion_r1514062283 ## seatunnel-shade/seatunnel-hadoop3-3.1.4-uber/pom.xml: ## @@ -47,6 +47,11 @@ hadoop-client ${hadoop3.version} + +

Re: [PR] [Hotfix][Zeta] Fix job deadlock when schema change [seatunnel]

2024-03-06 Thread via GitHub
hailin0 commented on PR #6389: URL: https://github.com/apache/seatunnel/pull/6389#issuecomment-1980376923 > Please add test case. Currently not possible to add testcase because the ddl event capture has not been developed yet. -- This is an automated message from the Apache Git Ser

Re: [PR] [Bug][Improve][Connector-v2][ElasticsearchSource] Fix behavior when source empty,Support SourceConfig.SOURCE field empty. [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on code in PR #6425: URL: https://github.com/apache/seatunnel/pull/6425#discussion_r1514063607 ## seatunnel-connectors-v2/connector-elasticsearch/src/test/java/org/apache/seatunnel/connectors/seatunnel/elasticsearch/ElasticsearchSourceTest.java: ## @@ -0,0 +1,

Re: [PR] [Feature][Paimon] Support the streaming mode for sink #6342 [seatunnel]

2024-03-06 Thread via GitHub
dailai commented on code in PR #6449: URL: https://github.com/apache/seatunnel/pull/6449#discussion_r1514062283 ## seatunnel-shade/seatunnel-hadoop3-3.1.4-uber/pom.xml: ## @@ -47,6 +47,11 @@ hadoop-client ${hadoop3.version} + +

Re: [I] [Bug] [seatunnel-web] 整库-多表同步无法选择数据源 [seatunnel]

2024-03-06 Thread via GitHub
cooltnt commented on issue #6233: URL: https://github.com/apache/seatunnel/issues/6233#issuecomment-1980371202 > 解决了吗,怎么解决的,我也遇到数据源是空的问题 我这个问题是选择整库模式下, 无法选择源, 这个好像目前不支持. 如果是集成方式下无法选择源的话, 请到 https://mvnrepository.com/search?q=org.apache.seatunnel 下载 以下jar : "datasource-p

Re: [PR] [Bugfix][Connector-v2][HttpSink] removed duplicate headers for HTTP requests [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on PR #6431: URL: https://github.com/apache/seatunnel/pull/6431#issuecomment-1980366528 Hi @24kGarry . I think we should add test case for this bug. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] [Feature][connector-jdbc] Support PostgreSQL based databases to use Copy statements to accelerate data writing. [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on code in PR #6443: URL: https://github.com/apache/seatunnel/pull/6443#discussion_r1514058292 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/executor/CopyManagerProxy.java: ## @@ -0,0 +1,48 @@ +

Re: [PR] [Feature][connector-jdbc] Support PostgreSQL based databases to use Copy statements to accelerate data writing. [seatunnel]

2024-03-06 Thread via GitHub
mosence commented on code in PR #6443: URL: https://github.com/apache/seatunnel/pull/6443#discussion_r1514054482 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/executor/CopyManagerProxy.java: ## @@ -0,0 +1,48 @@ +/

Re: [PR] [Feature][connector-jdbc] Support PostgreSQL based databases to use Copy statements to accelerate data writing. [seatunnel]

2024-03-06 Thread via GitHub
mosence commented on code in PR #6443: URL: https://github.com/apache/seatunnel/pull/6443#discussion_r1514054482 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/executor/CopyManagerProxy.java: ## @@ -0,0 +1,48 @@ +/

Re: [PR] [Feature][connector-jdbc] Support PostgreSQL based databases to use Copy statements to accelerate data writing. [seatunnel]

2024-03-06 Thread via GitHub
mosence commented on code in PR #6443: URL: https://github.com/apache/seatunnel/pull/6443#discussion_r1514053389 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/executor/CopyManagerProxy.java: ## @@ -0,0 +1,48 @@ +/

Re: [PR] [Bugfix][Connector-v2][HttpSink] removed duplicate headers for HTTP requests [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on PR #6431: URL: https://github.com/apache/seatunnel/pull/6431#issuecomment-1980358504 The error: ```java Repeated setting of content type resulted in an error, so unnecessary header settings were removed. Otherwise, the error is as follows: org.springfra

Re: [I] [Feature][Statistics] Connector pr not yet merged [seatunnel]

2024-03-06 Thread via GitHub
sanjaychitransh commented on issue #3960: URL: https://github.com/apache/seatunnel/issues/3960#issuecomment-1980348755 presto | #3774 when this PR will merged -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

(seatunnel) branch dev updated: [Doc][Improve] support chinese (#6373)

2024-03-06 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 045d3e3494 [Doc][Improve] support chinese (#637

Re: [PR] [Doc][Improve] support chinese [seatunnel]

2024-03-06 Thread via GitHub
hailin0 merged PR #6373: URL: https://github.com/apache/seatunnel/pull/6373 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated (76967066bf -> 14405fa8d4)

2024-03-06 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 76967066bf [Feature] Support nanosecond in Doris DateTimeV2 type (#6358) add 14405fa8d4 [Improve][Jdbc] Usin

Re: [PR] [Improve][Jdbc] Using varchar2 datatype store string in oracle [seatunnel]

2024-03-06 Thread via GitHub
EricJoy2048 merged PR #6392: URL: https://github.com/apache/seatunnel/pull/6392 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seat

Re: [PR] [Doc][Improve]Add Support Chinese for start-v2/locally/quick-start-seatunnel-engine.md and start-v2/locally/deployment.md [seatunnel]

2024-03-06 Thread via GitHub
JueLance commented on PR #6406: URL: https://github.com/apache/seatunnel/pull/6406#issuecomment-1980336540 > > There are some dead link in document: FILE: ./docs/zh/start-v2/locally/quick-start-seatunnel-engine.md [✖] ../../concept/config.md [✖] ../../connector-v2/source/FakeSource.md [✖]

[PR] Missing parameter for jdbc sink savemode case #6458 [seatunnel]

2024-03-06 Thread via GitHub
15810785091 opened a new pull request, #6459: URL: https://github.com/apache/seatunnel/pull/6459 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

(seatunnel) branch dev updated: [Feature] Support nanosecond in Doris DateTimeV2 type (#6358)

2024-03-06 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 76967066bf [Feature] Support nanosecond in Dori

Re: [PR] [Feature] Support nanosecond in Doris DateTimeV2 type [seatunnel]

2024-03-06 Thread via GitHub
hailin0 merged PR #6358: URL: https://github.com/apache/seatunnel/pull/6358 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [BUG][connector-doris] Adapt to changes in the latest version of Doris [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on PR #6432: URL: https://github.com/apache/seatunnel/pull/6432#issuecomment-1980328654 Please resolved conflict and add test case. Thanks @bingquanzhao -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[I] Missing parameter for jdbc sink savemode case [seatunnel]

2024-03-06 Thread via GitHub
15810785091 opened a new issue, #6458: URL: https://github.com/apache/seatunnel/issues/6458 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Improve][Connector-V2] Support INFINI Easysearch [seatunnel]

2024-03-06 Thread via GitHub
hailin0 merged PR #5933: URL: https://github.com/apache/seatunnel/pull/5933 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Bugfix][seatunnel--flink/spark-starter-common] windows specific issue fix [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X closed pull request #6436: [Bugfix][seatunnel--flink/spark-starter-common] windows specific issue fix URL: https://github.com/apache/seatunnel/pull/6436 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] [Bugfix][seatunnel--flink/spark-starter-common] windows specific issue fix [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on PR #6436: URL: https://github.com/apache/seatunnel/pull/6436#issuecomment-1980321255 duplicated of #6435 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

(seatunnel) branch dev updated: [Fix][Connector-V2] Fix doris source select fields loss primary key information (#6339)

2024-03-06 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 78abe2f202 [Fix][Connector-V2] Fix doris source

Re: [PR] [Feature][Paimon] Support the streaming mode for sink #6342 [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on code in PR #6449: URL: https://github.com/apache/seatunnel/pull/6449#discussion_r1514015487 ## seatunnel-shade/seatunnel-hadoop3-3.1.4-uber/pom.xml: ## @@ -47,6 +47,11 @@ hadoop-client ${hadoop3.version} + +

Re: [PR] [Fix][Connector-V2] Fix doris source select fields loss primary key information [seatunnel]

2024-03-06 Thread via GitHub
hailin0 merged PR #6339: URL: https://github.com/apache/seatunnel/pull/6339 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [I] [Feature] Can it support flink table mode sink and stream mode sink in one job? [seatunnel]

2024-03-06 Thread via GitHub
waywtdcc closed issue #1896: [Feature] Can it support flink table mode sink and stream mode sink in one job? URL: https://github.com/apache/seatunnel/issues/1896 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

(seatunnel) branch dev updated (78cb0deba9 -> f4776347cb)

2024-03-06 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 78cb0deba9 [Improve][RestAPI] always return jobId when call getJobInfoById API (#6422) add f4776347cb [Impro

Re: [PR] [Improve] Add deprecated annotation for `ReadonlyConfig::toConfig` [seatunnel]

2024-03-06 Thread via GitHub
hailin0 merged PR #6353: URL: https://github.com/apache/seatunnel/pull/6353 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Feature][connector-jdbc] Support PostgreSQL based databases to use Copy statements to accelerate data writing. [seatunnel]

2024-03-06 Thread via GitHub
Hisoka-X commented on code in PR #6443: URL: https://github.com/apache/seatunnel/pull/6443#discussion_r1513978932 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/config/JdbcOptions.java: ## @@ -151,6 +151,12 @@ public interf

Re: [PR] [Fix] Fix spark/flink starter script error on windows [seatunnel]

2024-03-06 Thread via GitHub
GangLiCN commented on code in PR #6435: URL: https://github.com/apache/seatunnel/pull/6435#discussion_r1513998376 ## seatunnel-core/seatunnel-core-starter/src/main/java/org/apache/seatunnel/core/starter/utils/SystemUtil.java: ## @@ -0,0 +1,24 @@ +package org.apache.seatunnel.cor

Re: [PR] [Fix] Fix spark/flink starter script error on windows [seatunnel]

2024-03-06 Thread via GitHub
GangLiCN commented on code in PR #6435: URL: https://github.com/apache/seatunnel/pull/6435#discussion_r1513994447 ## seatunnel-core/seatunnel-flink-starter/seatunnel-flink-starter-common/src/main/java/org/apache/seatunnel/core/starter/flink/FlinkStarter.java: ## @@ -52,8 +55,33

Re: [PR] [Feature][Paimon] Support the streaming mode for sink #6342 [seatunnel]

2024-03-06 Thread via GitHub
dailai commented on code in PR #6449: URL: https://github.com/apache/seatunnel/pull/6449#discussion_r1513983869 ## seatunnel-shade/seatunnel-hadoop3-3.1.4-uber/pom.xml: ## @@ -47,6 +47,11 @@ hadoop-client ${hadoop3.version} + +