Re: [PR] [Paimon]support projection for paimon source [seatunnel]

2024-04-10 Thread via GitHub
TaoZex commented on PR #6343: URL: https://github.com/apache/seatunnel/pull/6343#issuecomment-2049038613 PTAL @Hisoka-X @EricJoy2048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [Fix][connector-rocketmq] commit a correct offset to broker & reduce ThreadInterruptedException log [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on PR #6668: URL: https://github.com/apache/seatunnel/pull/6668#issuecomment-2049020663 > I found that,in e2e testing, rocketmq source connector won't submit consume offset when batch job finished with flink13. In batch mode, this is a known issue, we can skip it fo

Re: [PR] [Paimon]support projection for paimon source [seatunnel]

2024-04-10 Thread via GitHub
TaoZex commented on code in PR #6343: URL: https://github.com/apache/seatunnel/pull/6343#discussion_r1560499155 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-paimon-e2e/src/test/resources/paimon_projection_to_assert.conf: ## @@ -0,0 +1,78 @@ +# +# Licensed to the Apache

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-10 Thread via GitHub
corgy-w commented on PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#issuecomment-2049008072 @zhilinli123 @EricJoy2048 E I have completed PR self-review, please check , if there is any problem, I will fix it immediately. Tks! -- This is an automated message from the Apache G

Re: [I] [Bug] Can not find catalog table with factoryId [Postgres] [seatunnel]

2024-04-10 Thread via GitHub
Asura7969 commented on issue #6550: URL: https://github.com/apache/seatunnel/issues/6550#issuecomment-2049000189 > > > > Are you referring to the issue of account permissions for connecting to pg? > > > > > > > > > It could be, or it could happen because of a connection timeout, o

Re: [PR] [fix] fix get seatunnel row size npe issue [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on code in PR #6681: URL: https://github.com/apache/seatunnel/pull/6681#discussion_r1560476234 ## seatunnel-api/src/test/java/org/apache/seatunnel/api/table/type/SeaTunnelRowTest.java: ## @@ -51,12 +51,31 @@ void testForRowSize() {

Re: [PR] [Fix][connector-rocketmq] commit a correct offset to broker & reduce ThreadInterruptedException log [seatunnel]

2024-04-10 Thread via GitHub
YalikWang commented on PR #6668: URL: https://github.com/apache/seatunnel/pull/6668#issuecomment-2048978542 @Hisoka-X I found that,in e2e testing, rocketmq source connector won't submit consume offset when batch job finished with flink13. I did not test with zeta e2e because of env erro

Re: [PR] [Connector]Add druid sink connector [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on code in PR #6346: URL: https://github.com/apache/seatunnel/pull/6346#discussion_r1560466033 ## seatunnel-connectors-v2/connector-druid/src/main/java/org/apache/seatunnel/connectors/druid/sink/DruidSink.java: ## @@ -0,0 +1,89 @@ +/* + * Licensed to the Apach

Re: [PR] [Fix][Connector-v2] Fix the sql statement error of create table for doris and starrocks [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on code in PR #6679: URL: https://github.com/apache/seatunnel/pull/6679#discussion_r1560462921 ## seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/util/DorisCatalogUtil.java: ## @@ -153,6 +162,17 @@ public static Stri

Re: [PR] [Bug][Improve][Connector-v2][ElasticsearchSource] Fix behavior when source empty,Support SourceConfig.SOURCE field empty. [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on code in PR #6425: URL: https://github.com/apache/seatunnel/pull/6425#discussion_r1560434575 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-elasticsearch-e2e/src/test/java/org/apache/seatunnel/e2e/connector/elasticsearch/ElasticsearchIT.java: ## @@ -1

Re: [PR] [Bug][Improve][Connector-v2][ElasticsearchSource] Fix behavior when source empty,Support SourceConfig.SOURCE field empty. [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on code in PR #6425: URL: https://github.com/apache/seatunnel/pull/6425#discussion_r1560433169 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-elasticsearch-e2e/src/test/java/org/apache/seatunnel/e2e/connector/elasticsearch/ElasticsearchIT.java: ## @@ -2

Re: [PR] [Bug][Improve][Connector-v2][ElasticsearchSource] Fix behavior when source empty,Support SourceConfig.SOURCE field empty. [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on code in PR #6425: URL: https://github.com/apache/seatunnel/pull/6425#discussion_r1560405030 ## seatunnel-connectors-v2/connector-elasticsearch/src/main/java/org/apache/seatunnel/connectors/seatunnel/elasticsearch/client/EsRestClient.java: ## @@ -289,6 +289,

Re: [PR] [Bug][Improve][Connector-v2][ElasticsearchSource] Fix behavior when source empty,Support SourceConfig.SOURCE field empty. [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on PR #6425: URL: https://github.com/apache/seatunnel/pull/6425#issuecomment-2048885070 https://github.com/apache/seatunnel/pull/6425/files#diff-8eef53f88ae098e1477f67d8053f946d3267578ec8e68fd472d22c298864f876R60 This line should be deleted. Also please tell user when n

Re: [PR] [Bug][Improve][Connector-v2][ElasticsearchSource] Fix behavior when source empty,Support SourceConfig.SOURCE field empty. [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on code in PR #6425: URL: https://github.com/apache/seatunnel/pull/6425#discussion_r1560397506 ## seatunnel-connectors-v2/connector-elasticsearch/src/test/java/org/apache/seatunnel/connectors/seatunnel/elasticsearch/ElasticsearchSourceTest.java: ## @@ -0,0 +1,

Re: [I] Provider org.apache.seatunnel.connectors.seatunnel.file.s3.sink.S3FileSink could not be instantiated [seatunnel]

2024-04-10 Thread via GitHub
guoyangjie commented on issue #6676: URL: https://github.com/apache/seatunnel/issues/6676#issuecomment-2048874429 Thank you, I'll give it a try -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] [Bug] [connector-S3] 2个问题,Source 是S3,服务是minio,Sink是clickhouse,同步时报错;Source是iceberg catalog_type hive ,iceberg链接的服务是HA模式时 问题。 [seatunnel]

2024-04-10 Thread via GitHub
MadaoJikong closed issue #6643: [Bug] [connector-S3] 2个问题,Source 是S3,服务是minio,Sink是clickhouse,同步时报错;Source是iceberg catalog_type hive ,iceberg链接的服务是HA模式时 问题。 URL: https://github.com/apache/seatunnel/issues/6643 -- This is an automated message from the Apache Git Service. To respond to the mes

Re: [PR] [Fix][Doc] Fixed links in some documents [seatunnel]

2024-04-10 Thread via GitHub
xxzuo commented on code in PR #6673: URL: https://github.com/apache/seatunnel/pull/6673#discussion_r1560388362 ## docs/zh/connector-v2/source/HdfsFile.md: ## @@ -10,15 +10,15 @@ ## 主要特性 -- [x] [批处理](../../../en/concept/connector-v2-features.md) -- [ ] [流处理](../../../en/conc

Re: [PR] [Bug][Improve][Connector-v2][ElasticsearchSource] Fix behavior when source empty,Support SourceConfig.SOURCE field empty. [seatunnel]

2024-04-10 Thread via GitHub
CosmosNi commented on code in PR #6425: URL: https://github.com/apache/seatunnel/pull/6425#discussion_r1560387075 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/catalog/schema/TableSchemaOptions.java: ## @@ -49,6 +49,7 @@ public static class TableIdentifierOptions

Re: [I] [SqlServer-CDC]当字段数量超过128,无法正常cdc [seatunnel]

2024-04-10 Thread via GitHub
Carl-Zhou-CN commented on issue #6658: URL: https://github.com/apache/seatunnel/issues/6658#issuecomment-2048829534 @bulolo Can set result_table_name source_table_name Try it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [I] [Bug] Can not find catalog table with factoryId [Postgres] [seatunnel]

2024-04-10 Thread via GitHub
Carl-Zhou-CN commented on issue #6550: URL: https://github.com/apache/seatunnel/issues/6550#issuecomment-2048824366 > > > Are you referring to the issue of account permissions for connecting to pg? > > > > > > It could be, or it could happen because of a connection timeout, or be

Re: [PR] [Connector]Add druid sink connector [seatunnel]

2024-04-10 Thread via GitHub
TaoZex commented on PR #6346: URL: https://github.com/apache/seatunnel/pull/6346#issuecomment-2048811075 PTAL @Hisoka-X @EricJoy2048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [Connector]Add druid sink connector [seatunnel]

2024-04-10 Thread via GitHub
TaoZex commented on code in PR #6346: URL: https://github.com/apache/seatunnel/pull/6346#discussion_r1560350408 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-druid-e2e/src/test/java/org/apache/seatunnel/e2e/connector/druid/DruidIT.java: ## @@ -0,0 +1,72 @@ +/* + * Licens

Re: [I] [Bug] [Tool] Failed to resolve parameter [org.apache.seatunnel.e2e.common.container.TestContainer arg0] [seatunnel]

2024-04-10 Thread via GitHub
dailai commented on issue #6677: URL: https://github.com/apache/seatunnel/issues/6677#issuecomment-2048798707 > > Why is "ls -q"? I was also successful running this test locally alone。Screenshot as follows: ![image](https://private-user-images.githubusercontent.com/18141150/321134448-b6c204

Re: [I] [Bug] [oracle-cdc] from oracle (11g) to starrocks : Generate Splits for table xxxx error [seatunnel]

2024-04-10 Thread via GitHub
Carl-Zhou-CN commented on issue #6560: URL: https://github.com/apache/seatunnel/issues/6560#issuecomment-2048793676 hi @cqy931 @jiexiadwo Can you provide the DDL of the table? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [I] [Bug] [Oracle-CDC] Can not find catalog table with factoryId [Oracle] [seatunnel]

2024-04-10 Thread via GitHub
Carl-Zhou-CN commented on issue #6680: URL: https://github.com/apache/seatunnel/issues/6680#issuecomment-2048782460 Would you mind referring to the configuration of oracle cdc e2e -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [I] [Bug] [Oracle-CDC] Can not find catalog table with factoryId [Oracle] [seatunnel]

2024-04-10 Thread via GitHub
Carl-Zhou-CN commented on issue #6680: URL: https://github.com/apache/seatunnel/issues/6680#issuecomment-2048781319 # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additiona

Re: [I] [Bug] [Oracle-CDC] Can not find catalog table with factoryId [Oracle] [seatunnel]

2024-04-10 Thread via GitHub
Carl-Zhou-CN commented on issue #6680: URL: https://github.com/apache/seatunnel/issues/6680#issuecomment-2048780893 I think it is the table name configuration that is wrong, not the code -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

Re: [I] [Bug] [Oracle-CDC] Can not find catalog table with factoryId [Oracle] [seatunnel]

2024-04-10 Thread via GitHub
Carl-Zhou-CN commented on issue #6680: URL: https://github.com/apache/seatunnel/issues/6680#issuecomment-2048778837 It must be a configuration error eg: `env { # You can set engine configuration here parallelism = 1 job.mode = "STREAMING" checkpoint.interval = 5000

Re: [I] kafka source can not consumer all history data when use batch mode [seatunnel]

2024-04-10 Thread via GitHub
SbloodyS commented on issue #6388: URL: https://github.com/apache/seatunnel/issues/6388#issuecomment-2048738177 I'm encounter this issue too. I've already submit pr #6685 to fix this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[PR] [Fix-6388] Fix kafka source can not consumer all history data when use batch mode [seatunnel]

2024-04-10 Thread via GitHub
SbloodyS opened a new pull request, #6685: URL: https://github.com/apache/seatunnel/pull/6685 ### Purpose of this pull request fix #6388 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check li

Re: [PR] [Fix][Connector-v2] Fix the sql statement error of create table for doris [seatunnel]

2024-04-10 Thread via GitHub
dailai commented on PR #6679: URL: https://github.com/apache/seatunnel/pull/6679#issuecomment-2048672380 > Could you check the starrocks connector too? Thanks OK -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [I] [Bug] [connecter-kafka] java.lang.NoSuchMethodError: org.apache.kafka.clients.admin.AdminClient.listOffsets [seatunnel]

2024-04-10 Thread via GitHub
github-actions[bot] commented on issue #6483: URL: https://github.com/apache/seatunnel/issues/6483#issuecomment-2048640825 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] Can not find catalog table with factoryId [Postgres] [seatunnel]

2024-04-10 Thread via GitHub
ab92015359 commented on issue #6550: URL: https://github.com/apache/seatunnel/issues/6550#issuecomment-2047989309 it is ok now, thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

(seatunnel) branch dev updated: [Fix][Doc] Fixed links in some documents (#6673)

2024-04-10 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 6296d0c873 [Fix][Doc] Fixed links in some docum

Re: [PR] [Fix][Doc] Fixed links in some documents [seatunnel]

2024-04-10 Thread via GitHub
hailin0 merged PR #6673: URL: https://github.com/apache/seatunnel/pull/6673 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

[PR] [Hotfix][Jdbc/CDC] Fix postgresql uuid type in jdbc read [seatunnel]

2024-04-10 Thread via GitHub
hailin0 opened a new pull request, #6684: URL: https://github.com/apache/seatunnel/pull/6684 ### Purpose of this pull request [Jdbc/CDC] Fix postgresql uuid type in jdbc read ### Does this PR introduce _any_ user-facing change? No ### How was this patch tes

Re: [PR] [Fix][Doc] Fixed links in some documents [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on code in PR #6673: URL: https://github.com/apache/seatunnel/pull/6673#discussion_r1559387354 ## docs/zh/connector-v2/source/HdfsFile.md: ## @@ -10,15 +10,15 @@ ## 主要特性 -- [x] [批处理](../../../en/concept/connector-v2-features.md) -- [ ] [流处理](../../../en/c

Re: [PR] [Fix][Doc] Fixed links in some documents [seatunnel]

2024-04-10 Thread via GitHub
xxzuo commented on code in PR #6673: URL: https://github.com/apache/seatunnel/pull/6673#discussion_r1559380573 ## docs/zh/connector-v2/source/HdfsFile.md: ## @@ -10,15 +10,15 @@ ## 主要特性 -- [x] [批处理](../../../en/concept/connector-v2-features.md) -- [ ] [流处理](../../../en/conc

[PR] [Improve] Improve read with parquet type convert error [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X opened a new pull request, #6683: URL: https://github.com/apache/seatunnel/pull/6683 ### Purpose of this pull request This PR optimize the errors returned when reading unsupported field types in parquet files and provide more friendly and standardized error messages.

Re: [PR] [Fix][connector-rocketmq] commit a correct offset to broker & reduce ThreadInterruptedException log [seatunnel]

2024-04-10 Thread via GitHub
YalikWang commented on PR #6668: URL: https://github.com/apache/seatunnel/pull/6668#issuecomment-2047455137 > The CI failed. Could you fix it? ![image](https://private-user-images.githubusercontent.com/32387433/321238238-a91b5eb4-1098-4df1-b3ba-2fbc4e7f1548.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cC

Re: [PR] [Fix][connector-rocketmq] commit a correct offset to broker & reduce ThreadInterruptedException log [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on PR #6668: URL: https://github.com/apache/seatunnel/pull/6668#issuecomment-2047422756 The CI failed. Could you fix it? ![image](https://github.com/apache/seatunnel/assets/32387433/a91b5eb4-1098-4df1-b3ba-2fbc4e7f1548) -- This is an automated message from the Ap

Re: [I] [Bug] [JDBC] JDBC SQLSERVER use table_path reports error when filedname is KEY WORD [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on issue #6675: URL: https://github.com/apache/seatunnel/issues/6675#issuecomment-2047402594 Closed by https://github.com/apache/seatunnel/pull/6669 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [I] [Bug] [JDBC] JDBC SQLSERVER use table_path reports error when filedname is KEY WORD [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X closed issue #6675: [Bug] [JDBC] JDBC SQLSERVER use table_path reports error when filedname is KEY WORD URL: https://github.com/apache/seatunnel/issues/6675 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [Fix][Doc] Fixed links in some documents [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on code in PR #6673: URL: https://github.com/apache/seatunnel/pull/6673#discussion_r1559338859 ## docs/zh/connector-v2/source/HdfsFile.md: ## @@ -10,15 +10,15 @@ ## 主要特性 -- [x] [批处理](../../../en/concept/connector-v2-features.md) -- [ ] [流处理](../../../en/c

[I] [Improve][Doc] Intro the multi-line text feature in document [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X opened a new issue, #6682: URL: https://github.com/apache/seatunnel/issues/6682 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] Provider org.apache.seatunnel.connectors.seatunnel.file.s3.sink.S3FileSink could not be instantiated [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on issue #6676: URL: https://github.com/apache/seatunnel/issues/6676#issuecomment-2047384800 pelase retry with dev branch. Already fixed by #6551 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [Feature][starter] support user define parameter on spark/flink engine [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on code in PR #6387: URL: https://github.com/apache/seatunnel/pull/6387#discussion_r1559314986 ## docs/en/concept/config.md: ## @@ -193,6 +193,83 @@ configured with these two parameters, because in SeaTunnel, there is a default c parameters are not configure

Re: [I] [Bug] [Tool] Failed to resolve parameter [org.apache.seatunnel.e2e.common.container.TestContainer arg0] [seatunnel]

2024-04-10 Thread via GitHub
xiaochen-zhou commented on issue #6677: URL: https://github.com/apache/seatunnel/issues/6677#issuecomment-2047367536 > Why is "ls -q"? I was also successful running this test locally alone。Screenshot as follows: ![image](https://private-user-images.githubusercontent.com/18141150/321134448-b

Re: [I] [Bug] [Tool] Failed to resolve parameter [org.apache.seatunnel.e2e.common.container.TestContainer arg0] [seatunnel]

2024-04-10 Thread via GitHub
xiaochen-zhou commented on issue #6677: URL: https://github.com/apache/seatunnel/issues/6677#issuecomment-2047363430 > try this command: > > ``` > ./mvnw -U -T 1C clean install -DskipTests -D"maven.test.skip"=true -D"maven.javadoc.skip"=true -D"checkstyle.skip"=true -D"license.ski

Re: [PR] [Fix][Connector-v2] Fix the sql statement error of create table for doris [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on PR #6679: URL: https://github.com/apache/seatunnel/pull/6679#issuecomment-2047334536 Could you check the starrocks connector too? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] [Fix][Connector-v2] Fix the sql statement error of create table for doris [seatunnel]

2024-04-10 Thread via GitHub
Hisoka-X commented on code in PR #6679: URL: https://github.com/apache/seatunnel/pull/6679#discussion_r1559294376 ## seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/util/DorisCatalogUtil.java: ## @@ -110,21 +111,27 @@ public static Str

[PR] [fix] fix get seatunnel row size npe issue [seatunnel]

2024-04-10 Thread via GitHub
liunaijie opened a new pull request, #6681: URL: https://github.com/apache/seatunnel/pull/6681 ### Purpose of this pull request close #6455 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? update the current ut

(seatunnel) branch dev updated: [Improve][Jdbc] Add quote identifier for sql (#6669)

2024-04-10 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 849d748d3d [Improve][Jdbc] Add quote identifier

Re: [PR] [Improve][Jdbc] Add quote identifier for sql [seatunnel]

2024-04-10 Thread via GitHub
EricJoy2048 merged PR #6669: URL: https://github.com/apache/seatunnel/pull/6669 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seat

Re: [PR] [Fix][Kafka-Sink] fix kafka sink factory option rule [seatunnel]

2024-04-10 Thread via GitHub
liunaijie commented on code in PR #6657: URL: https://github.com/apache/seatunnel/pull/6657#discussion_r1559172634 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/sink/KafkaSinkFactory.java: ## @@ -39,23 +39,26 @@ public S

Re: [PR] [Fix][Kafka-Sink] fix kafka sink factory option rule [seatunnel]

2024-04-10 Thread via GitHub
liunaijie commented on code in PR #6657: URL: https://github.com/apache/seatunnel/pull/6657#discussion_r1559172634 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/sink/KafkaSinkFactory.java: ## @@ -39,23 +39,26 @@ public S

Re: [I] [Bug] [Oracle-CDC] Can not find catalog table with factoryId [Oracle] [seatunnel]

2024-04-10 Thread via GitHub
luzongzhu commented on issue #6680: URL: https://github.com/apache/seatunnel/issues/6680#issuecomment-2047080364 Oracle version 12c,not have cdb -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [I] [Bug] [JDBC] JDBC SQLSERVER use table_path reports error when filedname is KEY WORD [seatunnel]

2024-04-10 Thread via GitHub
dailai commented on issue #6675: URL: https://github.com/apache/seatunnel/issues/6675#issuecomment-2047051327 Refer: https://github.com/apache/seatunnel/pull/6669 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [Fix][Kafka-Sink] fix kafka sink factory option rule [seatunnel]

2024-04-10 Thread via GitHub
hailin0 commented on code in PR #6657: URL: https://github.com/apache/seatunnel/pull/6657#discussion_r1559154474 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/sink/KafkaSinkFactory.java: ## @@ -39,23 +39,26 @@ public Str

Re: [PR] [Fix][API] Fix get SeaTunnelRow size failed when array value has `null` [seatunnel]

2024-04-10 Thread via GitHub
fcb-xiaobo closed pull request #6453: [Fix][API] Fix get SeaTunnelRow size failed when array value has `null` URL: https://github.com/apache/seatunnel/pull/6453 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] [Fix][API] Fix get SeaTunnelRow size failed when array value has `null` [seatunnel]

2024-04-10 Thread via GitHub
fcb-xiaobo commented on PR #6453: URL: https://github.com/apache/seatunnel/pull/6453#issuecomment-2047041161 Sorry, I'm a little busy at work recently and don't have time to deal with this problem, so I'll close it first. -- This is an automated message from the Apache Git Service. To res

Re: [PR] [Improve][Jdbc] Add quote identifier for sql [seatunnel]

2024-04-10 Thread via GitHub
dailai commented on PR #6669: URL: https://github.com/apache/seatunnel/pull/6669#issuecomment-2047041067 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

Re: [I] [Bug] [Oracle-CDC] Can not find catalog table with factoryId [Oracle] [seatunnel]

2024-04-10 Thread via GitHub
luzongzhu commented on issue #6680: URL: https://github.com/apache/seatunnel/issues/6680#issuecomment-2047011465 The new configuration after modifying the source code ,It is a table without primary key @hailin0 env { job.name = "${jobName}" job.mode = "STREAMING" check

[I] [Bug] [Oracle-CDC] Can not find catalog table with factoryId [Oracle] [seatunnel]

2024-04-10 Thread via GitHub
_CREDIT_FINANCE230207", "source_table_name" : "ST_GLOBAL_VIEW_NAME", "sink.enable-delete" : "true", "plugin_name" : "Doris", "sink.label-prefix"

Re: [I] [Bug] [Tool] Failed to resolve parameter [org.apache.seatunnel.e2e.common.container.TestContainer arg0] [seatunnel]

2024-04-10 Thread via GitHub
liunaijie commented on issue #6677: URL: https://github.com/apache/seatunnel/issues/6677#issuecomment-2046969691 try this command: ``` ./mvnw -U -T 1C clean install -DskipTests -D"maven.test.skip"=true -D"maven.javadoc.skip"=true -D"checkstyle.skip"=true -D"license.skipAddThirdParty"

Re: [I] [Bug] [JDBC] JDBC SQLSERVER use table_path reports error when filedname is KEY WORD [seatunnel]

2024-04-10 Thread via GitHub
dailai commented on issue #6675: URL: https://github.com/apache/seatunnel/issues/6675#issuecomment-2046952406 This is indeed a bug and I intend to fix it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] [Feature][starter] support user define parameter on spark/flink engine [seatunnel]

2024-04-10 Thread via GitHub
liunaijie commented on PR #6387: URL: https://github.com/apache/seatunnel/pull/6387#issuecomment-2046948741 > > Could the processing parameter logic of different engines be unified together? It seems that zeta's processing code is a bit scattered now. > > > https://github.com/apache/

Re: [I] Provider org.apache.seatunnel.connectors.seatunnel.file.s3.sink.S3FileSink could not be instantiated [seatunnel]

2024-04-10 Thread via GitHub
pppeace commented on issue #6676: URL: https://github.com/apache/seatunnel/issues/6676#issuecomment-2046935585 same phenomenon. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [I] [Bug] [Zeta] OutOfMemoryError: Compressed class space [seatunnel]

2024-04-10 Thread via GitHub
xueshuai0922 commented on issue #6333: URL: https://github.com/apache/seatunnel/issues/6333#issuecomment-2046862318 > Use 2.3.5 and try again. 2.3.5版本什么时候出 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] [Bug] [Tool] Failed to resolve parameter [org.apache.seatunnel.e2e.common.container.TestContainer arg0] [seatunnel]

2024-04-10 Thread via GitHub
xiaochen-zhou commented on issue #6677: URL: https://github.com/apache/seatunnel/issues/6677#issuecomment-2046853955 > Why is "ls -q"? I was also successful running this test locally alone。Screenshot as follows: ![image](https://private-user-images.githubusercontent.com/18141150/321134448-b

[PR] [Fix][Connector-v2] Fix the sql statement error of create table for doris [seatunnel]

2024-04-10 Thread via GitHub
dailai opened a new pull request, #6679: URL: https://github.com/apache/seatunnel/pull/6679 ### Purpose of this pull request Fix the sql statement error caused by the source table having no primary key or unique key for doris. Link #6646 ### Does this PR introdu

[PR] [Improve][feature] Add JobInstance Delete [seatunnel-web]

2024-04-10 Thread via GitHub
Jetiaime opened a new pull request, #161: URL: https://github.com/apache/seatunnel-web/pull/161 ## Purpose of this pull request This PR adds the JobExecutor Delete functions. It work like this: If the Job haven't been completed, cancel it in the engine, and then delete the res

Re: [I] [Bug] [Doris] sync from mysql to doris create table error [seatunnel]

2024-04-10 Thread via GitHub
dailai commented on issue #6646: URL: https://github.com/apache/seatunnel/issues/6646#issuecomment-2046694073 You can use this property(save_mode_create_template) to override table creation statements. If your source table does not have a primary KEY, it is recommended to use DUPLICATE KEY.