Re: [PR] [improve] update Druid connector config option [seatunnel]

2025-01-29 Thread via GitHub
Hisoka-X commented on PR #8594: URL: https://github.com/apache/seatunnel/pull/8594#issuecomment-2623147635 waiting test case from #8580 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] [Bug] DuplicateKeyException encountered while retrieving the job execution history [seatunnel-web]

2025-01-29 Thread via GitHub
Hisoka-X merged PR #277: URL: https://github.com/apache/seatunnel-web/pull/277 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatu

[PR] Bump org.apache.hive:hive-exec from 2.3.9 to 4.0.1 in /seatunnel-connectors-v2/connector-iceberg [seatunnel]

2025-01-29 Thread via GitHub
dependabot[bot] opened a new pull request, #8597: URL: https://github.com/apache/seatunnel/pull/8597 Bumps org.apache.hive:hive-exec from 2.3.9 to 4.0.1. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=org.apach

Re: [PR] [improve] update Druid connector config option [seatunnel]

2025-01-29 Thread via GitHub
akulabs8 commented on PR #8594: URL: https://github.com/apache/seatunnel/pull/8594#issuecomment-2622548279 @liunaijie @Hisoka-X the checks have passed as well.. Can we move it forward? -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] [Bug] DuplicateKeyException encountered while retrieving the job execution history [seatunnel-web]

2025-01-29 Thread via GitHub
arshadmohammad commented on PR #277: URL: https://github.com/apache/seatunnel-web/pull/277#issuecomment-2621420726 After this fix job execution is displayed without error ![image](https://github.com/user-attachments/assets/00b5ae7c-1d4a-414a-ad53-bc213cad7f4f) -- This is an automat

Re: [PR] [Bug] DuplicateKeyException encountered while retrieving the job execution history [seatunnel-web]

2025-01-29 Thread via GitHub
arshadmohammad commented on PR #277: URL: https://github.com/apache/seatunnel-web/pull/277#issuecomment-2621413841 This is happening because the job history insert is being hit from two code flow at the same time. 1: ` java.lang.Throwable: insert: at org.apache.seatunnel.ap

[PR] [Bug] DuplicateKeyException encountered while retrieving the job execution history [seatunnel-web]

2025-01-29 Thread via GitHub
arshadmohammad opened a new pull request, #277: URL: https://github.com/apache/seatunnel-web/pull/277 immediately after task execution start, task instance page is opened. For small jobs it is throwing following errors 2025-01-29 12:06:18.800 seatunnel WM-TVJM7KC4Y4 ERROR [tr:,sp:] [

Re: [PR] [Improve]Optimize the way of obtaining user information. [seatunnel-web]

2025-01-29 Thread via GitHub
arshadmohammad commented on code in PR #267: URL: https://github.com/apache/seatunnel-web/pull/267#discussion_r1933681198 ## seatunnel-server/seatunnel-app/src/main/java/org/apache/seatunnel/app/config/AsyncConfig.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Software

Re: [PR] [test][ci] Fix test cases are unstable problem [seatunnel]

2025-01-29 Thread via GitHub
liugddx closed pull request #8595: [test][ci] Fix test cases are unstable problem URL: https://github.com/apache/seatunnel/pull/8595 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] [Fix][doris-e2e] Fix flaky Doris e2e tests [seatunnel]

2025-01-29 Thread via GitHub
Hisoka-X merged PR #8596: URL: https://github.com/apache/seatunnel/pull/8596 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [improve] update Druid connector config option [seatunnel]

2025-01-28 Thread via GitHub
liunaijie commented on PR #8594: URL: https://github.com/apache/seatunnel/pull/8594#issuecomment-2620336621 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

Re: [PR] [improve] update activemq connector config option [seatunnel]

2025-01-28 Thread via GitHub
liunaijie commented on code in PR #8580: URL: https://github.com/apache/seatunnel/pull/8580#discussion_r1933043887 ## seatunnel-connectors-v2/connector-activemq/src/main/java/org/apache/seatunnel/connectors/seatunnel/activemq/sink/ActivemqSinkWriter.java: ## @@ -42,11 +40,6 @@ p

[PR] [Fix][doris-e2e] Fix flaky Doris e2e tests [seatunnel]

2025-01-28 Thread via GitHub
jw-itq opened a new pull request, #8596: URL: https://github.com/apache/seatunnel/pull/8596 ### Purpose of this pull request ![Uploading wx20250129-004...@2x.png…]() ### Does this PR introduce _any_ user-facing change? ### How was this patch te

Re: [I] 恢复transform sql支持多source [seatunnel]

2025-01-27 Thread via GitHub
iventong commented on issue #5056: URL: https://github.com/apache/seatunnel/issues/5056#issuecomment-2618043428 多source join 的问题现在如何解决呢 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] [Fix][mysql-cdc] Fix GTIDs on startup to correctly recover from checkpoint [seatunnel]

2025-01-27 Thread via GitHub
jw-itq commented on PR #8528: URL: https://github.com/apache/seatunnel/pull/8528#issuecomment-2617946962 > doris e2e always fails, requesting help! Fixed. Please help review again. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[PR] [test][ci] Fix test cases are unstable problem [seatunnel]

2025-01-27 Thread via GitHub
liugddx opened a new pull request, #8595: URL: https://github.com/apache/seatunnel/pull/8595 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

Re: [I] [Umbrella] unified parameter class and refactor connector creation logic [seatunnel]

2025-01-27 Thread via GitHub
akulabs8 commented on issue #8576: URL: https://github.com/apache/seatunnel/issues/8576#issuecomment-2616534871 Hey @liunaijie , I have come with a draft PR: https://github.com/apache/seatunnel/pull/8594 Please take a look and let me know -- This is an automated message from the Ap

[PR] [improve] update Druid connector config option [seatunnel]

2025-01-27 Thread via GitHub
akulabs8 opened a new pull request, #8594: URL: https://github.com/apache/seatunnel/pull/8594 ### Purpose of this pull request subtask of https://github.com/apache/seatunnel/issues/8576 ### Check list * [ ] If any new Jar binary package adding in your PR, plea

Re: [PR] [improve] update activemq connector config option [seatunnel]

2025-01-27 Thread via GitHub
akulabs8 commented on code in PR #8580: URL: https://github.com/apache/seatunnel/pull/8580#discussion_r1930905238 ## seatunnel-connectors-v2/connector-activemq/src/main/java/org/apache/seatunnel/connectors/seatunnel/activemq/sink/ActivemqSinkWriter.java: ## @@ -42,11 +40,6 @@ pu

Re: [PR] [improve] update activemq connector config option [seatunnel]

2025-01-27 Thread via GitHub
akulabs8 commented on code in PR #8580: URL: https://github.com/apache/seatunnel/pull/8580#discussion_r1930905238 ## seatunnel-connectors-v2/connector-activemq/src/main/java/org/apache/seatunnel/connectors/seatunnel/activemq/sink/ActivemqSinkWriter.java: ## @@ -42,11 +40,6 @@ pu

Re: [I] [Bug] Windows local mode can't start seatunnel server [seatunnel]

2025-01-27 Thread via GitHub
flashvip commented on issue #8227: URL: https://github.com/apache/seatunnel/issues/8227#issuecomment-2616093209 I have the same error when debug code on windows 11,and change the port from 5801 to another port , for example , the program is correct running -- This is an automated mes

Re: [PR] [Fix][Connector-Mongodb] close MongodbClient when close MongodbReader [seatunnel]

2025-01-27 Thread via GitHub
liugddx merged PR #8592: URL: https://github.com/apache/seatunnel/pull/8592 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [I] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-01-26 Thread via GitHub
remones commented on issue #8511: URL: https://github.com/apache/seatunnel/issues/8511#issuecomment-2614990931 > hi~ [@remones](https://github.com/remones) Is there any progress on this task? I'm working on it, I'll finish it in the next few days -- This is an automated message fro

Re: [I] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-01-26 Thread via GitHub
hailin0 commented on issue #8511: URL: https://github.com/apache/seatunnel/issues/8511#issuecomment-2614985865 hi~ @remones Is there any progress on this task? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] [Feature][Selectdb-cloud] Support sink ddl [seatunnel]

2025-01-26 Thread via GitHub
hailin0 commented on issue #8122: URL: https://github.com/apache/seatunnel/issues/8122#issuecomment-2614985274 hi~ @guobaolin Is there any progress on this task? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] [Feature][Iceberg] Support merge fragmented files when sink [seatunnel]

2025-01-26 Thread via GitHub
hailin0 commented on issue #7973: URL: https://github.com/apache/seatunnel/issues/7973#issuecomment-2614984863 hi~ @sunxiaojian Is there any progress on this task? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [I] [Bug] [transform] 2.3.9 version can not support replace function [seatunnel]

2025-01-26 Thread via GitHub
github-actions[bot] commented on issue #8395: URL: https://github.com/apache/seatunnel/issues/8395#issuecomment-2614660228 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [Module Name] HADOOP_HOME and hadoop.home.dir are unset [seatunnel]

2025-01-26 Thread via GitHub
github-actions[bot] commented on issue #8365: URL: https://github.com/apache/seatunnel/issues/8365#issuecomment-2614660282 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [Connector-V2] PostgreSQL JDBC Sink Fails to Handle 0x00 Null Byte in Source Data [seatunnel]

2025-01-26 Thread via GitHub
github-actions[bot] commented on issue #8393: URL: https://github.com/apache/seatunnel/issues/8393#issuecomment-2614660241 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] seatunnel oracle invalid [seatunnel]

2025-01-26 Thread via GitHub
github-actions[bot] commented on issue #8389: URL: https://github.com/apache/seatunnel/issues/8389#issuecomment-2614660253 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [Hive source connector] OrcReadStrategy 读取文件出现 NLP [seatunnel]

2025-01-26 Thread via GitHub
Light-Towers commented on issue #8427: URL: https://github.com/apache/seatunnel/issues/8427#issuecomment-2614270615 > Are you saying that if a field in the Hive table is an array and there are two records with the same array value, this bug will be triggered? Yes, if nonull records in

Re: [I] [Bug] [Hive source connector] OrcReadStrategy 读取文件出现 NLP [seatunnel]

2025-01-25 Thread via GitHub
TyrantLucifer commented on issue #8427: URL: https://github.com/apache/seatunnel/issues/8427#issuecomment-2614216800 Are you saying that if a field in the Hive table is an array and there are two records with the same array value, this bug will be triggered? -- This is an automated messag

Re: [I] [Feature][Zeta] Support enable https protocol for rest-api v2 [seatunnel]

2025-01-25 Thread via GitHub
liugddx commented on issue #8583: URL: https://github.com/apache/seatunnel/issues/8583#issuecomment-2614201796 > Hey I am new to this repo but would like to contribute, so shall I help? Sure. Please feel free to let me know if you have any questions. -- This is an automated message

Re: [I] [Bug][Connector-V2][Assert] AssertSinkWriter supports multiple concurrent operations [seatunnel]

2025-01-25 Thread via GitHub
github-actions[bot] commented on issue #8357: URL: https://github.com/apache/seatunnel/issues/8357#issuecomment-2614150574 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [PR] [Fix][mysql-cdc] Fix GTIDs on startup to correctly recover from checkpoint [seatunnel]

2025-01-25 Thread via GitHub
jw-itq commented on PR #8528: URL: https://github.com/apache/seatunnel/pull/8528#issuecomment-2613982482 doris e2e always fails, requesting help! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [I] [Bug] [Module Name] class org.apache.kafka.common.serialization.ByteArraySerializer is not an instance of org.apache.kafka.common.serialization.Serializer [seatunnel]

2025-01-25 Thread via GitHub
mcagriaktas commented on issue #4023: URL: https://github.com/apache/seatunnel/issues/4023#issuecomment-2613932241 Hello, I was getting the error in flink 1.20.0 and kafka 3.8.0, also I'm using flink-kafka-connector 3.4.0: libraryDependencies ++= Seq( "org.apache.flink" %% "flink

Re: [I] [Umbrella] unified parameter class and refactor connector creation logic [seatunnel]

2025-01-25 Thread via GitHub
akulabs8 commented on issue #8576: URL: https://github.com/apache/seatunnel/issues/8576#issuecomment-2613836106 I would like to start with Kafka one -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [I] [Umbrella] unified parameter class and refactor connector creation logic [seatunnel]

2025-01-24 Thread via GitHub
liunaijie commented on issue #8576: URL: https://github.com/apache/seatunnel/issues/8576#issuecomment-2613819677 > Hey , I would like to contribute Hi, thank you want to do this with me. And Just comment which connector you want to update, I will assign it to you. -- This is an aut

Re: [PR] [improve] update activemq connector config option [seatunnel]

2025-01-24 Thread via GitHub
liunaijie commented on PR #8580: URL: https://github.com/apache/seatunnel/pull/8580#issuecomment-2613819003 > I think we should add a test case to verify the all connector has xxxSinkOptions or xxxSourceOptions. Good point, I will write the test. -- This is an automated message fro

Re: [I] [Bug] [Connector-V2] Source Oracle-CDC Sink Clickhouse checkpoint timeout [seatunnel]

2025-01-24 Thread via GitHub
bwcxyk commented on issue #8364: URL: https://github.com/apache/seatunnel/issues/8364#issuecomment-2613755750 2.3.9 Not verified -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [I] [Fix] fix deadlink in website [seatunnel]

2025-01-24 Thread via GitHub
davidzollo commented on issue #8573: URL: https://github.com/apache/seatunnel/issues/8573#issuecomment-2613728915 https://github.com/user-attachments/assets/a3709e0f-9f42-4ca8-a454-5bea858e4089"; /> You pull the project `https://github.com/apache/seatunnel.git` using IntelliJ IDEA or

Re: [I] [Bug] [Connector-V2] Source Oracle-CDC Sink Clickhouse checkpoint timeout [seatunnel]

2025-01-24 Thread via GitHub
github-actions[bot] commented on issue #8364: URL: https://github.com/apache/seatunnel/issues/8364#issuecomment-2613653229 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [Connector-V2] 'KingBase' unsupported convert type 'float' of 'xxx' to SeaTunnel data type. [seatunnel]

2025-01-24 Thread via GitHub
github-actions[bot] commented on issue #8381: URL: https://github.com/apache/seatunnel/issues/8381#issuecomment-2613652588 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [Flink] The flink e2e is faulty [seatunnel]

2025-01-24 Thread via GitHub
github-actions[bot] commented on issue #8383: URL: https://github.com/apache/seatunnel/issues/8383#issuecomment-2613652510 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [Connector-V2] connector-maxcompute: The source reader may cause data duplication [seatunnel]

2025-01-24 Thread via GitHub
github-actions[bot] commented on issue #8379: URL: https://github.com/apache/seatunnel/issues/8379#issuecomment-2613652852 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [Milvus] MilvusConnectorException: ErrorCode:[MILVUS-22], ErrorDescription:[Milvus write error] [seatunnel]

2025-01-24 Thread via GitHub
mananpreetsingh commented on issue #8593: URL: https://github.com/apache/seatunnel/issues/8593#issuecomment-2613341843 Found the issue seems I have to specify this option in sink, otherwise it is not able to get it by default, Doc says though this is not required and has the default value s

Re: [I] [Bug] [Milvus] MilvusConnectorException: ErrorCode:[MILVUS-22], ErrorDescription:[Milvus write error] [seatunnel]

2025-01-24 Thread via GitHub
mananpreetsingh closed issue #8593: [Bug] [Milvus] MilvusConnectorException: ErrorCode:[MILVUS-22], ErrorDescription:[Milvus write error] URL: https://github.com/apache/seatunnel/issues/8593 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [I] [Bug] [Oracle JDBC]Oracle source connect to oracle 11g failed [seatunnel]

2025-01-24 Thread via GitHub
akulabs8 commented on issue #8537: URL: https://github.com/apache/seatunnel/issues/8537#issuecomment-2613121626 @davidzollo Hey, please assign it to me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] [Feature][Core] Support Flink 1.20.0 [seatunnel]

2025-01-24 Thread via GitHub
akulabs8 commented on issue #8531: URL: https://github.com/apache/seatunnel/issues/8531#issuecomment-2613118951 @hailin0 hey I am open to contribute to this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [I] [Feature][Zeta] Support enable https protocol for rest-api v2 [seatunnel]

2025-01-24 Thread via GitHub
akulabs8 commented on issue #8583: URL: https://github.com/apache/seatunnel/issues/8583#issuecomment-2613010528 Hey I am new to this repo but would like to contribute, so shall I help? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] [Umbrella] unified parameter class and refactor connector creation logic [seatunnel]

2025-01-24 Thread via GitHub
akulabs8 commented on issue #8576: URL: https://github.com/apache/seatunnel/issues/8576#issuecomment-2613001456 Hey , I would like to contribute -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[I] [Bug] [Milvus] MilvusConnectorException: ErrorCode:[MILVUS-22], ErrorDescription:[Milvus write error] [seatunnel]

2025-01-24 Thread via GitHub
mananpreetsingh opened a new issue, #8593: URL: https://github.com/apache/seatunnel/issues/8593 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What ha

Re: [I] [Bug] [Engine] Frequent "TaskGroupLocation: TaskGroupLocation xxx already exists" error during task execution, causing task failure. [seatunnel]

2025-01-24 Thread via GitHub
lphbdfj commented on issue #8566: URL: https://github.com/apache/seatunnel/issues/8566#issuecomment-2612828800 I have also encountered this issue and have not yet found a solution. I hope the official team can provide a resolution as soon as possible. -> [Bug] [Engine] Frequent "TaskGroupLo

Re: [I] [Bug] SeaTunnel job executed failed [seatunnel]

2025-01-24 Thread via GitHub
mananpreetsingh commented on issue #6854: URL: https://github.com/apache/seatunnel/issues/6854#issuecomment-2612783265 I retested with docker tag [v1.1.0] it seems working with this tag but after this it starts giving error [v1.1.0] So seems somthing changed may be with seatunnel. I

[PR] [Fix][Connector-Mongodb] close MongodbClient when close MongodbReader [seatunnel]

2025-01-24 Thread via GitHub
sohurdc opened a new pull request, #8592: URL: https://github.com/apache/seatunnel/pull/8592 ### Purpose of this pull request fix mongodb connection leak in zeta cluster deploy mode. ### Does this PR introduce _any_ user-facing change? no ### Ho

[PR] [Feature][env]Load `seatunnel-env` into job env [seatunnel]

2025-01-24 Thread via GitHub
liugddx opened a new pull request, #8591: URL: https://github.com/apache/seatunnel/pull/8591 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

Re: [I] [Bug] [Hive source connector] OrcReadStrategy 读取文件出现 NLP [seatunnel]

2025-01-24 Thread via GitHub
Light-Towers commented on issue #8427: URL: https://github.com/apache/seatunnel/issues/8427#issuecomment-2612032870 调试后发现,当一批次某个字段数据都一样时,rowBatch.cols[0].child.vector中只会剩下一条数据,而对应的 ![Image](https://github.com/user-attachments/assets/cf266f9b-8611-406b-99e1-d0f6b9da0e92) -- This is

Re: [I] [Bug] [Hive source connector] OrcReadStrategy 读取文件出现 NLP [seatunnel]

2025-01-23 Thread via GitHub
Light-Towers commented on issue #8427: URL: https://github.com/apache/seatunnel/issues/8427#issuecomment-2611883429 我发现当数组字段中如果数据完全一致就会异常,像这样, ![Image](https://github.com/user-attachments/assets/07a7af1f-5cc6-41fc-a570-cce6949aa4e0) 而只要有1条数据不同便会成功。 -- This is an automate

[I] [Feature][Module Name]is sftpfile and ftpfile source connectors can add deletePolicy [seatunnel]

2025-01-23 Thread via GitHub
18859108815 opened a new issue, #8590: URL: https://github.com/apache/seatunnel/issues/8590 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Bugfix][example] Fixing spark test cases [seatunnel]

2025-01-23 Thread via GitHub
wuchunfu merged PR #8589: URL: https://github.com/apache/seatunnel/pull/8589 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [Bugfix][example] Fixing spark test cases [seatunnel]

2025-01-23 Thread via GitHub
hailin0 commented on PR #8589: URL: https://github.com/apache/seatunnel/pull/8589#issuecomment-2611706674 fix pr https://github.com/apache/seatunnel/pull/8137/files#diff-771950651977f51df4fd56fe4c68d635bf67fc2f9ed0c2f7ef2d42387647e874 -- This is an automated message from the Apache Git

[PR] [Bugfix][example] Fixing spark test cases [seatunnel]

2025-01-23 Thread via GitHub
liugddx opened a new pull request, #8589: URL: https://github.com/apache/seatunnel/pull/8589 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

[I] How to Implement Data Incremental Loading [seatunnel]

2025-01-23 Thread via GitHub
bodyea opened a new issue, #8588: URL: https://github.com/apache/seatunnel/issues/8588 There are two databases: one for production and the other for backup. Now, I need to perform incremental backup for a table. One of the tables has a field id, which is an integer and the primary key. When

Re: [PR] [Fix][mysql-cdc] Fix GTIDs on startup to correctly recover from checkpoint [seatunnel]

2025-01-23 Thread via GitHub
jw-itq commented on PR #8528: URL: https://github.com/apache/seatunnel/pull/8528#issuecomment-2611538918 > https://private-user-images.githubusercontent.com/14371345/406300133-ff624099-5367-4d8f-9512-4bc0fe7406a2.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjo

Re: [PR] [Fix][mysql-cdc] Fix GTIDs on startup to correctly recover from checkpoint [seatunnel]

2025-01-23 Thread via GitHub
hailin0 commented on PR #8528: URL: https://github.com/apache/seatunnel/pull/8528#issuecomment-2611523600 https://github.com/user-attachments/assets/ff624099-5367-4d8f-9512-4bc0fe7406a2"; /> -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [I] [Bug] [HIVE Plugin] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty [seatunnel]

2025-01-23 Thread via GitHub
jianJizz commented on issue #8575: URL: https://github.com/apache/seatunnel/issues/8575#issuecomment-2611483277 Can someone take a look at this?please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] [Bug] [Connector v2] Sink to iceberg MinIO; but getting org.apache.iceberg.aws.s3.S3FileIO does not implement FileIO [seatunnel]

2025-01-23 Thread via GitHub
litiliu commented on issue #8585: URL: https://github.com/apache/seatunnel/issues/8585#issuecomment-2611458794 I think it's related to classloader or classpath, Seems the org.apache.iceberg.aws.s3.S3FileIO And org.apache.iceberg.io.FileIO were loaded by the different classloader. Have you

Re: [PR] [Fix][MySQL-CDC]fix recovery task failure caused by binlog deletion [seatunnel]

2025-01-23 Thread via GitHub
hailin0 commented on PR #8587: URL: https://github.com/apache/seatunnel/pull/8587#issuecomment-2611446836 Thanks! Please add test cases -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] [Doc] Fix README_CN.md Word Spell Error [seatunnel-web]

2025-01-23 Thread via GitHub
Hisoka-X merged PR #271: URL: https://github.com/apache/seatunnel-web/pull/271 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatu

[I] [Bug] [MySQL-CDC] Restore task failed due to the deletion of binlog [seatunnel]

2025-01-23 Thread via GitHub
lm-ylj opened a new issue, #8586: URL: https://github.com/apache/seatunnel/issues/8586 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] Mysql-CDC -> Doris Sink [BUG] [seatunnel]

2025-01-23 Thread via GitHub
strayye commented on issue #7050: URL: https://github.com/apache/seatunnel/issues/7050#issuecomment-2611409591 sink.label-prefix="${database_name}" success -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [I] [Feature][Zeta] Support enable https protocol [seatunnel]

2025-01-23 Thread via GitHub
hailin0 commented on issue #8583: URL: https://github.com/apache/seatunnel/issues/8583#issuecomment-2611385688 > This is a demo > > ``` > import org.eclipse.jetty.server.Server; > import org.eclipse.jetty.server.ServerConnector; > import org.eclipse.jetty.util.ssl.SslContextFa

Re: [PR] [Feature][seatunnel-transforms-v2] LLM transform Support Ollama return format #8550 [seatunnel]

2025-01-23 Thread via GitHub
Hisoka-X commented on PR #8551: URL: https://github.com/apache/seatunnel/pull/8551#issuecomment-2611360693 Please retry failed ci. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [I] [Feature][Zeta] Support enable https protocol [seatunnel]

2025-01-23 Thread via GitHub
liugddx commented on issue #8583: URL: https://github.com/apache/seatunnel/issues/8583#issuecomment-2611340120 This is a demo ``` import org.eclipse.jetty.server.Server; import org.eclipse.jetty.server.ServerConnector; import org.eclipse.jetty.util.ssl.SslContextFactory;

Re: [PR] [Feature][transform-v2] jsonpath support map array type [seatunnel]

2025-01-23 Thread via GitHub
CosmosNi commented on PR #8577: URL: https://github.com/apache/seatunnel/pull/8577#issuecomment-2611333606 @hailin0 @Hisoka-X PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [I] [Bug] [k8s_Deploy] The client submits tasks and the home directory of the cluster must be consistent?? [seatunnel]

2025-01-23 Thread via GitHub
github-actions[bot] commented on issue #8371: URL: https://github.com/apache/seatunnel/issues/8371#issuecomment-2611291516 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] mysql CDC to starRocks ,Seatunnel save_mode_create_template 在 ${rowtype_fields} 后跟 op_time 字段(DEFAULT CURRENT_TIMESTAMP),写数据时op_time 时为 null [seatunnel]

2025-01-23 Thread via GitHub
github-actions[bot] commented on issue #8370: URL: https://github.com/apache/seatunnel/issues/8370#issuecomment-2611291548 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][Flink] Optimization of Flink Source Busy Problem [seatunnel]

2025-01-23 Thread via GitHub
github-actions[bot] commented on issue #8358: URL: https://github.com/apache/seatunnel/issues/8358#issuecomment-2611291654 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

[I] [Bug] [Connector v2] Sink to iceberg MinIO; but getting org.apache.iceberg.aws.s3.S3FileIO does not implement FileIO [seatunnel]

2025-01-23 Thread via GitHub
larryloi opened a new issue, #8585: URL: https://github.com/apache/seatunnel/issues/8585 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Feature][seatunnel-transforms-v2] LLM transform Support Ollama return format #8550 [seatunnel]

2025-01-23 Thread via GitHub
SplitfireUptown commented on PR #8551: URL: https://github.com/apache/seatunnel/pull/8551#issuecomment-2610020811 > > > Could you add a test case for this? Thanks > > > > > > i commit a new test case, please check it > > @SplitfireUptown Remember to retry the failure ci

[PR] [Doc][Improve] translate Redis/Paimon related chinese document [seatunnel]

2025-01-23 Thread via GitHub
lyne7-sc opened a new pull request, #8584: URL: https://github.com/apache/seatunnel/pull/8584 ### Purpose of this pull request [Doc][Improve] support chinese #8497 ### Does this PR introduce _any_ user-facing change? ### How was this patch test

Re: [PR] [Doc][Mysql-cdc]Update doc to support mysql 8.0 [seatunnel]

2025-01-23 Thread via GitHub
hailin0 merged PR #8579: URL: https://github.com/apache/seatunnel/pull/8579 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [improve] update activemq connector config option [seatunnel]

2025-01-23 Thread via GitHub
Hisoka-X commented on PR #8580: URL: https://github.com/apache/seatunnel/pull/8580#issuecomment-2609560566 I think we should add a test case to verify the all connector has xxxSinkOptions or xxxSourceOptions. -- This is an automated message from the Apache Git Service. To respond to the m

[I] [Feature][Zeta] Support enable https protocol [seatunnel]

2025-01-23 Thread via GitHub
hailin0 opened a new issue, #8583: URL: https://github.com/apache/seatunnel/issues/8583 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

Re: [PR] [Improve] Update snapshot version to 2.3.10 [seatunnel]

2025-01-23 Thread via GitHub
Hisoka-X merged PR #8578: URL: https://github.com/apache/seatunnel/pull/8578 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [I] [Umbrella] unified parameter class and refactor connector creation logic [seatunnel]

2025-01-23 Thread via GitHub
liunaijie commented on issue #8576: URL: https://github.com/apache/seatunnel/issues/8576#issuecomment-2609370843 example pr : https://github.com/apache/seatunnel/pull/8580 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[PR] [Feature][Connector-V2] Support maxcompute source with multi-table [seatunnel]

2025-01-23 Thread via GitHub
Hisoka-X opened a new pull request, #8582: URL: https://github.com/apache/seatunnel/pull/8582 ### Purpose of this pull request Support maxcompute source with multi-table, update e2e test case. ### Does this PR introduce _any_ user-facing change? no

Re: [I] [Bug] [seatunnel-web] seatunnel-web integration bug ---- java.lang.NoClassDefFoundError: org/apache/seatunnel/api/table/factory/ChangeStreamTableSourceFactory [seatunnel]

2025-01-23 Thread via GitHub
tianxingdao commented on issue #8496: URL: https://github.com/apache/seatunnel/issues/8496#issuecomment-2609319305 I have the same problem -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[PR] [feature][connectors-v2][ActiveMQ] add ActiveMQ source connector [seatunnel]

2025-01-23 Thread via GitHub
L-Gryps opened a new pull request, #8581: URL: https://github.com/apache/seatunnel/pull/8581 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

Re: [PR] [improve] update activemq connector config option [seatunnel]

2025-01-23 Thread via GitHub
liunaijie commented on code in PR #8580: URL: https://github.com/apache/seatunnel/pull/8580#discussion_r1926615120 ## seatunnel-connectors-v2/connector-activemq/src/main/java/org/apache/seatunnel/connectors/seatunnel/activemq/config/ActivemqSinkOptions.java: ## @@ -17,56 +17,12

[PR] [improve] update activemq connector config option [seatunnel]

2025-01-23 Thread via GitHub
liunaijie opened a new pull request, #8580: URL: https://github.com/apache/seatunnel/pull/8580 ### Purpose of this pull request subtask of #8576 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested?

Re: [I] [Feature][SqlServer CDC] Custom Fields [seatunnel]

2025-01-23 Thread via GitHub
trhlxc commented on issue #8529: URL: https://github.com/apache/seatunnel/issues/8529#issuecomment-2609159620 # 2.3.9 edit > src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/catalog/AbstractJdbcCatalog.java add `//Get the base type of a field's custom type public

Re: [I] [Bug] [Module Name] Caused by: org.apache.seatunnel.engine.common.exception.SeaTunnelEngineException: org.apache.seatunnel.engine.server.checkpoint.CheckpointException: CheckpointCoordinator i

2025-01-23 Thread via GitHub
wangbing505 commented on issue #5396: URL: https://github.com/apache/seatunnel/issues/5396#issuecomment-2609110463 Solved? same problem -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[PR] [Doc][Mysql-cdc]Update doc to support mysql 8.0 [seatunnel]

2025-01-23 Thread via GitHub
litiliu opened a new pull request, #8579: URL: https://github.com/apache/seatunnel/pull/8579 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

Re: [PR] [Fix][connector-http] fix when post have param [seatunnel]

2025-01-22 Thread via GitHub
Hisoka-X commented on code in PR #8434: URL: https://github.com/apache/seatunnel/pull/8434#discussion_r1926417932 ## docs/en/connector-v2/source/Http.md: ## @@ -67,6 +67,7 @@ They can be downloaded via install-plugin.sh or from the Maven central repositor | connect_timeout_ms

Re: [PR] [Fix][Connector-V2] User selects csv string pattern [seatunnel]

2025-01-22 Thread via GitHub
Hisoka-X commented on code in PR #8572: URL: https://github.com/apache/seatunnel/pull/8572#discussion_r1926452506 ## docs/en/connector-v2/sink/S3File.md: ## @@ -119,6 +119,7 @@ If write to `csv`, `text` file type, All column will be string. | common-options

Re: [PR] [Feature][seatunnel-transforms-v2] LLM transform Support Ollama return format #8550 [seatunnel]

2025-01-22 Thread via GitHub
corgy-w commented on PR #8551: URL: https://github.com/apache/seatunnel/pull/8551#issuecomment-2608982640 > > Could you add a test case for this? Thanks > > i commit a new test case, please check it @SplitfireUptown Remember to retry the failure ci -- This is an automated

Re: [PR] [Feature][seatunnel-transforms-v2] LLM transform Support Ollama return format #8550 [seatunnel]

2025-01-22 Thread via GitHub
SplitfireUptown commented on PR #8551: URL: https://github.com/apache/seatunnel/pull/8551#issuecomment-2608979696 > Could you add a test case for this? Thanks i commit a new test case, please check it -- This is an automated message from the Apache Git Service. To respond to the mes

Re: [PR] [Fix][Connector-V2] User selects csv string pattern [seatunnel]

2025-01-22 Thread via GitHub
Hisoka-X commented on code in PR #8572: URL: https://github.com/apache/seatunnel/pull/8572#discussion_r1926400564 ## seatunnel-formats/seatunnel-format-csv/src/main/java/org/apache/seatunnel/format/csv/CsvSerializationSchema.java: ## @@ -63,14 +64,16 @@ private CsvSerializationS

Re: [PR] [Feature][transform-v2] Support transform metrics [seatunnel]

2025-01-22 Thread via GitHub
CosmosNi commented on code in PR #8173: URL: https://github.com/apache/seatunnel/pull/8173#discussion_r1926353554 ## seatunnel-transforms-v2/src/main/java/org/apache/seatunnel/transform/common/AbstractSeaTunnelTransform.java: ## @@ -37,14 +41,39 @@ public abstract class Abstract

  1   2   3   4   5   6   7   8   9   10   >