Re: [PR] [improve] update S3File connector config option [seatunnel]

2025-02-05 Thread via GitHub
liunaijie commented on PR #8609: URL: https://github.com/apache/seatunnel/pull/8609#issuecomment-2639045828 thanks @litiliu for your work. the s3 connector also have `S3FileSource`, can you help add this Option class too. -- This is an automated message from the Apache Git Service

Re: [PR] [hotfix][doc] typo HdfsFile doc [seatunnel]

2025-02-05 Thread via GitHub
liunaijie merged PR #8613: URL: https://github.com/apache/seatunnel/pull/8613 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatun

(seatunnel) branch dev updated: [hotfix][doc] typo HdfsFile doc (#8613)

2025-02-05 Thread jarvis
This is an automated email from the ASF dual-hosted git repository. jarvis pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 0bf069364b [hotfix][doc] typo HdfsFile doc (#8613)

Re: [I] [Bug] [Connector-V2] fix jdbc-multi-metrics bug [seatunnel]

2025-02-05 Thread via GitHub
W-dragan commented on issue #7479: URL: https://github.com/apache/seatunnel/issues/7479#issuecomment-2639001129 @corgy-w I found that you solved this problem in 7484. MySQL is fine, but if it's Oracle, tableName = metadata.getTableName(1); databaseName = metadata.getCatalogName(1);

Re: [PR] typo fix [seatunnel-website]

2025-02-05 Thread via GitHub
wgzhao commented on PR #358: URL: https://github.com/apache/seatunnel-website/pull/358#issuecomment-2638966143 I create the PR: https://github.com/apache/seatunnel/pull/8613 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[PR] [hotfix][doc] Fix typo in HdfsFile.md doc [seatunnel]

2025-02-05 Thread via GitHub
wgzhao opened a new pull request, #8613: URL: https://github.com/apache/seatunnel/pull/8613 The HDFS file format options is `file_format_type` instead of `file_format` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [PR] [Fix][Connector-V2] Fix paimon sink restore error [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on code in PR #8598: URL: https://github.com/apache/seatunnel/pull/8598#discussion_r1944180216 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/master/JobMaster.java: ## @@ -245,7 +245,6 @@ public synchronized void i

Re: [PR] typo fix [seatunnel-website]

2025-02-05 Thread via GitHub
Hisoka-X commented on PR #358: URL: https://github.com/apache/seatunnel-website/pull/358#issuecomment-2638960104 Thanks @wgzhao . Could you try to raise a PR on ours SeaTunnel repository? https://github.com/apache/seatunnel/blob/dev/docs/en/connector-v2/source/HdfsFile.md -- This is an a

Re: [PR] [Fix][Connector-V2] Fix paimon sink restore error [seatunnel]

2025-02-05 Thread via GitHub
uniding commented on code in PR #8598: URL: https://github.com/apache/seatunnel/pull/8598#discussion_r1944177137 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/master/JobMaster.java: ## @@ -245,7 +245,6 @@ public synchronized void in

Re: [PR] [Feature][seatunnel-transforms-v2] LLM transform Support Ollama return format #8550 [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on code in PR #8551: URL: https://github.com/apache/seatunnel/pull/8551#discussion_r1944164440 ## seatunnel-transforms-v2/src/test/java/org/apache/seatunnel/transform/llm/LLMRequestJsonTest.java: ## @@ -209,4 +208,50 @@ void testCustomRequestJson() throws IOEx

Re: [I] [Bug] [o.a.s.c.s.SeaTunnel] Caused by: java.lang.RuntimeException: Failed to inference model (LLM) [seatunnel]

2025-02-05 Thread via GitHub
YuriyGavrilov commented on issue #8604: URL: https://github.com/apache/seatunnel/issues/8604#issuecomment-2638901983 make some config update to filter rows like this ``` env { parallelism = 1 job.mode = "BATCH" read_limit.rows_per_second = 120 } source {

Re: [I] [Umbrella] unified parameter class and refactor connector creation logic [seatunnel]

2025-02-05 Thread via GitHub
wattt3 commented on issue #8576: URL: https://github.com/apache/seatunnel/issues/8576#issuecomment-2638934511 @liunaijie please assign me connector-kafka -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [Feature][seatunnel-transforms-v2] LLM transform Support Ollama return format #8550 [seatunnel]

2025-02-05 Thread via GitHub
SplitfireUptown commented on PR #8551: URL: https://github.com/apache/seatunnel/pull/8551#issuecomment-2638929455 > Please retry failed ci. all ci successful -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [PR] [Fix][Connector-V2] User selects csv string pattern [seatunnel]

2025-02-05 Thread via GitHub
hailin0 commented on PR #8572: URL: https://github.com/apache/seatunnel/pull/8572#issuecomment-2638925639 waiting for ci passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] [Fix][Connector-V2] User selects csv string pattern [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on code in PR #8572: URL: https://github.com/apache/seatunnel/pull/8572#discussion_r1944071549 ## docs/zh/connector-v2/sink/HdfsFile.md: ## @@ -181,10 +182,19 @@ HdfsFile { is_enable_transaction = true } ``` + ### enable_header_write [boolean] 仅在 fi

Re: [PR] [Fix][Plugin] Optimize the plugin discovery mechanism [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on code in PR #8603: URL: https://github.com/apache/seatunnel/pull/8603#discussion_r1944064856 ## seatunnel-plugin-discovery/src/main/java/org/apache/seatunnel/plugin/discovery/AbstractPluginDiscovery.java: ## @@ -403,156 +409,104 @@ private Optional findPlug

Re: [PR] [Fix][Engine-Server] close task when job finished to release resource. [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on PR #8610: URL: https://github.com/apache/seatunnel/pull/8610#issuecomment-2638763005 Have you tried enable `classloader-cache-mode`? https://seatunnel.apache.org/docs/2.3.9/seatunnel-engine/hybrid-cluster-deployment#45-class-loader-cache-mode -- This is an automated

Re: [PR] [Fix][Engine-Server] close task when job finished to release resource. [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on code in PR #8610: URL: https://github.com/apache/seatunnel/pull/8610#discussion_r1944056316 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/sink/SeaTunnelSink.java: ## @@ -145,4 +145,6 @@ default Optional> getAggregatedCommitInfoSeria default

Re: [PR] [improve] cassandra connector options [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on PR #8608: URL: https://github.com/apache/seatunnel/pull/8608#issuecomment-2638755650 Please rebase from dev. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [improve] update activemq connector config option [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on PR #8580: URL: https://github.com/apache/seatunnel/pull/8580#issuecomment-2638756419 Please rebase from dev. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [improve] update Druid connector config option [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on PR #8594: URL: https://github.com/apache/seatunnel/pull/8594#issuecomment-2638756127 Please rebase from dev. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [improve] amazon sqs connector update [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on PR #8602: URL: https://github.com/apache/seatunnel/pull/8602#issuecomment-2638755794 Please rebase from dev. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [improve] update amazondynamodb connector [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on PR #8601: URL: https://github.com/apache/seatunnel/pull/8601#issuecomment-2638755958 Please rebase from dev. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [improve] update S3File connector config option [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on PR #8609: URL: https://github.com/apache/seatunnel/pull/8609#issuecomment-2638755529 Please rebase from dev. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [improve] cdc options [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on PR #8612: URL: https://github.com/apache/seatunnel/pull/8612#issuecomment-2638755387 Please rebase from dev. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [Refactor][core] Unify transformFactory creation logic [seatunnel]

2025-02-05 Thread via GitHub
hailin0 merged PR #8574: URL: https://github.com/apache/seatunnel/pull/8574 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Refactor][core] Unify transformFactory creation logic (#8574)

2025-02-05 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 99fa19d2ea [Refactor][core] Unify transformFact

Re: [PR] [improve] add connector options class exist check [seatunnel]

2025-02-05 Thread via GitHub
hailin0 merged PR #8600: URL: https://github.com/apache/seatunnel/pull/8600 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [improve] add connector options class exist check (#8600)

2025-02-05 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 6468a1b53a [improve] add connector options clas

Re: [PR] [Fix][Plugin] Optimize the plugin discovery mechanism [seatunnel]

2025-02-05 Thread via GitHub
corgy-w commented on PR #8603: URL: https://github.com/apache/seatunnel/pull/8603#issuecomment-2638721934 cc @hailin0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] [Fix][Connector-V2] Fix paimon sink restore error [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X commented on code in PR #8598: URL: https://github.com/apache/seatunnel/pull/8598#discussion_r1944028391 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/master/JobMaster.java: ## @@ -245,7 +245,6 @@ public synchronized void i

[PR] typo fix [seatunnel-website]

2025-02-05 Thread via GitHub
wgzhao opened a new pull request, #358: URL: https://github.com/apache/seatunnel-website/pull/358 the hdfs file format options is `file_format_type` instead of `file_format` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[PR] [improve] cdc options [seatunnel]

2025-02-05 Thread via GitHub
liunaijie opened a new pull request, #8612: URL: https://github.com/apache/seatunnel/pull/8612 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

Re: [PR] [Fix][Connector-V2] Fix paimon sink restore error [seatunnel]

2025-02-05 Thread via GitHub
uniding commented on code in PR #8598: URL: https://github.com/apache/seatunnel/pull/8598#discussion_r1943890373 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/master/JobMaster.java: ## @@ -245,7 +245,6 @@ public synchronized void in

Re: [PR] [Fix][Connector-V2] Fix paimon sink restore error [seatunnel]

2025-02-05 Thread via GitHub
uniding commented on code in PR #8598: URL: https://github.com/apache/seatunnel/pull/8598#discussion_r1943890373 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/master/JobMaster.java: ## @@ -245,7 +245,6 @@ public synchronized void in

Re: [I] [Bug] mysql cdc to paimon ,from checkpoint restart error [seatunnel]

2025-02-05 Thread via GitHub
uniding commented on issue #8460: URL: https://github.com/apache/seatunnel/issues/8460#issuecomment-2638341020 This is a bug Sent from Proton Mail for iOS On 周四, 2月 6, 2025 08:30, github-actions[bot] ***@***.***> 来信: > This issue has been automatically marked as stale bec

Re: [I] [Bug] mysql cdc to paimon ,from checkpoint restart error [seatunnel]

2025-02-05 Thread via GitHub
github-actions[bot] commented on issue #8460: URL: https://github.com/apache/seatunnel/issues/8460#issuecomment-2638338145 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [Source.LocalFile] issue about line break and double qutotation for csv file [seatunnel]

2025-02-05 Thread via GitHub
github-actions[bot] commented on issue #8444: URL: https://github.com/apache/seatunnel/issues/8444#issuecomment-2638338184 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [o.a.s.c.s.SeaTunnel] Caused by: java.lang.RuntimeException: Failed to inference model (LLM) [seatunnel]

2025-02-05 Thread via GitHub
YuriyGavrilov commented on issue #8604: URL: https://github.com/apache/seatunnel/issues/8604#issuecomment-2637842754 > > Thanks [@liunaijie](https://github.com/liunaijie) This is main reason of crash But I can't understood what wrong with this character it is just simply "?" ( I didn't try

Re: [PR] [Refactor][core] Unify transformFactory creation logic [seatunnel]

2025-02-05 Thread via GitHub
liugddx commented on code in PR #8574: URL: https://github.com/apache/seatunnel/pull/8574#discussion_r1942683399 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/factory/FactoryUtil.java: ## @@ -273,6 +283,23 @@ public static URL getFactoryUrl(T factory) {

[I] [Improve][Connector-V2] Support maxcompute sink writer with upsert session mode [seatunnel]

2025-02-05 Thread via GitHub
Hisoka-X opened a new issue, #8611: URL: https://github.com/apache/seatunnel/issues/8611 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] [Feature][Config] Support custom config keys for encrypt/decrypt [seatunnel]

2025-02-05 Thread via GitHub
litiliu commented on issue #8511: URL: https://github.com/apache/seatunnel/issues/8511#issuecomment-2636077569 this issue seems to be similar with #8494 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[PR] [Fix][Engine-Server] close task when job finished to release resource. [seatunnel]

2025-02-05 Thread via GitHub
sohurdc opened a new pull request, #8610: URL: https://github.com/apache/seatunnel/pull/8610 ### Purpose of this pull request close resource when job finished. ![image](https://github.com/user-attachments/assets/7c9cf289-4473-4944-8257-bf7c8073fed0) the class SeaTunn

Re: [PR] [Doc][Improve] translate Redis/Paimon related chinese document [seatunnel]

2025-02-05 Thread via GitHub
hailin0 merged PR #8584: URL: https://github.com/apache/seatunnel/pull/8584 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Doc][Improve] translate Redis/Paimon related chinese document (#8584)

2025-02-05 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new de44573482 [Doc][Improve] translate Redis/Paimo