Re: [PR] [fix][connectors-v2] repeated commit cause task exceptions [seatunnel]

2025-08-05 Thread via GitHub
Hisoka-X commented on code in PR #9665: URL: https://github.com/apache/seatunnel/pull/9665#discussion_r2254269497 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-paimon-e2e/src/test/resources/changelog_paimon_to_paimon.conf: ## @@ -44,7 +44,7 @@ sink { paimon.table.no

Re: [PR] [Improve][Csv] support configurable CSV delimiter in file connector [seatunnel]

2025-08-05 Thread via GitHub
Hisoka-X commented on PR #9660: URL: https://github.com/apache/seatunnel/pull/9660#issuecomment-3155036242 waiting test case passes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-05 Thread via GitHub
dybyte commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2254030321 ## docs/en/connector-v2/source/Redis.md: ## @@ -142,11 +142,26 @@ schema { ### key_field_name [string] -Specifies the field name to store the Redis key in the out

[PR] [fix][connectors-v2] repeated commit cause task exceptions [seatunnel]

2025-08-05 Thread via GitHub
hawk9821 opened a new pull request, #9665: URL: https://github.com/apache/seatunnel/pull/9665 ### Purpose of this pull request repeated commit cause task exceptions when restore from checkpoint in paimon task. savepoint process : * step1. serialize the state to local

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-05 Thread via GitHub
dybyte commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2254030321 ## docs/en/connector-v2/source/Redis.md: ## @@ -142,11 +142,26 @@ schema { ### key_field_name [string] -Specifies the field name to store the Redis key in the out

Re: [I] [Feature][Transform-V2] Support vector series sql function [seatunnel]

2025-08-05 Thread via GitHub
liuwei178 commented on issue #9663: URL: https://github.com/apache/seatunnel/issues/9663#issuecomment-3154767323 I'd like to have a try. Could you assign it to me? @Hisoka-X -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [Feature][Connectors-V2][DuckDB] Support DuckDB as JDBC Source and Sink [seatunnel]

2025-08-05 Thread via GitHub
davidzollo closed pull request #9659: [Feature][Connectors-V2][DuckDB] Support DuckDB as JDBC Source and Sink URL: https://github.com/apache/seatunnel/pull/9659 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] [Feature][Connectors-V2][DuckDB] Support DuckDB as JDBC Source and Sink [seatunnel]

2025-08-05 Thread via GitHub
davidzollo commented on PR #9659: URL: https://github.com/apache/seatunnel/pull/9659#issuecomment-3154723545 Sorry, I'll submit another PR for this feature -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] [Feature][tools] X2SeaTunnel #9507 [seatunnel]

2025-08-05 Thread via GitHub
Adamyuanyuan commented on PR #9664: URL: https://github.com/apache/seatunnel/pull/9664#issuecomment-3153692420 #9507 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [Feature][tools] X2SeaTunnel #9507 [seatunnel]

2025-08-05 Thread via GitHub
Hisoka-X commented on PR #9664: URL: https://github.com/apache/seatunnel/pull/9664#issuecomment-3154114040 I think we should create new sub repository just like mcp. cc @davidzollo @TyrantLucifer -- This is an automated message from the Apache Git Service. To respond to the message, plea

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-05 Thread via GitHub
liunaijie commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2253459919 ## docs/en/connector-v2/source/Redis.md: ## @@ -142,11 +142,26 @@ schema { ### key_field_name [string] -Specifies the field name to store the Redis key in the

Re: [I] [Feature][tools] X2SeaTunnel Design Document [seatunnel]

2025-08-05 Thread via GitHub
Adamyuanyuan commented on issue #9507: URL: https://github.com/apache/seatunnel/issues/9507#issuecomment-3153741208 > I have developed a project for converting datax to st configuration before. Supports fewer connectors. I can contribute it for reference. > > https://private-user-imag

Re: [I] [Feature][tools] X2SeaTunnel Design Document [seatunnel]

2025-08-04 Thread via GitHub
Adamyuanyuan commented on issue #9507: URL: https://github.com/apache/seatunnel/issues/9507#issuecomment-3153733963 > Very good suggestion. I've developed a small tool to convert DataX JSON into SparkSQL, extending it to Datatunnel statements, and I hope to get involved. > > https://

Re: [I] [Feature][tools] X2SeaTunnel Design Document [seatunnel]

2025-08-04 Thread via GitHub
Adamyuanyuan commented on issue #9507: URL: https://github.com/apache/seatunnel/issues/9507#issuecomment-3153729690 > Has any development work started on this feature yet? Yes, I have completed the development. It's ready to use out of the box with complete functionality. And with the

Re: [I] [Feature][tools] X2SeaTunnel Design Document [seatunnel]

2025-08-04 Thread via GitHub
Adamyuanyuan commented on issue #9507: URL: https://github.com/apache/seatunnel/issues/9507#issuecomment-3153693619 #9664 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[PR] [Feature][tools] X2SeaTunnel #9507 [seatunnel]

2025-08-04 Thread via GitHub
Adamyuanyuan opened a new pull request, #9664: URL: https://github.com/apache/seatunnel/pull/9664 ### Purpose of this pull request X2SeaTunnel is a tool for converting DataX and other configuration files to SeaTunnel configuration files, designed to help users quickly migrate

Re: [PR] [Improve][Csv] support configurable CSV delimiter in file connector [seatunnel]

2025-08-04 Thread via GitHub
zhenyue-xu commented on code in PR #9660: URL: https://github.com/apache/seatunnel/pull/9660#discussion_r2253106708 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/config/FileBaseSinkOptions.java: ## @@ -

Re: [PR] [Improve][Csv] support configurable CSV delimiter in file connector [seatunnel]

2025-08-04 Thread via GitHub
zhenyue-xu commented on code in PR #9660: URL: https://github.com/apache/seatunnel/pull/9660#discussion_r2253106277 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/test/java/org/apache/seatunnel/connectors/seatunnel/file/source/reader/CsvReadStrategyTest.java:

Re: [PR] feat(Databend): support CDC mode for databend sink connector [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on code in PR #9661: URL: https://github.com/apache/seatunnel/pull/9661#discussion_r2253013361 ## seatunnel-connectors-v2/connector-databend/src/main/java/org/apache/seatunnel/connectors/seatunnel/databend/sink/DatabendSinkWriter.java: ## @@ -110,48 +146,179 @

Re: [PR] feat(Databend): support CDC mode for databend sink connector [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on code in PR #9661: URL: https://github.com/apache/seatunnel/pull/9661#discussion_r2253012765 ## seatunnel-connectors-v2/connector-databend/src/main/java/org/apache/seatunnel/connectors/seatunnel/databend/config/DatabendOptions.java: ## @@ -97,4 +97,10 @@ pub

Re: [PR] feat(Databend): support CDC mode for databend sink connector [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on code in PR #9661: URL: https://github.com/apache/seatunnel/pull/9661#discussion_r2253010417 ## seatunnel-connectors-v2/connector-databend/src/main/java/org/apache/seatunnel/connectors/seatunnel/databend/sink/DatabendSinkWriter.java: ## @@ -110,48 +146,179 @

[I] [Feature][Transform-V2] Support vector series sql function [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X opened a new issue, #9663: URL: https://github.com/apache/seatunnel/issues/9663 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Feature][Connectors-V2][DuckDB] Support DuckDB as JDBC Source and Sink [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on PR #9659: URL: https://github.com/apache/seatunnel/pull/9659#issuecomment-3153116177 Please rebase on upstream dev. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[I] [Feature][Module Name] hdfsFile source didn`t support pure json line, without schema. [seatunnel]

2025-08-04 Thread via GitHub
chang-wd opened a new issue, #9662: URL: https://github.com/apache/seatunnel/issues/9662 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Improve][Csv] support configurable CSV delimiter in file connector [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on code in PR #9660: URL: https://github.com/apache/seatunnel/pull/9660#discussion_r2253000334 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/config/FileBaseSinkOptions.java: ## @@ -10

Re: [PR] [Improve][Csv] support configurable CSV delimiter in file connector [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on code in PR #9660: URL: https://github.com/apache/seatunnel/pull/9660#discussion_r2252996851 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/test/java/org/apache/seatunnel/connectors/seatunnel/file/source/reader/CsvReadStrategyTest.java: ##

Re: [PR] [Improve][Csv] support configurable CSV delimiter in file connector [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on PR #9660: URL: https://github.com/apache/seatunnel/pull/9660#issuecomment-3153112260 cc @corgy-w -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] feat(Databend): support CDC mode for databend sink connector [seatunnel]

2025-08-04 Thread via GitHub
hantmac commented on code in PR #9661: URL: https://github.com/apache/seatunnel/pull/9661#discussion_r2252994050 ## seatunnel-connectors-v2/connector-databend/src/main/java/org/apache/seatunnel/connectors/seatunnel/databend/sink/DatabendSinkWriter.java: ## @@ -110,48 +146,179 @@

Re: [PR] feat(Databend): support CDC mode for databend sink connector [seatunnel]

2025-08-04 Thread via GitHub
hantmac commented on code in PR #9661: URL: https://github.com/apache/seatunnel/pull/9661#discussion_r2252992996 ## seatunnel-connectors-v2/connector-databend/src/main/java/org/apache/seatunnel/connectors/seatunnel/databend/config/DatabendOptions.java: ## @@ -97,4 +97,10 @@ publ

Re: [PR] feat(Databend): support CDC mode for databend sink connector [seatunnel]

2025-08-04 Thread via GitHub
hantmac commented on code in PR #9661: URL: https://github.com/apache/seatunnel/pull/9661#discussion_r2252992312 ## seatunnel-connectors-v2/connector-databend/src/main/java/org/apache/seatunnel/connectors/seatunnel/databend/sink/DatabendSinkWriter.java: ## @@ -110,48 +146,179 @@

Re: [PR] [Improve][Csv] support configurable CSV delimiter in file connector [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on PR #9660: URL: https://github.com/apache/seatunnel/pull/9660#issuecomment-3153098670 > This PR adds back the csv_field_delimiter configuration option to properly support CSV files with custom delimiters (semicolon, tab, pipe, etc.) while maintaining full CSV standard c

Re: [PR] feat(Databend): support CDC mode for databend sink connector [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on code in PR #9661: URL: https://github.com/apache/seatunnel/pull/9661#discussion_r2252966464 ## seatunnel-connectors-v2/connector-databend/src/main/java/org/apache/seatunnel/connectors/seatunnel/databend/sink/DatabendSinkWriter.java: ## @@ -110,48 +146,179 @

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2252961018 ## docs/en/connector-v2/source/Redis.md: ## @@ -142,11 +142,26 @@ schema { ### key_field_name [string] -Specifies the field name to store the Redis key in the o

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-04 Thread via GitHub
dybyte commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2252929038 ## docs/en/connector-v2/source/Redis.md: ## @@ -142,11 +142,26 @@ schema { ### key_field_name [string] -Specifies the field name to store the Redis key in the out

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-04 Thread via GitHub
dybyte commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2252929038 ## docs/en/connector-v2/source/Redis.md: ## @@ -142,11 +142,26 @@ schema { ### key_field_name [string] -Specifies the field name to store the Redis key in the out

Re: [PR] [fix][kafka] fix kafka topic with multiple dot [seatunnel]

2025-08-04 Thread via GitHub
liunaijie commented on PR #8875: URL: https://github.com/apache/seatunnel/pull/8875#issuecomment-3152941400 @Cheun99 Please resolve the conflicts and update the e2e test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [fix][kafka] fix kafka topic with multiple dot [seatunnel]

2025-08-04 Thread via GitHub
liunaijie commented on code in PR #8875: URL: https://github.com/apache/seatunnel/pull/8875#discussion_r2032462208 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-kafka-e2e/src/test/resources/textFormatIT/kafka_source_topic_multiple_point_text_to_console.conf: ## @@ -68,7

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-04 Thread via GitHub
liunaijie commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2252875834 ## seatunnel-connectors-v2/connector-redis/src/main/java/org/apache/seatunnel/connectors/seatunnel/redis/config/RedisSourceOptions.java: ## @@ -51,6 +51,6 @@ public

Re: [I] [Feature][Module Name] Fill Default Value by datatype In Transform [seatunnel]

2025-08-04 Thread via GitHub
YYChildren commented on issue #9578: URL: https://github.com/apache/seatunnel/issues/9578#issuecomment-3152927955 @lovatti No! I have tried many method. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[PR] feat(Databend): support CDC mode for databend sink connector [seatunnel]

2025-08-04 Thread via GitHub
hantmac opened a new pull request, #9661: URL: https://github.com/apache/seatunnel/pull/9661 ### Purpose of this pull request Support the CDC mode for Databend Sink connector according the disscussion in https://github.com/apache/seatunnel/issues/9615 ### Does this PR i

Re: [PR] [Fix][Connector-V2] Update file filter pattern compilation to remove unnecessary quoting [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X merged PR #9658: URL: https://github.com/apache/seatunnel/pull/9658 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [Fix][Connector-Clickhouse] Cannot set null to non-nullable column [seatunnel]

2025-08-04 Thread via GitHub
Carl-Zhou-CN commented on PR #9605: URL: https://github.com/apache/seatunnel/pull/9605#issuecomment-3150519166 > Here: https://github.com/topsli/seatunnel/actions/runs/16587619460/job/46926288802 > > > @Hisoka-X It seems that CI has not been triggered. Do you know why? thanks

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2251368690 ## docs/en/connector-v2/source/Redis.md: ## @@ -142,11 +142,26 @@ schema { ### key_field_name [string] -Specifies the field name to store the Redis key in the o

Re: [PR] [Fix][Connector-Clickhouse] Cannot set null to non-nullable column [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on PR #9605: URL: https://github.com/apache/seatunnel/pull/9605#issuecomment-3150488025 Here: https://github.com/topsli/seatunnel/actions/runs/16587619460/job/46926288802 > @Hisoka-X It seems that CI has not been triggered. Do you know why? -- This is an

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-04 Thread via GitHub
dybyte commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2251344663 ## docs/en/connector-v2/source/Redis.md: ## @@ -142,11 +142,26 @@ schema { ### key_field_name [string] -Specifies the field name to store the Redis key in the out

Re: [PR] [Improve][Connector-V2] Support like predicate pushdown in paimon [seatunnel]

2025-08-04 Thread via GitHub
Carl-Zhou-CN commented on PR #9653: URL: https://github.com/apache/seatunnel/pull/9653#issuecomment-3150362725 @xiaochen-zhou hi,How does he perform for versions lower than 1.1.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [PR] [Fix][Connector-Clickhouse] Cannot set null to non-nullable column [seatunnel]

2025-08-04 Thread via GitHub
Carl-Zhou-CN commented on PR #9605: URL: https://github.com/apache/seatunnel/pull/9605#issuecomment-3150334648 @Hisoka-X It seems that CI has not been triggered. Do you know why? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] [Bug] [seatunnel-connector-http-base] Nested body formatting exceptio… [seatunnel]

2025-08-04 Thread via GitHub
Carl-Zhou-CN commented on PR #9567: URL: https://github.com/apache/seatunnel/pull/9567#issuecomment-3150305949 @LuJiu01 You can add a method in HttpClientProviderTest to verify the newly added methods, ensuring that the data is correctly converted to JSON -- This is an automated message f

Re: [PR] [Bug] [seatunnel-connector-http-base] Nested body formatting exceptio… [seatunnel]

2025-08-04 Thread via GitHub
Carl-Zhou-CN commented on PR #9567: URL: https://github.com/apache/seatunnel/pull/9567#issuecomment-3150297655 @LuJiu01 You can add an HttpClientProviderTest and include tests to verify the newly added methods, ensuring that the data is correctly converted to JSON -- This is an automated

Re: [PR] [Improve][Connectors-http] Add valid verification for http type URLs [seatunnel]

2025-08-04 Thread via GitHub
Carl-Zhou-CN commented on PR #9573: URL: https://github.com/apache/seatunnel/pull/9573#issuecomment-3150261751 @CosmosNi CC -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [improve]improve FE node failover logging for better observability [seatunnel]

2025-08-04 Thread via GitHub
Carl-Zhou-CN merged PR #9657: URL: https://github.com/apache/seatunnel/pull/9657 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@sea

Re: [PR] [Fix][Connector-V2] Add Filter for Partitions to Prevent Blocking in KafkaConsumer StreamMode [seatunnel]

2025-08-04 Thread via GitHub
Carl-Zhou-CN merged PR #9598: URL: https://github.com/apache/seatunnel/pull/9598 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@sea

Re: [PR] [Improve][Csv] support configurable CSV delimiter in file connector [seatunnel]

2025-08-04 Thread via GitHub
zhenyue-xu commented on PR #9660: URL: https://github.com/apache/seatunnel/pull/9660#issuecomment-3150230657 > I think the delimiter of CSV better not to be configurable, as the name of CSV means(Comma-Separated Values). You make a very valid point. RFC 4180 itself acknowledges "consi

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2251158505 ## docs/en/connector-v2/source/Redis.md: ## @@ -142,11 +142,26 @@ schema { ### key_field_name [string] -Specifies the field name to store the Redis key in the o

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-04 Thread via GitHub
Hisoka-X commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2251154380 ## seatunnel-connectors-v2/connector-redis/src/main/java/org/apache/seatunnel/connectors/seatunnel/redis/config/RedisSourceOptions.java: ## @@ -51,6 +51,6 @@ public

Re: [PR] [Improve][Csv] support configurable CSV delimiter in file connector [seatunnel]

2025-08-04 Thread via GitHub
litiliu commented on PR #9660: URL: https://github.com/apache/seatunnel/pull/9660#issuecomment-3149906541 I think the delimiter of CSV better not to be configurable, as the name of CSV means(Comma-Separated Values). -- This is an automated message from the Apache Git Service. To respond t

Re: [PR] [Improve][Csv] support configurable CSV delimiter in file connector [seatunnel]

2025-08-04 Thread via GitHub
litiliu commented on PR #9660: URL: https://github.com/apache/seatunnel/pull/9660#issuecomment-3149895135 There is a PR https://github.com/apache/seatunnel/pull/8919, should slove the issue you described, would you mind using it? -- This is an automated message from the Apache Git Service

Re: [PR] [Fix][Connector-V2] Add Filter for Partitions to Prevent Blocking in KafkaConsumer StreamMode [seatunnel]

2025-08-04 Thread via GitHub
xiaochen-zhou commented on PR #9598: URL: https://github.com/apache/seatunnel/pull/9598#issuecomment-3149884889 > waiting test case passes. Done. @Hisoka-X @Carl-Zhou-CN -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[PR] [Improve][Csv] support configurable CSV delimiter in file connector [seatunnel]

2025-08-04 Thread via GitHub
zhenyue-xu opened a new pull request, #9660: URL: https://github.com/apache/seatunnel/pull/9660 ### Purpose of this pull request This pull request restores configurable CSV delimiter support in the file connector. Previously, in PR #9066, the CSV delimiter configuration was removed w

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-04 Thread via GitHub
dybyte commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2250845797 ## seatunnel-connectors-v2/connector-redis/src/main/java/org/apache/seatunnel/connectors/seatunnel/redis/config/RedisSourceOptions.java: ## @@ -51,6 +51,6 @@ public en

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-04 Thread via GitHub
dybyte commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2250845797 ## seatunnel-connectors-v2/connector-redis/src/main/java/org/apache/seatunnel/connectors/seatunnel/redis/config/RedisSourceOptions.java: ## @@ -51,6 +51,6 @@ public en

Re: [I] [Feature][Jdbc] support duckdb [seatunnel]

2025-08-03 Thread via GitHub
davidzollo commented on issue #5115: URL: https://github.com/apache/seatunnel/issues/5115#issuecomment-3149372403 > > I'm doing this feature > > You have tested how to use Sqlite to specify database parameters and automatically generate sink sql. I have tested that the error has been

Re: [I] [Feature][Jdbc] support duckdb [seatunnel]

2025-08-03 Thread via GitHub
davidzollo commented on issue #5115: URL: https://github.com/apache/seatunnel/issues/5115#issuecomment-3149368253 https://github.com/apache/seatunnel/pull/9659 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[PR] [Feature][Connectors-V2][DuckDB] Support DuckDB as JDBC Source and Sink [seatunnel]

2025-08-03 Thread via GitHub
davidzollo opened a new pull request, #9659: URL: https://github.com/apache/seatunnel/pull/9659 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

[PR] [Fix][Connector-V2] Update file filter pattern compilation to remove unnecessary quoting [seatunnel]

2025-08-03 Thread via GitHub
corgy-w opened a new pull request, #9658: URL: https://github.com/apache/seatunnel/pull/9658 ### Purpose of this pull request The previous regular expression matching pattern was incorrect ### Does this PR introduce _any_ user-facing change?

Re: [PR] [improve]improve FE node failover logging for better observability [seatunnel]

2025-08-03 Thread via GitHub
Hisoka-X commented on code in PR #9657: URL: https://github.com/apache/seatunnel/pull/9657#discussion_r2250532856 ## seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/sink/writer/DorisSinkWriter.java: ## @@ -120,6 +120,9 @@ private void

Re: [PR] [Improve][Core] Configure spotless to auto-replace imports with shaded packages. [seatunnel]

2025-08-03 Thread via GitHub
corgy-w merged PR #9655: URL: https://github.com/apache/seatunnel/pull/9655 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [I] [Bug] [Transform-V2] XxxModel#dimension return number of vectors not number of dimensions [seatunnel]

2025-08-03 Thread via GitHub
corgy-w closed issue #9643: [Bug] [Transform-V2] XxxModel#dimension return number of vectors not number of dimensions URL: https://github.com/apache/seatunnel/issues/9643 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] [Hotfix][Transform-V2] Fix some model return number of dimensions [seatunnel]

2025-08-03 Thread via GitHub
corgy-w merged PR #9644: URL: https://github.com/apache/seatunnel/pull/9644 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Fix][Doc] Update StarRocks doc change schema necessity to true [seatunnel]

2025-08-03 Thread via GitHub
corgy-w merged PR #9656: URL: https://github.com/apache/seatunnel/pull/9656 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [I] [Bug] [Transform-V2] Milvus create collection error because of vector field dimension is null [seatunnel]

2025-08-03 Thread via GitHub
corgy-w closed issue #9645: [Bug] [Transform-V2] Milvus create collection error because of vector field dimension is null URL: https://github.com/apache/seatunnel/issues/9645 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [PR] [Fix] [Transform-V2] Fix embedding output columns vector dimension [seatunnel]

2025-08-03 Thread via GitHub
corgy-w merged PR #9646: URL: https://github.com/apache/seatunnel/pull/9646 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [I] 为什么2.3.11seatunnel 的source StarRocks还需要显示配置schema,但是官方文档显示不需要显示配置 [seatunnel]

2025-08-03 Thread via GitHub
corgy-w closed issue #9647: 为什么2.3.11seatunnel 的source StarRocks还需要显示配置schema,但是官方文档显示不需要显示配置 URL: https://github.com/apache/seatunnel/issues/9647 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [Feature][Flink] Add flink version 1.20.1 support [seatunnel]

2025-08-03 Thread via GitHub
TyrantLucifer commented on PR #9576: URL: https://github.com/apache/seatunnel/pull/9576#issuecomment-3149199078 https://hub.docker.com/repository/docker/tyrantlucifer/flink/tags/1.20.2-scala_2.12_hadoop27/sha256-2a3f548cd690dd3718fbcd73208c9de7d28bbbd9385df3581ccf347128b390d0 I have p

Re: [PR] [Feature][Flink] Add flink version 1.20.1 support [seatunnel]

2025-08-03 Thread via GitHub
TyrantLucifer commented on code in PR #9576: URL: https://github.com/apache/seatunnel/pull/9576#discussion_r2250426914 ## seatunnel-translation/seatunnel-translation-flink/seatunnel-translation-flink-20/src/main/java/org/apache/seatunnel/translation/flink/source/SplitWrapper.java: #

Re: [PR] [improve]improve FE node failover logging for better observability [seatunnel]

2025-08-03 Thread via GitHub
zhenyue-xu commented on code in PR #9657: URL: https://github.com/apache/seatunnel/pull/9657#discussion_r2250386012 ## seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/sink/writer/DorisSinkWriter.java: ## @@ -140,6 +140,11 @@ private vo

Re: [PR] [improve]improve FE node failover logging for better observability [seatunnel]

2025-08-03 Thread via GitHub
Hisoka-X commented on code in PR #9657: URL: https://github.com/apache/seatunnel/pull/9657#discussion_r2250339834 ## seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/sink/writer/DorisSinkWriter.java: ## @@ -140,6 +140,11 @@ private void

Re: [PR] [Feature][Connector-Iceberg]Support iceberg rest catalog integration and support AWS S3 tables [seatunnel]

2025-08-03 Thread via GitHub
SEZ9 commented on code in PR #9654: URL: https://github.com/apache/seatunnel/pull/9654#discussion_r2250337069 ## seatunnel-connectors-v2/connector-iceberg/src/main/java/org/apache/seatunnel/connectors/seatunnel/iceberg/IcebergCatalogLoader.java: ## @@ -58,8 +60,98 @@ public Iceb

[PR] [improve]improve FE node failover logging for better observability [seatunnel]

2025-08-03 Thread via GitHub
zhenyue-xu opened a new pull request, #9657: URL: https://github.com/apache/seatunnel/pull/9657 ### Purpose of this pull request This pull request improves the FE node failover logging in Doris connector to enhance observability during connection failures. When multiple FE

Re: [PR] [Feature][Connector-Iceberg]Support iceberg rest catalog integration and support AWS S3 tables [seatunnel]

2025-08-03 Thread via GitHub
Hisoka-X commented on code in PR #9654: URL: https://github.com/apache/seatunnel/pull/9654#discussion_r2250325021 ## seatunnel-connectors-v2/connector-iceberg/src/main/java/org/apache/seatunnel/connectors/seatunnel/iceberg/IcebergCatalogLoader.java: ## @@ -58,8 +60,98 @@ public

Re: [PR] [Feature][Connector-Iceberg]Support iceberg rest catalog integration and support AWS S3 tables [seatunnel]

2025-08-03 Thread via GitHub
Hisoka-X commented on code in PR #9654: URL: https://github.com/apache/seatunnel/pull/9654#discussion_r2250323959 ## seatunnel-connectors-v2/connector-iceberg/src/main/java/org/apache/seatunnel/connectors/seatunnel/iceberg/IcebergCatalogLoader.java: ## @@ -58,8 +60,98 @@ public

Re: [PR] [Feature][Connector-Iceberg]Support iceberg rest catalog integration and support AWS S3 tables [seatunnel]

2025-08-03 Thread via GitHub
SEZ9 commented on code in PR #9654: URL: https://github.com/apache/seatunnel/pull/9654#discussion_r2250321041 ## seatunnel-connectors-v2/connector-iceberg/src/main/java/org/apache/seatunnel/connectors/seatunnel/iceberg/config/IcebergCommonOptions.java: ## @@ -87,4 +87,35 @@ publ

Re: [PR] [Feature][Connector-Iceberg]Support iceberg rest catalog integration and support AWS S3 tables [seatunnel]

2025-08-03 Thread via GitHub
Hisoka-X commented on code in PR #9654: URL: https://github.com/apache/seatunnel/pull/9654#discussion_r2250312138 ## seatunnel-connectors-v2/connector-iceberg/src/main/java/org/apache/seatunnel/connectors/seatunnel/iceberg/config/IcebergCommonOptions.java: ## @@ -87,4 +87,35 @@

Re: [PR] [Improve][Connector-V2] Support like predicate pushdown in paimon [seatunnel]

2025-08-03 Thread via GitHub
Hisoka-X commented on code in PR #9653: URL: https://github.com/apache/seatunnel/pull/9653#discussion_r2250306595 ## seatunnel-connectors-v2/connector-paimon/src/main/java/org/apache/seatunnel/connectors/seatunnel/paimon/source/converter/SqlToPaimonPredicateConverter.java: ## @@

Re: [PR] [Improve][Connector-V2] Support like predicate pushdown in paimon [seatunnel]

2025-08-03 Thread via GitHub
Hisoka-X commented on PR #9653: URL: https://github.com/apache/seatunnel/pull/9653#issuecomment-3148983028 cc @hawk9821 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[I] Connection com.mysql.cj.jdbc.ConnectionImpl@17a1981f marked as broken because of SQLSTATE(08S01), ErrorCode(0) [seatunnel]

2025-08-03 Thread via GitHub
zhaohongyan133 opened a new issue, #6638: URL: https://github.com/apache/seatunnel/issues/6638 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What hap

Re: [I] Connection com.mysql.cj.jdbc.ConnectionImpl@17a1981f marked as broken because of SQLSTATE(08S01), ErrorCode(0) [seatunnel]

2025-08-03 Thread via GitHub
Hisoka-X commented on issue #6638: URL: https://github.com/apache/seatunnel/issues/6638#issuecomment-3148978959 Could you provide the full log? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [Fix][Connector-V2] Add Filter for Partitions to Prevent Blocking in KafkaConsumer StreamMode [seatunnel]

2025-08-03 Thread via GitHub
Hisoka-X commented on PR #9598: URL: https://github.com/apache/seatunnel/pull/9598#issuecomment-3148963505 waiting test case passes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] [Improve][Connector-V2] File Source Support filtering files by last modified time. [seatunnel]

2025-08-03 Thread via GitHub
Hisoka-X commented on PR #9526: URL: https://github.com/apache/seatunnel/pull/9526#issuecomment-3148952820 We need the end to end test with https://github.com/apache/seatunnel/pull/9526#pullrequestreview-3060545722. Please add a test case in it. -- This is an automated message from the A

Re: [PR] [Improve][Connector-V2] Use key_field_name option when reading Redis hash data [seatunnel]

2025-08-03 Thread via GitHub
Hisoka-X commented on code in PR #9642: URL: https://github.com/apache/seatunnel/pull/9642#discussion_r2250273802 ## docs/en/connector-v2/source/Redis.md: ## @@ -142,11 +142,26 @@ schema { ### key_field_name [string] -Specifies the field name to store the Redis key in the o

Re: [I] Connection com.mysql.cj.jdbc.ConnectionImpl@17a1981f marked as broken because of SQLSTATE(08S01), ErrorCode(0) [seatunnel]

2025-08-03 Thread via GitHub
maple1n5 commented on issue #6638: URL: https://github.com/apache/seatunnel/issues/6638#issuecomment-3148929832 > Seem like your network have some problem. 是这样的,MySQL CDC 同步 MySQL 时,如果源端表一两天没数据更新,后面更新了一条,客户端 jdbc sink writer 中连接池的连接就会超时,是否有考虑? -- This is an automated message from t

Re: [I] [Umbrella] unified parameter class and refactor connector creation logic [seatunnel]

2025-08-03 Thread via GitHub
github-actions[bot] commented on issue #8576: URL: https://github.com/apache/seatunnel/issues/8576#issuecomment-3148826327 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Improve][seatunnel-translation-flink] Current Seatunnel version incompatible with Flink 1.20+ [seatunnel]

2025-08-03 Thread via GitHub
github-actions[bot] commented on issue #9513: URL: https://github.com/apache/seatunnel/issues/9513#issuecomment-3148826244 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] hdfs imap空间越占越大 [seatunnel]

2025-08-03 Thread via GitHub
github-actions[bot] commented on issue #9472: URL: https://github.com/apache/seatunnel/issues/9472#issuecomment-3148826272 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Improve][seatunnel-translation-flink] Current Seatunnel version incompatible with Flink 1.20+ [seatunnel]

2025-08-03 Thread via GitHub
github-actions[bot] closed issue #9513: [Improve][seatunnel-translation-flink] Current Seatunnel version incompatible with Flink 1.20+ URL: https://github.com/apache/seatunnel/issues/9513 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] [Bug] [connector-cdc-base] AbstractSchemaChangeResolver use ddl to know support, maybe miss [seatunnel]

2025-08-03 Thread via GitHub
github-actions[bot] closed issue #9514: [Bug] [connector-cdc-base] AbstractSchemaChangeResolver use ddl to know support, maybe miss URL: https://github.com/apache/seatunnel/issues/9514 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [I] hdfs imap空间越占越大 [seatunnel]

2025-08-03 Thread via GitHub
github-actions[bot] closed issue #9472: hdfs imap空间越占越大 URL: https://github.com/apache/seatunnel/issues/9472 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-m

Re: [I] [Bug] [connector-cdc-base] AbstractSchemaChangeResolver use ddl to know support, maybe miss [seatunnel]

2025-08-03 Thread via GitHub
github-actions[bot] commented on issue #9514: URL: https://github.com/apache/seatunnel/issues/9514#issuecomment-3148826221 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] 为什么2.3.11seatunnel 的source StarRocks还需要显示配置schema,但是官方文档显示不需要显示配置 [seatunnel]

2025-08-03 Thread via GitHub
xiaochen-zhou commented on issue #9647: URL: https://github.com/apache/seatunnel/issues/9647#issuecomment-3148811838 There might be some ambiguity in the documentation. see details in this PR. [9656](https://github.com/apache/seatunnel/pull/9656) -- This is an automated message from the

[PR] [Fix][Connector-V2] Update StarRocks doc: Change schema necessity to true [seatunnel]

2025-08-03 Thread via GitHub
xiaochen-zhou opened a new pull request, #9656: URL: https://github.com/apache/seatunnel/pull/9656 ### Purpose of this pull request There might be some ambiguity in the documentation. When implementing multi-table reading in StarRocks, the schema has been moved to table_li

  1   2   3   4   5   6   7   8   9   10   >