Re: [PR] [Improve][Connector-V2] Random pick the starrocks fe address which can be connected [seatunnel]

2025-03-05 Thread via GitHub
Hisoka-X commented on code in PR #8898: URL: https://github.com/apache/seatunnel/pull/8898#discussion_r1982841313 ## seatunnel-connectors-v2/connector-starrocks/src/main/java/org/apache/seatunnel/connectors/seatunnel/starrocks/client/source/StarRocksQueryPlanReadClient.java: ##

[PR] [Feature][Clickhouse] Support multi-table source read [seatunnel]

2025-03-05 Thread via GitHub
zhilinli123 opened a new pull request, #7529: URL: https://github.com/apache/seatunnel/pull/7529 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

Re: [PR] [Fix] [Clickhouse] Parallelism makes data duplicate [seatunnel]

2025-03-05 Thread via GitHub
Hisoka-X commented on PR #8916: URL: https://github.com/apache/seatunnel/pull/8916#issuecomment-2703039586 Maybe fixing ClickHouse connector's sharding logic is a better option. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[I] [Bug] [Module Name] Plugin PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='MySQL'} not found. [seatunnel]

2025-03-05 Thread via GitHub
qbmiller opened a new issue, #8917: URL: https://github.com/apache/seatunnel/issues/8917 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[PR] [Fix] [Clickhouse] Parallelism makes data duplicate [seatunnel]

2025-03-05 Thread via GitHub
FrommyMind opened a new pull request, #8916: URL: https://github.com/apache/seatunnel/pull/8916 ### Purpose of this pull request close #8803 ### Does this PR introduce _any_ user-facing change? When use Clickhouse, use must set parallelism to 1.

Re: [PR] [improve] feature factory create connector [seatunnel]

2025-03-05 Thread via GitHub
misi1987107 closed pull request #8915: [improve] feature factory create connector URL: https://github.com/apache/seatunnel/pull/8915 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] [Bug] [connector-jdbc-kingbase]Error in Jdbc Source with Kingbase8: Unsupported Field Data Types (e.g., smallint) during Catalog Table Lookup #8866 [seatunnel]

2025-03-05 Thread via GitHub
t1234849 commented on PR #8874: URL: https://github.com/apache/seatunnel/pull/8874#issuecomment-2702902140 @Hisoka-X I have updated the test case to comply with Spotless's rules. Please review the changes and let me know if further modifications are needed. -- This is an automated message

Re: [I] [Bug] [Clickhouse to localfile] export Data rows error,need 1000,000 but actual 2000,000 [seatunnel]

2025-03-05 Thread via GitHub
FrommyMind commented on issue #8803: URL: https://github.com/apache/seatunnel/issues/8803#issuecomment-2702831075 @liunaijie Could you assign this to me pls. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

(seatunnel) branch dev updated: [Feature][Paimon] Customize the hadoop user (#8888)

2025-03-05 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 2657626f93 [Feature][Paimon] Customize the hado

[PR] [improve] feature factory create connector [seatunnel]

2025-03-05 Thread via GitHub
misi1987107 opened a new pull request, #8915: URL: https://github.com/apache/seatunnel/pull/8915 ### Purpose of this pull request subtask of https://github.com/apache/seatunnel/issues/8576 Adjust factory class to create connector instances ### Does this PR int

Re: [PR] [Fix][Connector-V2] Fix CSV String type write type [seatunnel]

2025-03-05 Thread via GitHub
litiliu commented on PR #8499: URL: https://github.com/apache/seatunnel/pull/8499#issuecomment-2702669762 this pr is not related to any issue, what's the purpose of this pr? What does `CSV String type write type` mean? -- This is an automated message from the Apache Git Service. To respo

Re: [PR] [Improve][Connector-V2] RocketMQ Source add message tag config [seatunnel]

2025-03-05 Thread via GitHub
wuchunfu commented on PR #8825: URL: https://github.com/apache/seatunnel/pull/8825#issuecomment-2702661488 @Hisoka-X @hailin0 PTAL, thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [PR] [Feature][Paimon] Customize the hadoop user [seatunnel]

2025-03-05 Thread via GitHub
hailin0 merged PR #: URL: https://github.com/apache/seatunnel/pull/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Doc] Fix example error (#8905)

2025-03-05 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 5c4d42c465 [Doc] Fix example error (#8905) 5c4d42c4

Re: [PR] [Doc] Fix example error [seatunnel]

2025-03-05 Thread via GitHub
Hisoka-X merged PR #8905: URL: https://github.com/apache/seatunnel/pull/8905 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [Improve][connector-file-base] Improved multiple table file source allocation algorithm for subtasks [seatunnel]

2025-03-05 Thread via GitHub
hailin0 merged PR #8878: URL: https://github.com/apache/seatunnel/pull/8878 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Improve][connector-file-base] Improved multiple table file source allocation algorithm for subtasks (#8878)

2025-03-05 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 44a12cc55c [Improve][connector-file-base] Impro

(seatunnel) branch dev updated: [Fix][Connector-V2] Fixed incorrectly setting s3 key in some cases (#8885)

2025-03-05 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new cf4bab5be2 [Fix][Connector-V2] Fixed incorrectl

Re: [PR] [Fix][Connector-V2] Fixed incorrectly setting s3 key in some cases [seatunnel]

2025-03-05 Thread via GitHub
hailin0 merged PR #8885: URL: https://github.com/apache/seatunnel/pull/8885 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

[I] [Question] How to identify source Kafka topic when using pattern-based subscription? [seatunnel]

2025-03-05 Thread via GitHub
chessplay opened a new issue, #8914: URL: https://github.com/apache/seatunnel/issues/8914 Hi SeaTunnel community, When using the Kafka Source with pattern-based topic subscription (e.g., topic = "^test-ogg-sou.*"), how can I include the source topic name in output records? My

Re: [I] 支持国产数据库吗,如人大金仓Kingbase [seatunnel]

2025-03-05 Thread via GitHub
gitfortian commented on issue #4512: URL: https://github.com/apache/seatunnel/issues/4512#issuecomment-2702463560 > it not supported now, do you has any document for us , maybe I would like to do it, because the database support is in Roadmap for me can seatunnel support cdc connector

[I] [Feature][connector] can seatunnel support kingbase cdc and dm cdc such chinese database [seatunnel]

2025-03-05 Thread via GitHub
gitfortian opened a new issue, #8913: URL: https://github.com/apache/seatunnel/issues/8913 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] [Bug] [Rest-api] Response timeout [seatunnel]

2025-03-05 Thread via GitHub
github-actions[bot] commented on issue #8349: URL: https://github.com/apache/seatunnel/issues/8349#issuecomment-2702396987 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] [Rest-api] Response timeout [seatunnel]

2025-03-05 Thread via GitHub
github-actions[bot] closed issue #8349: [Bug] [Rest-api] Response timeout URL: https://github.com/apache/seatunnel/issues/8349 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [I] [Feature][JDBC] Support database/table wildcards scan read [seatunnel]

2025-03-05 Thread via GitHub
github-actions[bot] closed issue #8473: [Feature][JDBC] Support database/table wildcards scan read URL: https://github.com/apache/seatunnel/issues/8473 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [I] [Bug] [seatunnel-engine] Concurrent task execution [seatunnel]

2025-03-05 Thread via GitHub
github-actions[bot] commented on issue #8348: URL: https://github.com/apache/seatunnel/issues/8348#issuecomment-2702397018 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] mysql 同步mysql [seatunnel]

2025-03-05 Thread via GitHub
github-actions[bot] closed issue #8344: mysql 同步mysql URL: https://github.com/apache/seatunnel/issues/8344 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

Re: [I] [Feature][JDBC] Support database/table wildcards scan read [seatunnel]

2025-03-05 Thread via GitHub
github-actions[bot] commented on issue #8473: URL: https://github.com/apache/seatunnel/issues/8473#issuecomment-2702396906 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] [seatunnel-engine] Concurrent task execution [seatunnel]

2025-03-05 Thread via GitHub
github-actions[bot] closed issue #8348: [Bug] [seatunnel-engine] Concurrent task execution URL: https://github.com/apache/seatunnel/issues/8348 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [I] [Bug] [connector-cdc-sqlserver] SqlServer-CDC出现SSL认证问题 [seatunnel]

2025-03-05 Thread via GitHub
github-actions[bot] commented on issue #8346: URL: https://github.com/apache/seatunnel/issues/8346#issuecomment-2702397048 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] mysql 同步mysql [seatunnel]

2025-03-05 Thread via GitHub
github-actions[bot] commented on issue #8344: URL: https://github.com/apache/seatunnel/issues/8344#issuecomment-2702397081 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

[I] 同步数据Oracle字符集为ASCII到Doirs,出现中文乱码 [seatunnel]

2025-03-05 Thread via GitHub
acttk opened a new issue, #8907: URL: https://github.com/apache/seatunnel/issues/8907 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ###

[PR] [Improve][deploy](#8902) helm chart config improve [seatunnel]

2025-03-05 Thread via GitHub
prclin opened a new pull request, #8903: URL: https://github.com/apache/seatunnel/pull/8903 ### Purpose of this pull request improve helm chart config ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? ```bash

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/source/MySQL-CDC.md] [seatunnel]

2025-03-05 Thread via GitHub
davidzollo commented on code in PR #8884: URL: https://github.com/apache/seatunnel/pull/8884#discussion_r1981404884 ## docs/zh/connector-v2/source/MySQL-CDC.md: ## @@ -0,0 +1,342 @@ +# MySQL CDC + +> MySQL CDC 源连接器 + +## 支持这些引擎 + +> SeaTunnel Zeta +> Flink + +## 描述 + +MySQL CDC

Re: [PR] [Bug] [connector-jdbc-kingbase]Error in Jdbc Source with Kingbase8: Unsupported Field Data Types (e.g., smallint) during Catalog Table Lookup #8866 [seatunnel]

2025-03-05 Thread via GitHub
Hisoka-X commented on PR #8874: URL: https://github.com/apache/seatunnel/pull/8874#issuecomment-2700893236 Please fix test case. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] Update deployment.md [seatunnel-website]

2025-03-05 Thread via GitHub
prclin closed pull request #341: Update deployment.md URL: https://github.com/apache/seatunnel-website/pull/341 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] [Improve][Oracle-CDC] Support ReadOnlyLogWriterFlushStrategy [seatunnel]

2025-03-05 Thread via GitHub
hailin0 opened a new pull request, #8912: URL: https://github.com/apache/seatunnel/pull/8912 ### Purpose of this pull request Cherry debezium ReadOnlyLogWriterFlushStrategy ### Does this PR introduce _any_ user-facing change? ### How was this patch tes

Re: [PR] [Improve][Oracle-CDC] Support ReadOnlyLogWriterFlushStrategy [seatunnel]

2025-03-05 Thread via GitHub
hailin0 commented on PR #8912: URL: https://github.com/apache/seatunnel/pull/8912#issuecomment-2700828842 https://github.com/debezium/debezium/blob/80fbf772549b1995f86013b6fc8dc3afffe34d67/debezium-connector-oracle/src/main/java/io/debezium/connector/oracle/logminer/LogMinerStreamingChangeEv

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/source/MySQL-CDC.md] [seatunnel]

2025-03-05 Thread via GitHub
davidzollo commented on code in PR #8884: URL: https://github.com/apache/seatunnel/pull/8884#discussion_r1981299885 ## docs/zh/connector-v2/source/MySQL-CDC.md: ## @@ -0,0 +1,342 @@ +# MySQL CDC + +> MySQL CDC 源连接器 Review Comment: ```suggestion > MySQL CDC Source 连接器 `

[PR] [Improve][CDC] Filter ddl for snapshot phase [seatunnel]

2025-03-05 Thread via GitHub
hailin0 opened a new pull request, #8911: URL: https://github.com/apache/seatunnel/pull/8911 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

[I] kafka to S3 set "have_partition:true" has a problem,why? [seatunnel]

2025-03-05 Thread via GitHub
liu668 opened a new issue, #8909: URL: https://github.com/apache/seatunnel/issues/8909 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[I] [Feature][Module Name] Oracle字符集为ASCII同步数据到Doris,出现中文乱码 [seatunnel]

2025-03-05 Thread via GitHub
acttk opened a new issue, #8908: URL: https://github.com/apache/seatunnel/issues/8908 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ###

Re: [I] 同步数据Oracle字符集为ASCII到Doirs,出现中文乱码 [seatunnel]

2025-03-05 Thread via GitHub
acttk closed issue #8907: 同步数据Oracle字符集为ASCII到Doirs,出现中文乱码 URL: https://github.com/apache/seatunnel/issues/8907 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[I] [Bug] [InfluxDBSource] Throw NullPointerException when source query returns no data [seatunnel]

2025-03-05 Thread via GitHub
bob007abc opened a new issue, #8904: URL: https://github.com/apache/seatunnel/issues/8904 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[PR] [Doc] Fix example error [seatunnel]

2025-03-05 Thread via GitHub
hailin0 opened a new pull request, #8905: URL: https://github.com/apache/seatunnel/pull/8905 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

[PR] [Improve][CDC] Extract duplicate code [seatunnel]

2025-03-05 Thread via GitHub
hailin0 opened a new pull request, #8906: URL: https://github.com/apache/seatunnel/pull/8906 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

[I] [Improve][deploy] helm chart config improve [seatunnel]

2025-03-05 Thread via GitHub
prclin opened a new issue, #8902: URL: https://github.com/apache/seatunnel/issues/8902 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ##

[I] [Bug] [Transform] Json parsing exception, value 'DEEPSEEK' [seatunnel]

2025-03-05 Thread via GitHub
bluesecret opened a new issue, #8901: URL: https://github.com/apache/seatunnel/issues/8901 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [I] [Feature][KafkaSource] The usage of StartMode in KafkaSource should have some Optimization [seatunnel]

2025-03-05 Thread via GitHub
plaofchina commented on issue #8900: URL: https://github.com/apache/seatunnel/issues/8900#issuecomment-2700111512 > I agree, we should remove the `earliest` and `latest` from the `start_mode` and use `group_offsets` as the default value. If use want to use the `earliest` or `latest` for the