Re: [I] [Bug] [seatunnel-engine] close pending status job failed [seatunnel]

2025-02-20 Thread via GitHub
github-actions[bot] commented on issue #8564: URL: https://github.com/apache/seatunnel/issues/8564#issuecomment-2673032340 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [MYSQL CDC] geometry 类型自动转换为BYTES类型失败 [seatunnel]

2025-02-20 Thread via GitHub
github-actions[bot] commented on issue #8548: URL: https://github.com/apache/seatunnel/issues/8548#issuecomment-2673032464 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][Connector - V2] Support for AWS Glue Data Catalog in Apache Iceberg connector [seatunnel]

2025-02-20 Thread via GitHub
github-actions[bot] commented on issue #8559: URL: https://github.com/apache/seatunnel/issues/8559#issuecomment-2673032418 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [Paimon] The data has repeated after the dynamic hash table write. [seatunnel]

2025-02-20 Thread via GitHub
github-actions[bot] commented on issue #8565: URL: https://github.com/apache/seatunnel/issues/8565#issuecomment-2673032257 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [PR] [improve] update localfile connector config [seatunnel]

2025-02-20 Thread via GitHub
liunaijie commented on code in PR #8765: URL: https://github.com/apache/seatunnel/pull/8765#discussion_r1964868961 ## seatunnel-connectors-v2/connector-file/connector-file-local/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/local/source/config/LocalFileSourceConfig.java:

Re: [PR] [improve] RabbitMq connector options [seatunnel]

2025-02-20 Thread via GitHub
liunaijie commented on PR #8699: URL: https://github.com/apache/seatunnel/pull/8699#issuecomment-2673157897 Hi @akulabs8, I will close this PR since the changes have already been merged in [PR #8740](https://github.com/apache/seatunnel/pull/8740). Feel free to contribute with another PR!

Re: [PR] [improve] RabbitMq connector options [seatunnel]

2025-02-20 Thread via GitHub
liunaijie closed pull request #8699: [improve] RabbitMq connector options URL: https://github.com/apache/seatunnel/pull/8699 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

(seatunnel) branch dev updated: [Fix][Connector-V2]Fix Descriptions for CUSTOM_SQL in Connector (#8778)

2025-02-20 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 96b610eb7e [Fix][Connector-V2]Fix Descriptions for

Re: [PR] [Fix][Connector-V2]Fix Descriptions for CUSTOM_SQL in Connector [seatunnel]

2025-02-20 Thread via GitHub
Hisoka-X merged PR #8778: URL: https://github.com/apache/seatunnel/pull/8778 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [Improve][Connector-V2] Optimizes default value of jdbc fetch_size [seatunnel]

2025-02-20 Thread via GitHub
wuchunfu commented on PR #8774: URL: https://github.com/apache/seatunnel/pull/8774#issuecomment-2670840094 @corgy-w Please also update the document, thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[I] [Bug] [MongoDB] collStats 的值太大,Long类型无法处理科学计数法表示的字符串数值 [seatunnel]

2025-02-20 Thread via GitHub
qifanlili opened a new issue, #8775: URL: https://github.com/apache/seatunnel/issues/8775 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] [Feature][FTP/SFTP] FTP/SFTP connnectors add validation file when data transform ended [seatunnel]

2025-02-20 Thread via GitHub
liunaijie commented on issue #8773: URL: https://github.com/apache/seatunnel/issues/8773#issuecomment-2671026163 Hi, @18859108815 Welcome to contribute! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[PR] [Fix][Connector-V2]Fix Descriptions for CUSTOM_SQL in Connector [seatunnel]

2025-02-20 Thread via GitHub
xiaochen-zhou opened a new pull request, #8778: URL: https://github.com/apache/seatunnel/pull/8778 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check li

[PR] [Bugfix] Fix ClassCastException of ExceptionUtil [seatunnel]

2025-02-20 Thread via GitHub
hailin0 opened a new pull request, #8776: URL: https://github.com/apache/seatunnel/pull/8776 ### Purpose of this pull request https://github.com/user-attachments/assets/d7162242-35b7-4a5e-99c4-3ff3dfc2e73e"; /> ### Does this PR introduce _any_ user-facing change?

[PR] [Fix][Connector-V2]Fix Descriptions for CUSTOM_SQL in Connector [seatunnel]

2025-02-20 Thread via GitHub
xiaochen-zhou opened a new pull request, #8777: URL: https://github.com/apache/seatunnel/pull/8777 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check li

[PR] [Improve][Connector-V2] Optimizes default value of jdbc fetch_size [seatunnel]

2025-02-20 Thread via GitHub
corgy-w opened a new pull request, #8774: URL: https://github.com/apache/seatunnel/pull/8774 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

Re: [PR] [Fix][Connector-V2]Fix Descriptions for CUSTOM_SQL in Connector [seatunnel]

2025-02-20 Thread via GitHub
xiaochen-zhou closed pull request #8777: [Fix][Connector-V2]Fix Descriptions for CUSTOM_SQL in Connector URL: https://github.com/apache/seatunnel/pull/8777 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [Feature][Connector-V2] Add Handling Logic for HBase Asynchronous Data Write Failures [seatunnel]

2025-02-20 Thread via GitHub
xiaochen-zhou closed pull request #8279: [Feature][Connector-V2] Add Handling Logic for HBase Asynchronous Data Write Failures URL: https://github.com/apache/seatunnel/pull/8279 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [Improve][Connector-V2] Improve Paimon source split enumerator [seatunnel]

2025-02-20 Thread via GitHub
xiaochen-zhou closed pull request #6766: [Improve][Connector-V2] Improve Paimon source split enumerator URL: https://github.com/apache/seatunnel/pull/6766 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[I] [Feature][FTP/SFTP] FTP/SFTP connnectors add validation file when data transform ended [seatunnel]

2025-02-20 Thread via GitHub
18859108815 opened a new issue, #8773: URL: https://github.com/apache/seatunnel/issues/8773 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Improve][Connector-V2] Optimizes default value of jdbc fetch_size [seatunnel]

2025-02-20 Thread via GitHub
corgy-w commented on PR #8774: URL: https://github.com/apache/seatunnel/pull/8774#issuecomment-2670889619 > @corgy-w Please also update the document, thanks. get -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [Fix][Connector-V2]Fix Descriptions for CUSTOM_SQL in Connector [seatunnel]

2025-02-20 Thread via GitHub
hailin0 commented on code in PR #8778: URL: https://github.com/apache/seatunnel/pull/8778#discussion_r1963437456 ## docs/en/connector-v2/sink/Clickhouse.md: ## @@ -61,6 +61,7 @@ They can be downloaded via install-plugin.sh or from the Maven central repositor | allow_experiment

Re: [PR] [Improve][Jdbc] Optimize source data dynamic splitting when where_condition is configured [seatunnel]

2025-02-20 Thread via GitHub
davidzollo commented on PR #8760: URL: https://github.com/apache/seatunnel/pull/8760#issuecomment-2673747278 good job Please add related Unit Tests, thx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] [Improve][Connector-V2] Optimizes default value of jdbc fetch_size [seatunnel]

2025-02-20 Thread via GitHub
corgy-w closed pull request #8774: [Improve][Connector-V2] Optimizes default value of jdbc fetch_size URL: https://github.com/apache/seatunnel/pull/8774 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] [Bug] [MYSQL CDC] geometry 类型自动转换为BYTES类型失败 [seatunnel]

2025-02-20 Thread via GitHub
Quilian commented on issue #8548: URL: https://github.com/apache/seatunnel/issues/8548#issuecomment-2673082921 help -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [PR] [Feature][Connector-V2] Add `filename_extension` parameter for read/write file [seatunnel]

2025-02-20 Thread via GitHub
Hisoka-X commented on code in PR #8769: URL: https://github.com/apache/seatunnel/pull/8769#discussion_r1964668736 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/sink/writer/AbstractWriteStrategy.java: ##

[I] [Bug] [Module Name] Spark changed the metadata source information of Hudi after writing data. Seatunnel reported an error when writing data and read Hudi's metadata information [seatunnel]

2025-02-20 Thread via GitHub
lm520hy opened a new issue, #8781: URL: https://github.com/apache/seatunnel/issues/8781 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Improve][Connector-V2] Optimizes default value of jdbc fetch_size [seatunnel]

2025-02-20 Thread via GitHub
Hisoka-X commented on code in PR #8774: URL: https://github.com/apache/seatunnel/pull/8774#discussion_r1964965488 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/config/JdbcOptions.java: ## @@ -84,7 +84,7 @@ public interface

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/sink/TDengine.md] [seatunnel]

2025-02-20 Thread via GitHub
Hisoka-X commented on code in PR #8732: URL: https://github.com/apache/seatunnel/pull/8732#discussion_r1964721109 ## docs/zh/connector-v2/sink/TDengine.md: ## @@ -0,0 +1,71 @@ +# TDengine + +> TDengine 数据接收器 + +## 描述 + +用于将数据写入TDengine. 在运行 seatunnel 任务之前,你需要创建稳定的环境。 + +## 主要特性

Re: [PR] [Bugfix] Fix ClassCastException of ExceptionUtil [seatunnel]

2025-02-20 Thread via GitHub
liunaijie merged PR #8776: URL: https://github.com/apache/seatunnel/pull/8776 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatun

Re: [PR] [Feature] [Zeta] Client print event which received from jobmaster [seatunnel]

2025-02-20 Thread via GitHub
Hisoka-X commented on code in PR #8696: URL: https://github.com/apache/seatunnel/pull/8696#discussion_r1964742072 ## docs/en/seatunnel-engine/rest-api-v1.md: ## @@ -843,4 +843,46 @@ Returns a list of logs from the requested node. To get a list of logs from the current node: `h

[I] [Bug] [Module Name] jdbc sink create table failed [seatunnel]

2025-02-20 Thread via GitHub
OYRoy opened a new issue, #8782: URL: https://github.com/apache/seatunnel/issues/8782 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[I] [Bug] [connector maxcompute] maxcompute connector ClassCastException: java.time.ZonedDateTime cannot be cast to java.util.Date [seatunnel]

2025-02-20 Thread via GitHub
liujunfei2230 opened a new issue, #8780: URL: https://github.com/apache/seatunnel/issues/8780 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happ

Re: [PR] [Doc][Improve] support chinese [docs/zh/connector-v2/sink/TDengine.md] [seatunnel]

2025-02-20 Thread via GitHub
Hisoka-X commented on code in PR #8732: URL: https://github.com/apache/seatunnel/pull/8732#discussion_r1964725280 ## docs/zh/connector-v2/sink/TDengine.md: ## @@ -0,0 +1,71 @@ +# TDengine + +> TDengine 数据接收器 + +## 描述 + +用于将数据写入TDengine。 + +## 主要特性 + +- [x] [exactly-once](../../c

Re: [PR] [Fix][Connector-V2] Fix possible data loss in scenarios of request_tablet_size is less than the number of BUCKETS [seatunnel]

2025-02-20 Thread via GitHub
hailin0 commented on PR #8768: URL: https://github.com/apache/seatunnel/pull/8768#issuecomment-2673321695 good pr -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

Re: [PR] [Fix][Connector-V2] Fix possible data loss in scenarios of request_tablet_size is less than the number of BUCKETS [seatunnel]

2025-02-20 Thread via GitHub
hailin0 merged PR #8768: URL: https://github.com/apache/seatunnel/pull/8768 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Fix][Connector-V2] Fix possible data loss in scenarios of request_tablet_size is less than the number of BUCKETS (#8768)

2025-02-20 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 3c6f216135 [Fix][Connector-V2] Fix possible dat

Re: [I] [SqlServer-CDC]当字段数量超过128,无法正常cdc [seatunnel]

2025-02-20 Thread via GitHub
lirulei commented on issue #6658: URL: https://github.com/apache/seatunnel/issues/6658#issuecomment-2673189015 i met same bug too (my datasource is mysql database) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [I] [Bug] [Module Name] Spark changed the metadata source information of Hudi after writing data. Seatunnel reported an error when writing data and read Hudi's metadata information [seatunnel]

2025-02-20 Thread via GitHub
lm520hy commented on issue #8781: URL: https://github.com/apache/seatunnel/issues/8781#issuecomment-2673803138 When hudi's metadata is set to hoodie. table. metadata. partitions=files, there is a data synchronization error in seatunnel -- This is an automated message from the Apache Git S

Re: [I] [Demos-Collection] Collecting Use Case Demos for Apache SeaTunnel [seatunnel]

2025-02-20 Thread via GitHub
davidzollo commented on issue #8388: URL: https://github.com/apache/seatunnel/issues/8388#issuecomment-2673812869 Streaming task from Kafka to Doris ``` env { execution.parallelism = 4 # It is recommended to adjust according to the number of Kafka partitions, keeping it consis

(seatunnel) branch dev updated: [Fix][E2e] Optimized pom file name tag (#8770)

2025-02-20 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 7763326726 [Fix][E2e] Optimized pom file name tag (

Re: [PR] [Fix][E2e] Optimized pom file name tag [seatunnel]

2025-02-20 Thread via GitHub
Hisoka-X merged PR #8770: URL: https://github.com/apache/seatunnel/pull/8770 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [Fix][Connector-V2] Fix possible data loss in certain scenarios of starrocks [seatunnel]

2025-02-20 Thread via GitHub
xiaochen-zhou commented on PR #8768: URL: https://github.com/apache/seatunnel/pull/8768#issuecomment-2672117863 I added a test case, `StarRocksIT#testStarRocksReadRowCount()`, to verify whether the number of rows written to the sink matches the number of rows read from the source in scenari

Re: [PR] [Fix][Connector-V2]Fix Descriptions for CUSTOM_SQL in Connector [seatunnel]

2025-02-20 Thread via GitHub
xiaochen-zhou commented on code in PR #8778: URL: https://github.com/apache/seatunnel/pull/8778#discussion_r1963550533 ## docs/en/connector-v2/sink/Clickhouse.md: ## @@ -61,6 +61,7 @@ They can be downloaded via install-plugin.sh or from the Maven central repositor | allow_expe

Re: [PR] [Fix][connector-http] fix when post have param [seatunnel]

2025-02-20 Thread via GitHub
Hisoka-X commented on PR #8434: URL: https://github.com/apache/seatunnel/pull/8434#issuecomment-2670765327 > Please update https://github.com/apache/seatunnel/pull/8434/files#diff-31bd0672f7a316bde3b591f194484526bed84f71b007370b75c2c2bf99223fb4R362 with how to set pageing parameter into bod