Re: [PR] [Improve][connector-doris] Improved doris source enumerator splits allocation algorithm for subtasks。 [seatunnel]

2025-04-08 Thread via GitHub
Hisoka-X commented on PR #9108: URL: https://github.com/apache/seatunnel/pull/9108#issuecomment-2785983841 waiting test case passes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] [Improve][connector-doris] Improved doris source enumerator splits allocation algorithm for subtasks。 [seatunnel]

2025-04-08 Thread via GitHub
JeremyXin commented on code in PR #9108: URL: https://github.com/apache/seatunnel/pull/9108#discussion_r2032774035 ## seatunnel-translation/seatunnel-translation-base/src/test/java/org/apache/seatunnel/translation/source/ParallelSourceTest.java: ## @@ -17,106 +17,177 @@ packa

Re: [PR] [Feat][Connector-v2][Iceberg]support filter conditions in iceberg source [seatunnel]

2025-04-08 Thread via GitHub
litiliu commented on code in PR #9095: URL: https://github.com/apache/seatunnel/pull/9095#discussion_r2032704495 ## docs/en/connector-v2/source/Iceberg.md: ## @@ -90,8 +90,10 @@ libfb303-xxx.jar | use_snapshot_id | long| no | -| Instructs

[I] Oracle migrates data to ClickHouse, empty data cannot be inserted into non-empty columns [seatunnel]

2025-04-08 Thread via GitHub
pruidong opened a new issue, #9123: URL: https://github.com/apache/seatunnel/issues/9123 Oracle migrates data to Clickhouse. Some fields in Oracle tables are null values, and some date fields have the value of 1900-01-01 (ClickHouse only supports 1970-01-01). Every column in the ClickHouse

[I] [Bug] [MySql-CDC] MySql-CDC to Clickhouse,一次同步多个表报错 [seatunnel]

2025-04-08 Thread via GitHub
kelebobo opened a new issue, #9122: URL: https://github.com/apache/seatunnel/issues/9122 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] [Bug] [Oracle-CDC] cdb+pdb 模式, Unable to create a source for identifier 'Oracle-CDC', Can not find catalog table with factoryId [Oracle] [seatunnel]

2025-04-08 Thread via GitHub
827086469 commented on issue #8463: URL: https://github.com/apache/seatunnel/issues/8463#issuecomment-2785466137 > # 1. CDC 同步配置文件 > ## 1.1. CDC 单表(Oracle -> MySQL) > env { > # stream_ora2mysql.conf > parallelism = 2 > job.mode = "STREAMING" > checkpoint.interval = 5

Re: [I] [Bug] [Sink-LocalFile] When generating a local file in JSON format, numbers are converted to scientific notation. [seatunnel]

2025-04-08 Thread via GitHub
misi1987107 commented on issue #8949: URL: https://github.com/apache/seatunnel/issues/8949#issuecomment-2786075984 This is a problem caused by serializing numbers -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[I] [Bug] [Mysql source] sql有中文乱码 [seatunnel]

2025-04-08 Thread via GitHub
zheng594 opened a new issue, #9127: URL: https://github.com/apache/seatunnel/issues/9127 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[I] [Bug] [Zeta] Occasional checkpoint failed when use COS as checkpoint storage [seatunnel]

2025-04-08 Thread via GitHub
lm-ylj opened a new issue, #9124: URL: https://github.com/apache/seatunnel/issues/9124 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[I] [Feature][SQLTransform] The error prompt of SQL transform does not indicate which specific field has a problem. [seatunnel]

2025-04-08 Thread via GitHub
cast(FIELD3 as decimal(22,0)) as field3 from `some_table` """ } ] "source_table_name" = "Table0001" "result_table_name" = "Table0002" } } sink { Maxcompute { "acc

Re: [PR] [Fix][Command] On windows, canot stop cluster with stop-seatunnel-cluster.cmd [seatunnel]

2025-04-08 Thread via GitHub
hailin0 commented on PR #8939: URL: https://github.com/apache/seatunnel/pull/8939#issuecomment-2786809743 Please resolve the conflict https://github.com/user-attachments/assets/dec80721-f5c1-4bc9-8107-0652f9e9ac67"; /> -- This is an automated message from the Apache Git Service

Re: [PR] [Feature][Transform] Support single/batch mode vectorization using Amazon Titan & cohere embedding model [seatunnel]

2025-04-08 Thread via GitHub
corgy-w commented on code in PR #9120: URL: https://github.com/apache/seatunnel/pull/9120#discussion_r2032545047 ## seatunnel-transforms-v2/src/main/java/org/apache/seatunnel/transform/nlpmodel/embedding/EmbeddingTransformFactory.java: ## @@ -48,6 +48,14 @@ public OptionRule opt

Re: [PR] [bugfix] modify ObjectMapper configuration [seatunnel]

2025-04-08 Thread via GitHub
Hisoka-X commented on PR #9126: URL: https://github.com/apache/seatunnel/pull/9126#issuecomment-2786156743 Please add test case -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [I] SeaTunnel community meeting topic collect [seatunnel]

2025-04-08 Thread via GitHub
hailin0 closed issue #9100: SeaTunnel community meeting topic collect URL: https://github.com/apache/seatunnel/issues/9100 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] [Fix][Connector-V2] Fix postgres cdc with debezium_json format can not parse number without scale [seatunnel]

2025-04-08 Thread via GitHub
FrommyMind commented on code in PR #9052: URL: https://github.com/apache/seatunnel/pull/9052#discussion_r2032302084 ## seatunnel-connectors-v2/connector-cdc/connector-cdc-base/src/main/java/org/apache/seatunnel/connectors/cdc/base/source/reader/IncrementalSourceRecordEmitter.java: #

Re: [I] [Bug] [Sink-LocalFile] When generating a local file in JSON format, numbers are converted to scientific notation. [seatunnel]

2025-04-08 Thread via GitHub
misi1987107 commented on issue #8949: URL: https://github.com/apache/seatunnel/issues/8949#issuecomment-2786085172 Please review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [I] [Bug] [Zeta] Occasional checkpoint failed when use COS as checkpoint storage [seatunnel]

2025-04-08 Thread via GitHub
lm-ylj commented on issue #9124: URL: https://github.com/apache/seatunnel/issues/9124#issuecomment-2785853063 We are using hadoop-cos-3.4.1, and even with the lowest version of hadoop-cos-3.3.0, the CleanerUtil class is required, so lowering the version does not solve the problem I think

Re: [I] Oracle migrates data to ClickHouse, empty data cannot be inserted into non-empty columns [seatunnel]

2025-04-08 Thread via GitHub
pruidong commented on issue #9123: URL: https://github.com/apache/seatunnel/issues/9123#issuecomment-2785735466 error: ``` Caused by: java.sql.SQLException: Cannot set null to non-nullable column #2 [EXTPID String] at com.clickhouse.jdbc.SqlExceptionUtils.clientError(Sq

[I] [Bug] [RocketMQ] RocketMQ NullPointerException [seatunnel]

2025-04-08 Thread via GitHub
xxyykkxx opened a new issue, #9129: URL: https://github.com/apache/seatunnel/issues/9129 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] [Bug] [RocketMQ] RocketMQ NullPointerException [seatunnel]

2025-04-08 Thread via GitHub
xxyykkxx commented on issue #9129: URL: https://github.com/apache/seatunnel/issues/9129#issuecomment-2788047449 ![Image](https://github.com/user-attachments/assets/99fcb717-809c-4574-9fde-fc23644cde7b) ![Image](https://github.com/user-attachments/assets/6fd56eb9-89e8-4f71-a425-7cadb6

(seatunnel) branch dev updated: [Fix][Connector-V2] Fix maxcompute write with multi parallelism (#9089)

2025-04-08 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 9426b7ba2c [Fix][Connector-V2] Fix maxcompute wri

[I] [Feature][Transform] Sql transform need get source table MateData [seatunnel]

2025-04-08 Thread via GitHub
xxyykkxx opened a new issue, #9128: URL: https://github.com/apache/seatunnel/issues/9128 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] [Bug] [RocketMQ] RocketMQ NullPointerException [seatunnel]

2025-04-08 Thread via GitHub
xxyykkxx commented on issue #9129: URL: https://github.com/apache/seatunnel/issues/9129#issuecomment-2788050270 What circumstances will cause an initialized HashMap be Null -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u