Re: [PR] [Fix][Connector-V2] assign size for KafkaSource reader cache queue [seatunnel]

2025-03-26 Thread via GitHub
JesseAtSZ commented on code in PR #9041: URL: https://github.com/apache/seatunnel/pull/9041#discussion_r2014083826 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/source/KafkaSource.java: ## @@ -78,9 +78,9 @@ public List g

Re: [PR] [Improve] Refactor file enumerator to prevent duplicate put split [seatunnel]

2025-03-26 Thread via GitHub
Carl-Zhou-CN merged PR #8989: URL: https://github.com/apache/seatunnel/pull/8989 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@sea

[PR] [Improve][Zeta] Support restore execute savemode [seatunnel]

2025-03-26 Thread via GitHub
hailin0 opened a new pull request, #9059: URL: https://github.com/apache/seatunnel/pull/9059 ### Purpose of this pull request [Zeta] Support restore execute savemode ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested?

(seatunnel) branch 2.3.8-release created (now cf6e28916d)

2025-03-26 Thread jarvis
This is an automated email from the ASF dual-hosted git repository. jarvis pushed a change to branch 2.3.8-release in repository https://gitbox.apache.org/repos/asf/seatunnel.git at cf6e28916d [maven-release-plugin] prepare for next development iteration No new revisions were added by th

Re: [PR] [Improve][Transform-V2] support try_cast expressions [seatunnel]

2025-03-26 Thread via GitHub
corgy-w commented on code in PR #9029: URL: https://github.com/apache/seatunnel/pull/9029#discussion_r2014007241 ## seatunnel-e2e/seatunnel-transforms-v2-e2e/seatunnel-transforms-v2-e2e-part-2/src/test/resources/sql_transform/func_try_cast.conf: ## @@ -0,0 +1,85 @@ +# +# License

Re: [I] [Bug] [Hive Source] Invalid method name: 'get_table_req' [seatunnel]

2025-03-26 Thread via GitHub
matianhe3 commented on issue #7330: URL: https://github.com/apache/seatunnel/issues/7330#issuecomment-2756263498 SOLVED. Build SeaTunnel From Source Code. > ALTER `${SEATUNNEL_HOME}/seatunnel-connectors-v2/connector-hive/pom.xml` hive-exec.version to your hive version.

Re: [I] [Bug] [Hive Source] Invalid method name: 'get_table_req' [seatunnel]

2025-03-26 Thread via GitHub
matianhe3 closed issue #7330: [Bug] [Hive Source] Invalid method name: 'get_table_req' URL: https://github.com/apache/seatunnel/issues/7330 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] [Feature][connector-hive] hive sink connector support overwrite mode #7843 [seatunnel]

2025-03-26 Thread via GitHub
15810785091 commented on PR #7891: URL: https://github.com/apache/seatunnel/pull/7891#issuecomment-2756289694 How long will it take to use it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[I] 为何任务时间一长就会有java.lang.RuntimeException: TaskGroupLocation: TaskGroupLocation{jobId=957213081283330050, pipelineId=1, taskGroupId=1}这样的问题 [seatunnel]

2025-03-26 Thread via GitHub
JanSay opened a new issue, #9061: URL: https://github.com/apache/seatunnel/issues/9061 目前从使用情况来看,无论是 http 还是 cdc,时间稍微长点就会有这个分片的问题。麻烦帮忙看看。 使用版本是 2.3.9 我的 http 同步到 pg 的 job 配置: { "sink": [ { "primary_keys": [ "BSM" ], "batch_size": 1000

[PR] [Doc][Fix] DB2.md fix markdown formatting in Data Type Mapping [seatunnel]

2025-03-26 Thread via GitHub
MyeoungDev opened a new pull request, #9062: URL: https://github.com/apache/seatunnel/pull/9062 ### Purpose of this pull request This PR fixes incorrect Markdown table formatting in the "Data Type Mapping" section. ### Does this PR introduce _any_ user-facing change

Re: [I] [Feature][connector-cdc-tidb] Dose connector-cdc-tidb support parsing DDL? [seatunnel]

2025-03-26 Thread via GitHub
github-actions[bot] commented on issue #8791: URL: https://github.com/apache/seatunnel/issues/8791#issuecomment-2756064280 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Umbrella] CDC Connector Design [seatunnel]

2025-03-26 Thread via GitHub
zhaixinying521 commented on issue #3175: URL: https://github.com/apache/seatunnel/issues/3175#issuecomment-2756174592 nice -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] [Umbrella][Connector-V2] SeaTunnel Connector V2 Tracking Table [seatunnel]

2025-03-26 Thread via GitHub
davidzollo closed issue #3018: [Umbrella][Connector-V2] SeaTunnel Connector V2 Tracking Table URL: https://github.com/apache/seatunnel/issues/3018 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [Fix][Connector-V2][OceanBase] oceanbase vector support simple vector index [seatunnel]

2025-03-26 Thread via GitHub
xxsc0529 closed pull request #9057: [Fix][Connector-V2][OceanBase] oceanbase vector support simple vector index URL: https://github.com/apache/seatunnel/pull/9057 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [PR] [Fix][Connector-V2][Postgres-CDC] BigDecimal cast String Exception [seatunnel]

2025-03-26 Thread via GitHub
Hisoka-X commented on code in PR #9052: URL: https://github.com/apache/seatunnel/pull/9052#discussion_r2013726130 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/type/SeaTunnelRow.java: ## @@ -132,6 +133,9 @@ private int getBytesForValue(Object v, SeaTunnelDataType

Re: [PR] [Improve] Refactor file enumerator to prevent duplicate put split [seatunnel]

2025-03-26 Thread via GitHub
Carl-Zhou-CN commented on code in PR #8989: URL: https://github.com/apache/seatunnel/pull/8989#discussion_r2013825871 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/source/split/MultipleTableFileSourceSplitEnume

Re: [PR] [Release][2.3.10] update docs for seatunnel website [seatunnel-website]

2025-03-26 Thread via GitHub
zhangshenghang commented on PR #371: URL: https://github.com/apache/seatunnel-website/pull/371#issuecomment-2754244308 @Hisoka-X PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] [Fix][Connector-V2] assign size for KafkaSource reader cache queue [seatunnel]

2025-03-26 Thread via GitHub
Hisoka-X commented on code in PR #9041: URL: https://github.com/apache/seatunnel/pull/9041#discussion_r2014073595 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/source/KafkaSource.java: ## @@ -78,9 +78,9 @@ public List ge

Re: [PR] [Doc] fix deadlinks [seatunnel]

2025-03-26 Thread via GitHub
kartikkudada commented on PR #9053: URL: https://github.com/apache/seatunnel/pull/9053#issuecomment-2753647656 @hailin0 @Hisoka-X Please approve this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] [Bug] [connector-file] HdfsFile sink lost data [seatunnel]

2025-03-26 Thread via GitHub
aprilApples commented on issue #5952: URL: https://github.com/apache/seatunnel/issues/5952#issuecomment-275362 You can call "snapshotState" in method "prepareCommit" like this: ![Image](https://github.com/user-attachments/assets/5829b192-d117-4f3c-975d-25c9d5b89374) Then,

[PR] [Fix][Connector-V2][OceanBase] oceanbase vector support simple vector index [seatunnel]

2025-03-26 Thread via GitHub
xxsc0529 opened a new pull request, #9057: URL: https://github.com/apache/seatunnel/pull/9057 ### Purpose of this pull request ConstraintType class add VECTOR_INDEX_KEY enum,The error is reported in the buildConstrainKeySql method of OceanBaseMysqlCreateTableSqlBuilder. Cu

Re: [PR] [Improve] Refactor file enumerator to prevent duplicate put split [seatunnel]

2025-03-26 Thread via GitHub
Hisoka-X commented on code in PR #8989: URL: https://github.com/apache/seatunnel/pull/8989#discussion_r2013776466 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/source/split/MultipleTableFileSourceSplitEnumerato

Re: [I] [Feature][MCP] Support MCP [seatunnel]

2025-03-26 Thread via GitHub
davidzollo commented on issue #9047: URL: https://github.com/apache/seatunnel/issues/9047#issuecomment-2754205695 great job. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[PR] [Feature] Version from 2.3.10 to 2.3.11 [seatunnel]

2025-03-26 Thread via GitHub
zhangshenghang opened a new pull request, #9058: URL: https://github.com/apache/seatunnel/pull/9058 ### Purpose of this pull request Version from 2.3.10 to 2.3.11 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested?

[I] [Feature][Zeta] To persist the failed data from SeaTunnel synchronization to the target end, here are some ideas and insights that might help you achieve this goal: [seatunnel]

2025-03-26 Thread via GitHub
xinshuaiyong opened a new issue, #9054: URL: https://github.com/apache/seatunnel/issues/9054 ### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] [Feature][Connector] Does SeaTunnel support mycat? [seatunnel]

2025-03-26 Thread via GitHub
lvbo1 commented on issue #9025: URL: https://github.com/apache/seatunnel/issues/9025#issuecomment-2753424920 @hailin0 我根据这个client_plugin_Auth处理的问题 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] [Fix] fix deadlink in website [seatunnel]

2025-03-26 Thread via GitHub
kartikkudada commented on issue #8573: URL: https://github.com/apache/seatunnel/issues/8573#issuecomment-2753467058 I raised PR https://github.com/apache/seatunnel/pull/9053 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

(seatunnel) branch st-fix-iceberg-timezone deleted (was 9e607441f5)

2025-03-26 Thread lidongdai
This is an automated email from the ASF dual-hosted git repository. lidongdai pushed a change to branch st-fix-iceberg-timezone in repository https://gitbox.apache.org/repos/asf/seatunnel.git was 9e607441f5 ST-2399 fix sink to iceberg timezone The revisions that were on this branch are sti

Re: [PR] [Fix][Connector-V2] Fix sink to iceberg timezone is not right [seatunnel]

2025-03-26 Thread via GitHub
davidzollo closed pull request #8230: [Fix][Connector-V2] Fix sink to iceberg timezone is not right URL: https://github.com/apache/seatunnel/pull/8230 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [Doc] fix deadlinks [seatunnel]

2025-03-26 Thread via GitHub
kartikkudada commented on PR #9053: URL: https://github.com/apache/seatunnel/pull/9053#issuecomment-2753465916 please approve this PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [Improve] Refactor file enumerator to prevent duplicate put split [seatunnel]

2025-03-26 Thread via GitHub
Carl-Zhou-CN commented on code in PR #8989: URL: https://github.com/apache/seatunnel/pull/8989#discussion_r2013767427 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/source/split/MultipleTableFileSourceSplitEnume

[I] [Fix][Connector-V2][OceanBase] oceanbase vector support simple vector index [seatunnel]

2025-03-26 Thread via GitHub
xxsc0529 opened a new issue, #9056: URL: https://github.com/apache/seatunnel/issues/9056 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[PR] [Improve][Connector-Redis] Redis did not write successfully, but the task did not fail [seatunnel]

2025-03-26 Thread via GitHub
lm-ylj opened a new pull request, #9055: URL: https://github.com/apache/seatunnel/pull/9055 ### Purpose of this pull request close https://github.com/apache/seatunnel/issues/9033 ### Does this PR introduce _any_ user-facing change? ### How was this

Re: [PR] [Doc] fix deadlinks [seatunnel]

2025-03-26 Thread via GitHub
Carl-Zhou-CN merged PR #9053: URL: https://github.com/apache/seatunnel/pull/9053 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@sea

(seatunnel) branch dev updated: [Doc] fix deadlinks (#9053)

2025-03-26 Thread zhouyao2023
This is an automated email from the ASF dual-hosted git repository. zhouyao2023 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new c1b8284423 [Doc] fix deadlinks (#9053) c1b8284

Re: [PR] [Hotfix][Jdbc] Fix mysql tinyint(1) type mapping for TypeMapper [seatunnel]

2025-03-26 Thread via GitHub
Carl-Zhou-CN merged PR #9012: URL: https://github.com/apache/seatunnel/pull/9012 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@sea

Re: [I] [Feature][MCP] Support MCP [seatunnel]

2025-03-26 Thread via GitHub
ocean-zhc commented on issue #9047: URL: https://github.com/apache/seatunnel/issues/9047#issuecomment-2753835951 Achieved, [seatunnel-mcp](https://github.com/ocean-zhc/seatunnel-mcp) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [I] [Umbrella][Connector-V2] SeaTunnel Connector V2 Tracking Table [seatunnel]

2025-03-26 Thread via GitHub
davidzollo commented on issue #3018: URL: https://github.com/apache/seatunnel/issues/3018#issuecomment-2756306975 This issue is outdated. If you have any new connector requirements, please submit a new issue. -- This is an automated message from the Apache Git Service. To respond to the m

Re: [PR] [Doc][Fix] DB2.md fix markdown formatting in Data Type Mapping [seatunnel]

2025-03-26 Thread via GitHub
hailin0 merged PR #9062: URL: https://github.com/apache/seatunnel/pull/9062 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated (fdf1beae9c -> d1c0e055a8)

2025-03-26 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from fdf1beae9c [Improve] Refactor file enumerator to prevent duplicate put split (#8989) add d1c0e055a8 [Doc][Fi

Re: [PR] support connection config, and use conn_id to replace conn info in jo… [seatunnel]

2025-03-26 Thread via GitHub
hailin0 commented on PR #8945: URL: https://github.com/apache/seatunnel/pull/8945#issuecomment-2756457171 Why do we need to resubmit the PR? The context of the review will be lost. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [I] [Feature][seatunnel-config] connection configuration uniform and reuse in job config [seatunnel]

2025-03-26 Thread via GitHub
hailin0 commented on issue #8941: URL: https://github.com/apache/seatunnel/issues/8941#issuecomment-2756540964 Any suggestions? ### common.conf ``` my_user_db { a = "x" b = "" c = "" } my_order_db { d =

Re: [PR] [Release][2.3.10] update docs for seatunnel website [seatunnel-website]

2025-03-26 Thread via GitHub
Hisoka-X merged PR #371: URL: https://github.com/apache/seatunnel-website/pull/371 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@s

Re: [PR] [Fix][Connector-V2] assign size for KafkaSource reader cache queue [seatunnel]

2025-03-26 Thread via GitHub
Hisoka-X commented on code in PR #9041: URL: https://github.com/apache/seatunnel/pull/9041#discussion_r2015368658 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/source/KafkaSource.java: ## @@ -78,9 +78,9 @@ public List ge

Re: [I] [Bug] [Connector-V2] Source Oracle-CDC Sink Clickhouse checkpoint timeout [seatunnel]

2025-03-26 Thread via GitHub
Carl-Zhou-CN commented on issue #8364: URL: https://github.com/apache/seatunnel/issues/8364#issuecomment-2756508864 ./bin/seatunnel.sh -c oracle_to_ck.conf ctrl+c ./bin/seatunnel.sh -c oracle_to_ck.conf -- This is an automated message from the Apache Git Service. To respond to the me

Re: [I] [Feature][Jdbc] support duckdb [seatunnel]

2025-03-26 Thread via GitHub
HaoXuAI commented on issue #5115: URL: https://github.com/apache/seatunnel/issues/5115#issuecomment-2746379236 @davidzollo I can tkae on this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] [Fix][Connector-V2] assign size for KafkaSource reader cache queue [seatunnel]

2025-03-26 Thread via GitHub
JesseAtSZ commented on code in PR #9041: URL: https://github.com/apache/seatunnel/pull/9041#discussion_r2015712445 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/source/KafkaSource.java: ## @@ -78,9 +78,9 @@ public List g

Re: [I] [Good First Issues] How to complete the first contribution [seatunnel]

2025-03-26 Thread via GitHub
selectboydata commented on issue #2828: URL: https://github.com/apache/seatunnel/issues/2828#issuecomment-2756193312 can you assign to me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] [Bug] [Engine] Frequent "TaskGroupLocation: TaskGroupLocation xxx already exists" error during task execution, causing task failure. [seatunnel]

2025-03-26 Thread via GitHub
JanSay commented on issue #8566: URL: https://github.com/apache/seatunnel/issues/8566#issuecomment-2756872170 Hello, may I ask if you have solved this issue? I often encounter this problem now, and there is no solution, with no response from the official support. -- This is an automated

Re: [PR] [feature]Add Apache Doris Datasource [seatunnel-web]

2025-03-26 Thread via GitHub
hailin0 commented on PR #276: URL: https://github.com/apache/seatunnel-web/pull/276#issuecomment-2756365867 please rebase dev branch -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] Ref config [seatunnel]

2025-03-26 Thread via GitHub
wuchunfu commented on code in PR #8984: URL: https://github.com/apache/seatunnel/pull/8984#discussion_r2015531517 ## docs/en/concept/config.md: ## @@ -335,6 +335,91 @@ sink { - For dynamic parameters, you can use the following format: `-i date=$(date +"%Y%m%d")`. - Cannot use

Re: [PR] Ref config [seatunnel]

2025-03-26 Thread via GitHub
wuchunfu commented on code in PR #8984: URL: https://github.com/apache/seatunnel/pull/8984#discussion_r2015529442 ## docs/en/concept/config.md: ## @@ -335,6 +335,91 @@ sink { - For dynamic parameters, you can use the following format: `-i date=$(date +"%Y%m%d")`. - Cannot use

[I] v2.3.9【Mysql同步到Hudi】UnsupportedOperationException: Flink ParallelSource don't support sending SourceEvent [seatunnel]

2025-03-26 Thread via GitHub
deamonJohn opened a new issue, #9063: URL: https://github.com/apache/seatunnel/issues/9063 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [I] [Bug] [Oracle-CDC] 报错Oracle日志保存点断裂,但是数据库日志查看正常,未发生断裂。 [seatunnel]

2025-03-26 Thread via GitHub
kingxeros commented on issue #8772: URL: https://github.com/apache/seatunnel/issues/8772#issuecomment-2756770101 I met the same problem. This problem happens irregularly -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use