Re: [I] Dirty data filtering function脏数据过滤功能 [seatunnel]

2025-03-17 Thread via GitHub
KangTomwk commented on issue #8321: URL: https://github.com/apache/seatunnel/issues/8321#issuecomment-2728527475 > > [@tusiCHN](https://github.com/tusiCHN) Would you like to design this feature? [#4587](https://github.com/apache/seatunnel/issues/4587) > > I want to try to implement th

Re: [PR] [improve] email connector options [seatunnel]

2025-03-17 Thread via GitHub
wuchunfu merged PR #8983: URL: https://github.com/apache/seatunnel/pull/8983 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

[PR] Multi sink added for RabbitMq [seatunnel]

2025-03-17 Thread via GitHub
akulabs8 opened a new pull request, #8994: URL: https://github.com/apache/seatunnel/pull/8994 subtask of https://github.com/apache/seatunnel/issues/5652 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How w

Re: [PR] [Fix][Command] Run seatunnel on windows with fileAppender enabled, no log file been created [seatunnel]

2025-03-17 Thread via GitHub
Hisoka-X merged PR #8938: URL: https://github.com/apache/seatunnel/pull/8938 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] Ref config [seatunnel]

2025-03-17 Thread via GitHub
thirsd commented on code in PR #8984: URL: https://github.com/apache/seatunnel/pull/8984#discussion_r276478 ## docs/zh/concept/config.md: ## @@ -322,7 +322,85 @@ sink { - 值不能包含空格`' '`。例如, `-i jobName='this is a job name'`将被替换为`job.name = "this"`。 你可以使用环境变量传递带有空格的值。 - 如果要

Re: [PR] [Fix] Fix MySQL-CDC restore schema but without schema change config [seatunnel]

2025-03-17 Thread via GitHub
Hisoka-X closed pull request #6872: [Fix] Fix MySQL-CDC restore schema but without schema change config URL: https://github.com/apache/seatunnel/pull/6872 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] [Improve] Update release guide for connector change log [seatunnel-website]

2025-03-17 Thread via GitHub
Hisoka-X commented on PR #366: URL: https://github.com/apache/seatunnel-website/pull/366#issuecomment-2731556202 cc @baicie @zhangshenghang -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[PR] [Improve] Update release guide for connector change log [seatunnel-website]

2025-03-17 Thread via GitHub
Hisoka-X opened a new pull request, #366: URL: https://github.com/apache/seatunnel-website/pull/366 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

(seatunnel) branch dev updated: [Improve] influxdb options (#8966)

2025-03-17 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 9f498b8133 [Improve] influxdb options (#8966) 9

Re: [PR] [Improve] influxdb options [seatunnel]

2025-03-17 Thread via GitHub
hailin0 merged PR #8966: URL: https://github.com/apache/seatunnel/pull/8966 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [improve] http connector options [seatunnel]

2025-03-17 Thread via GitHub
hailin0 merged PR #8969: URL: https://github.com/apache/seatunnel/pull/8969 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Fix][File]use common-csv to read csv file [seatunnel]

2025-03-17 Thread via GitHub
litiliu commented on PR #8919: URL: https://github.com/apache/seatunnel/pull/8919#issuecomment-2731721155 @Hisoka-X @zhangshenghang PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [PR] [Improve][Connector-V2] Optimize dialect selection in jdbc [seatunnel]

2025-03-17 Thread via GitHub
Hisoka-X commented on code in PR #8820: URL: https://github.com/apache/seatunnel/pull/8820#discussion_r294001 ## docs/en/connector-v2/source/Jdbc.md: ## @@ -47,6 +47,7 @@ supports query SQL and can achieve projection effect. | password | St

Re: [PR] Ref config [seatunnel]

2025-03-17 Thread via GitHub
liunaijie commented on code in PR #8984: URL: https://github.com/apache/seatunnel/pull/8984#discussion_r2000101963 ## docs/zh/concept/config.md: ## @@ -322,7 +322,85 @@ sink { - 值不能包含空格`' '`。例如, `-i jobName='this is a job name'`将被替换为`job.name = "this"`。 你可以使用环境变量传递带有空格的值。 -

Re: [PR] [Feature][Connector-V2] RabbitMq support multi-table sink [seatunnel]

2025-03-17 Thread via GitHub
Hisoka-X commented on PR #8994: URL: https://github.com/apache/seatunnel/pull/8994#issuecomment-2731479218 Thanks @akulabs8 ! Waiting ci passes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [I] [Feature][CDC] Support db2 cdc connector source [seatunnel]

2025-03-17 Thread via GitHub
davidzollo commented on issue #7194: URL: https://github.com/apache/seatunnel/issues/7194#issuecomment-2731499918 @sunxiaojian I have assigned this feature to you, I'm looking forward to your PR. -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [PR] [Improve][Doc] Added automatically generate connector commit history documents [seatunnel]

2025-03-17 Thread via GitHub
Hisoka-X commented on PR #8948: URL: https://github.com/apache/seatunnel/pull/8948#issuecomment-2731503650 1. Is it manually run every time now? Yes, we should refresh it before release new version doc. (After version tag generated) 2. If the PR title contains "|", an error wil

Re: [PR] [Improve][Doc] Added automatically generate connector commit history documents [seatunnel]

2025-03-17 Thread via GitHub
Hisoka-X commented on PR #8948: URL: https://github.com/apache/seatunnel/pull/8948#issuecomment-2731514636 The final look ![image](https://github.com/user-attachments/assets/f57dae0d-ef0f-4167-ae11-432cafb6e949) -- This is an automated message from the Apache Git Service. To respo

Re: [PR] [Improve][Doc] Added automatically generate connector commit history documents [seatunnel]

2025-03-17 Thread via GitHub
zhangshenghang merged PR #8948: URL: https://github.com/apache/seatunnel/pull/8948 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@s

Re: [PR] [Feature][Transform][python] add python transform [seatunnel]

2025-03-17 Thread via GitHub
hailin0 commented on PR #8854: URL: https://github.com/apache/seatunnel/pull/8854#issuecomment-2731578682 Hi @FuYouJ Is there any progress on this task? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

(seatunnel) branch dev updated (9f498b8133 -> a85fce4d54)

2025-03-17 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 9f498b8133 [Improve] influxdb options (#8966) add a85fce4d54 [Improve] Update nodejs version to fix ci (#8991)

Re: [PR] [Improve] Update nodejs version to fix ci [seatunnel]

2025-03-17 Thread via GitHub
wuchunfu merged PR #8991: URL: https://github.com/apache/seatunnel/pull/8991 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [I] [Bug] SeaTunnel job executed failed [seatunnel]

2025-03-17 Thread via GitHub
Larborator commented on issue #6854: URL: https://github.com/apache/seatunnel/issues/6854#issuecomment-2728678792 > It seems doris streamloader failed, but seatunnel is not show the error message in streamloader. After [#6688](https://github.com/apache/seatunnel/pull/6688), we improve it an

Re: [I] [Bug] [Zeta] When I use the savepoint method to restart the task, a NullPointerException is thrown. [seatunnel]

2025-03-17 Thread via GitHub
JunjianS commented on issue #6898: URL: https://github.com/apache/seatunnel/issues/6898#issuecomment-2728680736 2.3.9,kafka->hive(3.1.3)也有这个问题,怎么解决的? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] [Bug] [Doris] SeaTunnel Spark job execute failed when sink.enable-2pc=true [seatunnel]

2025-03-17 Thread via GitHub
Larborator closed issue #8990: [Bug] [Doris] SeaTunnel Spark job execute failed when sink.enable-2pc=true URL: https://github.com/apache/seatunnel/issues/8990 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [I] [Bug] SeaTunnel job executed failed [seatunnel]

2025-03-17 Thread via GitHub
Larborator commented on issue #6854: URL: https://github.com/apache/seatunnel/issues/6854#issuecomment-2729361876 > In Doris data synchronization, I also encountered the same problem. According to the logs, every time I synchronized 37 million, an error occurred, and the error message could

(seatunnel) branch dev updated (30aa485b38 -> 7821e824dd)

2025-03-17 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 30aa485b38 [Feature][Jdbc] Support sink ddl for sqlserver #8114 (#8936) add 7821e824dd [improve] email connecto

[PR] [Improve] Update nodejs version to fix ci [seatunnel]

2025-03-17 Thread via GitHub
Hisoka-X opened a new pull request, #8991: URL: https://github.com/apache/seatunnel/pull/8991 ### Purpose of this pull request Update nodejs version to fix ci because we bring local search plugin in https://github.com/apache/seatunnel-website/pull/365. ### Does this

[PR] [Improve] Refactor file enumerator to prevent duplicate put split [seatunnel]

2025-03-17 Thread via GitHub
Hisoka-X opened a new pull request, #8989: URL: https://github.com/apache/seatunnel/pull/8989 ### Purpose of this pull request Refactor file enumerator to prevent duplicate put split. Also add a test case for #6896. ### Does this PR introduce _any_ user-facing chang

[I] [Bug] [Doris] SeaTunnel Spark job execute failed when sink.enable-2pc=true [seatunnel]

2025-03-17 Thread via GitHub
Larborator opened a new issue, #8990: URL: https://github.com/apache/seatunnel/issues/8990 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [I] [Bug] [MYSQL CDC] geometry 类型自动转换为BYTES类型失败 [seatunnel]

2025-03-17 Thread via GitHub
misi1987107 commented on issue #8548: URL: https://github.com/apache/seatunnel/issues/8548#issuecomment-2729386384 I have submitted a PR to fix the geometry field type issue.But if you want to sink to an external database, you need to use a function to convert wkb binary data. You can refer

[PR] [bugfix] fix with https://github.com/apache/seatunnel/issues/8548 [seatunnel]

2025-03-17 Thread via GitHub
misi1987107 opened a new pull request, #8992: URL: https://github.com/apache/seatunnel/pull/8992 ### Purpose of this pull request Fix the geometry field type issue in MySQL CDC https://github.com/apache/seatunnel/issues/8548 ### Does this PR introduce _any_ user-facin

Re: [PR] [improve] iotdb options [seatunnel]

2025-03-17 Thread via GitHub
davidzollo merged PR #8965: URL: https://github.com/apache/seatunnel/pull/8965 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatu

Re: [I] [Feature] Please help fix search capacity for Apache SeaTunnel website [seatunnel]

2025-03-17 Thread via GitHub
davidzollo commented on issue #8980: URL: https://github.com/apache/seatunnel/issues/8980#issuecomment-2729446697 @baicie , you did a great job, so quickly and fast. Many thanks to you! -- This is an automated message from the Apache Git Service. To respond to the message, please lo

Re: [I] [Bug] [Doris] SeaTunnel Spark job execute failed when sink.enable-2pc=true [seatunnel]

2025-03-17 Thread via GitHub
Larborator commented on issue #8990: URL: https://github.com/apache/seatunnel/issues/8990#issuecomment-2729356884 通过修改BE配置:streaming_load_max_mb=81920解决 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[PR] [Fix][Core] Cancel pending job [seatunnel]

2025-03-17 Thread via GitHub
zhangshenghang opened a new pull request, #8993: URL: https://github.com/apache/seatunnel/pull/8993 ### Purpose of this pull request Cancel pending job ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### C

Re: [PR] [bugfix] fix with https://github.com/apache/seatunnel/issues/8548 [seatunnel]

2025-03-17 Thread via GitHub
hailin0 commented on PR #8992: URL: https://github.com/apache/seatunnel/pull/8992#issuecomment-2729429580 Please add test cases -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [I] [Feature] Please help fix search capacity for Apache SeaTunnel website [seatunnel]

2025-03-17 Thread via GitHub
davidzollo closed issue #8980: [Feature] Please help fix search capacity for Apache SeaTunnel website URL: https://github.com/apache/seatunnel/issues/8980 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [I] [Feature][Connector-V2] Support multi-table sink feature [seatunnel]

2025-03-17 Thread via GitHub
akulabs8 commented on issue #5652: URL: https://github.com/apache/seatunnel/issues/5652#issuecomment-2730491199 https://github.com/apache/seatunnel/pull/8994 Added this for RabbitMq -- This is an automated message from the Apache Git Service. To respond to the message, please log on