Re: [PR] [Bug][connector-iceberg]fixed iceberg sink [seatunnel]

2024-09-14 Thread via GitHub
sunxiaojian commented on PR #7660: URL: https://github.com/apache/seatunnel/pull/7660#issuecomment-2350983428 > Could you add a test case? This is useless code, existing case can cover it -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [I] [Bug] [Seatunnel Examples] Sample code execution error. No DataSerializerFactory registered for namespace: -30002 [seatunnel]

2024-09-14 Thread via GitHub
sudeephazra commented on issue #6345: URL: https://github.com/apache/seatunnel/issues/6345#issuecomment-2350986969 Thanks @Hisoka-X I believe we need to modify the documentation to showcase that we need both the module and sub-module to be added in the pom.xml. When I used just the LocalFil

Re: [PR] [Feature][Connector-V2] Ftp file sink suport multiple table and save mode [seatunnel]

2024-09-14 Thread via GitHub
hailin0 merged PR #7665: URL: https://github.com/apache/seatunnel/pull/7665 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Feature][Connector-V2] Ftp file sink suport multiple table and save mode (#7665)

2024-09-14 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 4f812e12ae [Feature][Connector-V2] Ftp file sin

Re: [PR] [Improve][Connector-V2] Support read archive compress file [seatunnel]

2024-09-14 Thread via GitHub
corgy-w commented on code in PR #7633: URL: https://github.com/apache/seatunnel/pull/7633#discussion_r1759762682 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/config/BaseFileSinkConfig.java: ## @@ -38,6

[PR] [Bug][datasource-mongodb] fix cannot listDatabaseNames and listConnectionNames [seatunnel-web]

2024-09-14 Thread via GitHub
colin719 opened a new pull request, #215: URL: https://github.com/apache/seatunnel-web/pull/215 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary package

[PR] [Bug][Seatunnel-web][Hive] An error occurred during the attempt to save a job using the Hive connector. [seatunnel-web]

2024-09-14 Thread via GitHub
arshadmohammad opened a new pull request, #216: URL: https://github.com/apache/seatunnel-web/pull/216 Added HiveDataSourceConfigSwitcher and corrected logic to populate correct fields for Hive Source ## Purpose of this pull request ## Check list * [ ] Code ch

Re: [PR] [Bug][Seatunnel-web][Hive] An error occurred during the attempt to save a job using the Hive connector. [seatunnel-web]

2024-09-14 Thread via GitHub
arshadmohammad commented on PR #216: URL: https://github.com/apache/seatunnel-web/pull/216#issuecomment-2351202375 After change, hive source containing job was saved and executed successfully. ![image](https://github.com/user-attachments/assets/91f4383f-97fe-4453-b9d8-9b5edde6f450)

Re: [I] [Bug] File does not exist: /hadoop/hudi/.hoodie/hoodie.properties (inode 50486) [Lease. Holder: DFSClient_NONMAPREDUCE_1296093085_172, pending creates: 1] [seatunnel]

2024-09-14 Thread via GitHub
github-actions[bot] commented on issue #7409: URL: https://github.com/apache/seatunnel/issues/7409#issuecomment-2351248470 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [Checkoint] checkpoint fail in 2.3.6 [seatunnel]

2024-09-14 Thread via GitHub
github-actions[bot] closed issue #7339: [Bug] [Checkoint] checkpoint fail in 2.3.6 URL: https://github.com/apache/seatunnel/issues/7339 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [I] [Bug] [Checkoint] checkpoint fail in 2.3.6 [seatunnel]

2024-09-14 Thread via GitHub
github-actions[bot] commented on issue #7339: URL: https://github.com/apache/seatunnel/issues/7339#issuecomment-2351248505 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] Mysql bug [seatunnel]

2024-09-14 Thread via GitHub
github-actions[bot] commented on issue #7317: URL: https://github.com/apache/seatunnel/issues/7317#issuecomment-2351248517 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] Mysql bug [seatunnel]

2024-09-14 Thread via GitHub
github-actions[bot] closed issue #7317: [Bug] Mysql bug URL: https://github.com/apache/seatunnel/issues/7317 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-m

[PR] [Feature][Connector-V2] sftp file sink suport multiple table and save mode [seatunnel]

2024-09-14 Thread via GitHub
chl-wxp opened a new pull request, #7668: URL: https://github.com/apache/seatunnel/pull/7668 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

[PR] [Fix] Fix can not import icons [seatunnel-website]

2024-09-14 Thread via GitHub
Hisoka-X opened a new pull request, #335: URL: https://github.com/apache/seatunnel-website/pull/335 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

Re: [PR] [Improve][Connector-V2] Support read archive compress file [seatunnel]

2024-09-14 Thread via GitHub
Hisoka-X commented on code in PR #7633: URL: https://github.com/apache/seatunnel/pull/7633#discussion_r1759965260 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/config/BaseFileSinkConfig.java: ## @@ -38,

Re: [I] [Improve][Doc] icon display problem [seatunnel]

2024-09-14 Thread via GitHub
Hisoka-X commented on issue #7663: URL: https://github.com/apache/seatunnel/issues/7663#issuecomment-2351379188 fixed by https://github.com/apache/seatunnel-website/pull/335 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [Improve][Connector-V2] Support read archive compress file [seatunnel]

2024-09-14 Thread via GitHub
corgy-w commented on code in PR #7633: URL: https://github.com/apache/seatunnel/pull/7633#discussion_r1759970735 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/config/BaseFileSinkConfig.java: ## @@ -38,6

Re: [PR] [Improve][Connector-V2] Support read archive compress file [seatunnel]

2024-09-14 Thread via GitHub
corgy-w commented on code in PR #7633: URL: https://github.com/apache/seatunnel/pull/7633#discussion_r1759972979 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/config/BaseFileSinkConfig.java: ## @@ -38,6

Re: [I] [Feature][Core] The feasibility of seatunnel as an underlying support for an ETL tool(seatunnel作为ETL工具的底层支持的可行性) [seatunnel]

2024-09-14 Thread via GitHub
loveyang1990 commented on issue #6913: URL: https://github.com/apache/seatunnel/issues/6913#issuecomment-2350886391 I also need this requirement, at first thought it was very simple, after reading the source code, I feel that it is really a little difficult to achieve, please how there

Re: [I] [Feature][Core] The feasibility of seatunnel as an underlying support for an ETL tool(seatunnel作为ETL工具的底层支持的可行性) [seatunnel]

2024-09-14 Thread via GitHub
loveyang1990 commented on issue #6913: URL: https://github.com/apache/seatunnel/issues/6913#issuecomment-2350886515 I also need this requirement, at first thought it was very simple, after reading the source code, I feel that it is really a little difficult to achieve, please how there

Re: [I] [Feature][Core] The feasibility of seatunnel as an underlying support for an ETL tool(seatunnel作为ETL工具的底层支持的可行性) [seatunnel]

2024-09-14 Thread via GitHub
hexnn commented on issue #6913: URL: https://github.com/apache/seatunnel/issues/6913#issuecomment-2350887158 https://github.com/hexnn/Stark Try this. 试试这个 回复的原邮件 | 发件人 | ***@***.***> | | 发送日期 | 2024年09月14日 15:13 | | 收件人 | apache/seatunnel ***@***.***> | | 抄送人 |

Re: [I] [Feature][Core] The feasibility of seatunnel as an underlying support for an ETL tool(seatunnel作为ETL工具的底层支持的可行性) [seatunnel]

2024-09-14 Thread via GitHub
loveyang1990 commented on issue #6913: URL: https://github.com/apache/seatunnel/issues/6913#issuecomment-2350892907 https://github.com/hexnn/Stark 不是基于 seatunnel 的吧, 还是Spark平台 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[PR] [improve][Redis]Redis scan command supports versions 3, 4, 5, 6, 7 [seatunnel]

2024-09-14 Thread via GitHub
FuYouJ opened a new pull request, #7666: URL: https://github.com/apache/seatunnel/pull/7666 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

Re: [PR] [Fix][Plugin]Add remote plugin discovery for flink yarn applicion deploy mode [seatunnel]

2024-09-14 Thread via GitHub
hanhanzhang commented on PR #7649: URL: https://github.com/apache/seatunnel/pull/7649#issuecomment-2350905660 > https://private-user-images.githubusercontent.com/51053924/367492556-eddb9fcd-8a03-4c46-8f2a-7cdb3f9100b4.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYX

Re: [PR] [Feature][Hudi Sink] Optimize hudi sink [seatunnel]

2024-09-14 Thread via GitHub
happyboy1024 commented on code in PR #7662: URL: https://github.com/apache/seatunnel/pull/7662#discussion_r1759694499 ## docs/en/connector-v2/sink/Hudi.md: ## @@ -14,33 +14,74 @@ Used to write data to Hudi. ## Options -|name| type | required | defa

Re: [PR] [Fix][Plugin]Add remote plugin discovery for flink yarn applicion deploy mode [seatunnel]

2024-09-14 Thread via GitHub
hanhanzhang commented on PR #7649: URL: https://github.com/apache/seatunnel/pull/7649#issuecomment-2350908113 Remote plugin discover mechanism allows user to upload connector plugins to an external storage system in advance. In application deployment mode, dependency plugin can be loaded fr

Re: [I] [Bug] [Seatunnel Examples] Sample code execution error. No DataSerializerFactory registered for namespace: -30002 [seatunnel]

2024-09-14 Thread via GitHub
sudeephazra commented on issue #6345: URL: https://github.com/apache/seatunnel/issues/6345#issuecomment-2350910832 So, I rolled back to JDK 8 since nothing was working. And moved development to my Ubuntu VM. Then I forked the dev branch from commit 154e866 - Cloned the repo - Op

Re: [I] [Bug] [Seatunnel Examples] Sample code execution error. No DataSerializerFactory registered for namespace: -30002 [seatunnel]

2024-09-14 Thread via GitHub
sudeephazra commented on issue #6345: URL: https://github.com/apache/seatunnel/issues/6345#issuecomment-2350912520 > So, I rolled back to JDK 8 since nothing was working. And moved development to my Ubuntu VM. > > Then I forked the dev branch from commit [154e866](https://github.com/

Re: [I] [Bug] [Seatunnel Examples] Sample code execution error. No DataSerializerFactory registered for namespace: -30002 [seatunnel]

2024-09-14 Thread via GitHub
Hisoka-X commented on issue #6345: URL: https://github.com/apache/seatunnel/issues/6345#issuecomment-2350913211 Yep, please follow our guide https://seatunnel.apache.org/docs/2.3.7/contribution/setup/#whats-more ``` Please note that when using connectors other than FakeSource and Conso

Re: [I] [Bug] [Seatunnel Examples] Sample code execution error. No DataSerializerFactory registered for namespace: -30002 [seatunnel]

2024-09-14 Thread via GitHub
Hisoka-X closed issue #6345: [Bug] [Seatunnel Examples] Sample code execution error. No DataSerializerFactory registered for namespace: -30002 URL: https://github.com/apache/seatunnel/issues/6345 -- This is an automated message from the Apache Git Service. To respond to the message, please lo

Re: [I] [Bug] [Seatunnel Examples] Sample code execution error. No DataSerializerFactory registered for namespace: -30002 [seatunnel]

2024-09-14 Thread via GitHub
Hisoka-X commented on issue #6345: URL: https://github.com/apache/seatunnel/issues/6345#issuecomment-2350913390 Thanks @sudeephazra for feedback. I closed this issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [Improve][SeaTunnel-Web] Unified use of JSONUtils [seatunnel-web]

2024-09-14 Thread via GitHub
wuchunfu merged PR #214: URL: https://github.com/apache/seatunnel-web/pull/214 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatu

(seatunnel-web) branch main updated: [Improve][SeaTunnel-Web] Unified use of JSONUtils (#214)

2024-09-14 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/seatunnel-web.git The following commit(s) were added to refs/heads/main by this push: new 6cd2d7c8 [Improve][SeaTunnel-Web] Unified u

[I] [Bug] [org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.oracle] CatalogException [seatunnel]

2024-09-14 Thread via GitHub
hxh-plzshowme opened a new issue, #7667: URL: https://github.com/apache/seatunnel/issues/7667 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happ

Re: [PR] [Fix][Plugin]Add remote plugin discovery for flink yarn applicion deploy mode [seatunnel]

2024-09-14 Thread via GitHub
Carl-Zhou-CN commented on PR #7649: URL: https://github.com/apache/seatunnel/pull/7649#issuecomment-2350931964 `${FLINK_HOME}/bin/flink run-application -Dyarn.ship-files='./config/v2.streaming.conf.template' -Dyarn.classpath.include-user-jar=DISABLED -Dyarn.provided.usrlib.dir='hdfs://HDF

Re: [I] [Bug] [seatunnel-hadoop3-3.1.4-uber] This jar package is not up to date [seatunnel]

2024-09-14 Thread via GitHub
Hisoka-X commented on issue #7588: URL: https://github.com/apache/seatunnel/issues/7588#issuecomment-2350943495 Hi @FLOWFOX @YuriyGavrilov , are you build on mac/linux? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] [Fix][Plugin]Add remote plugin discovery for flink yarn applicion deploy mode [seatunnel]

2024-09-14 Thread via GitHub
Carl-Zhou-CN commented on PR #7649: URL: https://github.com/apache/seatunnel/pull/7649#issuecomment-2350950917 ![image](https://github.com/user-attachments/assets/4dfdb588-9257-46af-94f5-35db9163626d) -- This is an automated message from the Apache Git Service. To respond to the messa

Re: [I] [Bug] [seatunnel-hadoop3-3.1.4-uber] This jar package is not up to date [seatunnel]

2024-09-14 Thread via GitHub
Hisoka-X commented on issue #7588: URL: https://github.com/apache/seatunnel/issues/7588#issuecomment-2350955352 > @Hisoka-X yes, used Mac OS X on intel chip and latest maven. > > First way was to use latest java but it didn't work fine with 22, 21 and so on till 17 Thanks for s

Re: [PR] [Fix][Core] Fix hadoop shade jar not up to date [seatunnel]

2024-09-14 Thread via GitHub
Hisoka-X closed pull request #7659: [Fix][Core] Fix hadoop shade jar not up to date URL: https://github.com/apache/seatunnel/pull/7659 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] [Fix][Core] Fix hadoop shade jar not up to date [seatunnel]

2024-09-14 Thread via GitHub
Hisoka-X closed pull request #7659: [Fix][Core] Fix hadoop shade jar not up to date URL: https://github.com/apache/seatunnel/pull/7659 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] [Feature][Connector-V2] Ftp file sink suport multiple table and save mode [seatunnel]

2024-09-14 Thread via GitHub
Hisoka-X commented on code in PR #7665: URL: https://github.com/apache/seatunnel/pull/7665#discussion_r1759719905 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-file-ftp-e2e/src/test/java/org/apache/seatunnel/e2e/connector/file/ftp/FtpFileIT.java: ## @@ -143,6 +153,70 @@

Re: [PR] [Improve][Connector-V2] Support read archive compress file [seatunnel]

2024-09-14 Thread via GitHub
Hisoka-X commented on code in PR #7633: URL: https://github.com/apache/seatunnel/pull/7633#discussion_r1759721104 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/config/BaseFileSinkConfig.java: ## @@ -38,

Re: [PR] [Feature][Connector-V2] Ftp file sink suport multiple table and save mode [seatunnel]

2024-09-14 Thread via GitHub
chl-wxp commented on code in PR #7665: URL: https://github.com/apache/seatunnel/pull/7665#discussion_r1759721875 ## docs/en/connector-v2/sink/FtpFile.md: ## @@ -273,6 +287,33 @@ FtpFile { ``` +When our source end is multiple tables, and wants different expressions to diffe

Re: [PR] [Feature][Connector Hive] support hive savemode [seatunnel]

2024-09-14 Thread via GitHub
Hisoka-X commented on code in PR #6842: URL: https://github.com/apache/seatunnel/pull/6842#discussion_r1759723067 ## seatunnel-connectors-v2/connector-hive/src/test/java/org/apache/seatunnel/connectors/seatunnel/hive/utils/HiveMetaStoreProxyUtilsTest.java: ## @@ -1,59 +0,0 @@ -/