Re: [PR] [Feature] Add Support for encrypting config fields [seatunnel-web]

2025-02-10 Thread via GitHub
arshadmohammad commented on code in PR #278: URL: https://github.com/apache/seatunnel-web/pull/278#discussion_r1950374695 ## seatunnel-server/seatunnel-app/src/main/java/org/apache/seatunnel/app/service/impl/JobInstanceServiceImpl.java: ## @@ -324,6 +331,10 @@ public String gene

Re: [PR] [Feature] Add Support for encrypting config fields [seatunnel-web]

2025-02-10 Thread via GitHub
arshadmohammad commented on code in PR #278: URL: https://github.com/apache/seatunnel-web/pull/278#discussion_r1950373188 ## seatunnel-server/seatunnel-app/src/main/resources/application.yml: ## @@ -52,7 +52,13 @@ jwt: secretKey: algorithm: HS256 - +seatunnel-web: + dat

Re: [I] [Bug][seatunnel-web-1.0.2][Oracle-to-Mysql]Unable to create a source for identifier 'Jdbc' [seatunnel]

2025-02-10 Thread via GitHub
RebortBoss commented on issue #8638: URL: https://github.com/apache/seatunnel/issues/8638#issuecomment-2650040443 > Try to put the orale-jdbc driver and the mysql-jdbc driver into the $SEATUNNEL_HOME/lib directory. I have tried to put the oracle driver package in $SEATUNNEL_HOME/lib,

Re: [I] [Bug][seatunnel-web-1.0.2][Oracle-to-Mysql]Unable to create a source for identifier 'Jdbc' [seatunnel]

2025-02-10 Thread via GitHub
forkTemi commented on issue #8638: URL: https://github.com/apache/seatunnel/issues/8638#issuecomment-2650024968 Try to put the orale-jdbc driver and the mysql-jdbc driver into the $SEATUNNEL_HOME/lib directory. -- This is an automated message from the Apache Git Service. To respond to the

[PR] [Improve][dist] Reduce Docker image size [seatunnel]

2025-02-10 Thread via GitHub
quicklyfast opened a new pull request, #8641: URL: https://github.com/apache/seatunnel/pull/8641 ### Purpose of this pull request Reduce Docker image size ### Does this PR introduce _any_ user-facing change? ### How was this patch tested?

Re: [PR] [Feature] Add Support for encrypting config fields [seatunnel-web]

2025-02-10 Thread via GitHub
arshadmohammad commented on code in PR #278: URL: https://github.com/apache/seatunnel-web/pull/278#discussion_r1950350248 ## seatunnel-server/seatunnel-app/src/main/resources/application.yml: ## @@ -52,7 +52,13 @@ jwt: secretKey: algorithm: HS256 - +seatunnel-web: Revie

[PR] [Improve][Connector-v2][Paimon]PaimonCatalog close error message update [seatunnel]

2025-02-10 Thread via GitHub
uniding opened a new pull request, #8640: URL: https://github.com/apache/seatunnel/pull/8640 update close error msg ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested?

Re: [PR] [Fix][Connector-V2] Fix paimon sink restore error [seatunnel]

2025-02-10 Thread via GitHub
uniding commented on PR #8598: URL: https://github.com/apache/seatunnel/pull/8598#issuecomment-2649895929 close -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

Re: [PR] [Fix][Connector-V2] Fix paimon sink restore error [seatunnel]

2025-02-10 Thread via GitHub
uniding closed pull request #8598: [Fix][Connector-V2] Fix paimon sink restore error URL: https://github.com/apache/seatunnel/pull/8598 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [I] [Bug] [HIVE Plugin] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty [seatunnel]

2025-02-10 Thread via GitHub
jianJizz closed issue #8575: [Bug] [HIVE Plugin] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty URL: https://github.com/apache/seatunnel/issues/8575 -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [I] [Bug] [HIVE Plugin] seatunnel 2.3.9 sqlserver to hive Error: Table default.default.default field name cannot be empty [seatunnel]

2025-02-10 Thread via GitHub
jianJizz commented on issue #8575: URL: https://github.com/apache/seatunnel/issues/8575#issuecomment-2649843337 已解决,是source的sql中查询字段用了cast函数,没有取别名导致,解决:用了函数的字段一定要取别名 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[PR] [improve] add StarRocks options [seatunnel]

2025-02-10 Thread via GitHub
fcb-xiaobo opened a new pull request, #8639: URL: https://github.com/apache/seatunnel/pull/8639 ### Purpose of this pull request subtask of https://github.com/apache/seatunnel/issues/8576 ### Does this PR introduce _any_ user-facing change? ### How

Re: [PR] [Improve] restruct connector common options [seatunnel]

2025-02-10 Thread via GitHub
liunaijie commented on code in PR #8634: URL: https://github.com/apache/seatunnel/pull/8634#discussion_r1948322767 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/options/EnvOptionRule.java: ## @@ -15,26 +15,38 @@ * limitations under the License. */ -package org.ap

Re: [PR] [Fix][Engine-Server] close task when job finished to release resource. [seatunnel]

2025-02-10 Thread via GitHub
Hisoka-X closed pull request #8610: [Fix][Engine-Server] close task when job finished to release resource. URL: https://github.com/apache/seatunnel/pull/8610 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] [Fix][Connector-Hive] Fix connector hive memory leak problem [seatunnel]

2025-02-10 Thread via GitHub
Hisoka-X commented on PR #8637: URL: https://github.com/apache/seatunnel/pull/8637#issuecomment-2649691555 Waiting ci passes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] [Good First Issues] How to complete the first contribution [seatunnel]

2025-02-10 Thread via GitHub
davidzollo closed issue #2828: [Good First Issues] How to complete the first contribution URL: https://github.com/apache/seatunnel/issues/2828 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [I] [Feature][Transform] converting JSON list to multiple rows [seatunnel]

2025-02-10 Thread via GitHub
CosmosNi commented on issue #8635: URL: https://github.com/apache/seatunnel/issues/8635#issuecomment-2649626662 ` Sql { plugin_input = "fake2" plugin_output = "fake3" query = "select * from dual LATERAL VIEW EXPLODE(array_field) as map_data" }

Re: [I] [Bug][seatunnel-web-1.0.2][Oracle-to-Mysql]Unable to create a source for identifier 'Jdbc' [seatunnel]

2025-02-10 Thread via GitHub
hw20130102 commented on issue #8638: URL: https://github.com/apache/seatunnel/issues/8638#issuecomment-2649604104 I used the entire lilbrary of seatunnel-web-1.0.2 to oracle to mySQL and reported an error that did not recognize Oracle and reported a sql exception. -- This is an automated

[I] [Bug][seatunnel-web_1.0.2] Oracle and other drivers cannot be dynamically loaded [seatunnel]

2025-02-10 Thread via GitHub
hw20130102 opened a new issue, #8638: URL: https://github.com/apache/seatunnel/issues/8638 ### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [I] [Feature][Connector-Sink][Hdfs/hive]Add "data_save_mode" option plz! [seatunnel]

2025-02-10 Thread via GitHub
github-actions[bot] commented on issue #8437: URL: https://github.com/apache/seatunnel/issues/8437#issuecomment-2649558222 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] mongodb 使用match.query 无法接受外部参数 [seatunnel]

2025-02-10 Thread via GitHub
github-actions[bot] commented on issue #8498: URL: https://github.com/apache/seatunnel/issues/8498#issuecomment-2649558095 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [oracle-cdc] from oracle (19c) to starrocks : No viable statement for input 'CREATE TABLE IF NOT EXISTS [seatunnel]

2025-02-10 Thread via GitHub
github-actions[bot] closed issue #8452: [Bug] [oracle-cdc] from oracle (19c) to starrocks : No viable statement for input 'CREATE TABLE IF NOT EXISTS URL: https://github.com/apache/seatunnel/issues/8452 -- This is an automated message from the Apache Git Service. To respond to the message, pl

Re: [I] [Bug] [oracle-cdc] from oracle (19c) to starrocks : No viable statement for input 'CREATE TABLE IF NOT EXISTS [seatunnel]

2025-02-10 Thread via GitHub
github-actions[bot] commented on issue #8452: URL: https://github.com/apache/seatunnel/issues/8452#issuecomment-2649558176 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Feature][Connector-Sink][Hdfs/hive]Add "data_save_mode" option plz! [seatunnel]

2025-02-10 Thread via GitHub
github-actions[bot] closed issue #8437: [Feature][Connector-Sink][Hdfs/hive]Add "data_save_mode" option plz! URL: https://github.com/apache/seatunnel/issues/8437 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[PR] [Feature] Add Support for encrypting config fields [seatunnel-web]

2025-02-10 Thread via GitHub
shashwatsai opened a new pull request, #278: URL: https://github.com/apache/seatunnel-web/pull/278 ## Purpose of this pull request While writing intermediate config to submit job via seatunnel client, we are required to encrypt certain fields like password, auth, username

Re: [PR] [improve] update Redis connector config option [seatunnel]

2025-02-10 Thread via GitHub
akulabs8 commented on code in PR #8631: URL: https://github.com/apache/seatunnel/pull/8631#discussion_r1949646350 ## seatunnel-connectors-v2/connector-redis/src/main/java/org/apache/seatunnel/connectors/seatunnel/redis/source/RedisSourceFactory.java: ## @@ -48,18 +48,21 @@ Table

Re: [I] [Seatunnel Web] Permission control optimization [seatunnel]

2025-02-10 Thread via GitHub
zhangshenghang commented on issue #8515: URL: https://github.com/apache/seatunnel/issues/8515#issuecomment-2648111580 thanks @thakralgarvit It has been assigned to you. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [I] [Seatunnel Web] Permission control optimization [seatunnel]

2025-02-10 Thread via GitHub
thakralgarvit commented on issue #8515: URL: https://github.com/apache/seatunnel/issues/8515#issuecomment-2648101557 can u please assign it to me as no body has updated it @zhangshenghang -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [I] [Fix] fix deadlink in website [seatunnel]

2025-02-10 Thread via GitHub
thakralgarvit commented on issue #8573: URL: https://github.com/apache/seatunnel/issues/8573#issuecomment-2648094219 can u please assign it to me as no body has updated it @davidzollo -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

(seatunnel) branch dev updated: [Fix][transform-v2]SQL transform support max/min function (#8625)

2025-02-10 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 9d201bb103 [Fix][transform-v2]SQL transform sup

Re: [PR] [Fix][transform-v2]SQL transform support max/min function [seatunnel]

2025-02-10 Thread via GitHub
hailin0 merged PR #8625: URL: https://github.com/apache/seatunnel/pull/8625 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Fix][Connector-v2][DorisIT]Fix the problem that DorisIT cannot run local [seatunnel]

2025-02-10 Thread via GitHub
zhangshenghang commented on PR #8630: URL: https://github.com/apache/seatunnel/pull/8630#issuecomment-2647986710 > > Only in git environment need to execute initializeBE() logic. > > Could you share more details about why we need this in here? @hawk9821 @Hisoka-X I also have th

Re: [I] [Feature][Transform] Add python script tool to Transform [seatunnel]

2025-02-10 Thread via GitHub
FuYouJ commented on issue #8542: URL: https://github.com/apache/seatunnel/issues/8542#issuecomment-2647881788 @liugddx @hailin0 @Hisoka-X Give me some advice and I'm ready to do it -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [I] [Feature][Transform] Add python script tool to Transform [seatunnel]

2025-02-10 Thread via GitHub
FuYouJ commented on issue #8542: URL: https://github.com/apache/seatunnel/issues/8542#issuecomment-2647863894 demo -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] [Feature][Transform] Add python script tool to Transform [seatunnel]

2025-02-10 Thread via GitHub
FuYouJ commented on issue #8542: URL: https://github.com/apache/seatunnel/issues/8542#issuecomment-2647847804 I looked into a solution using py4j, and here's how it works. It supports bidirectional communication between java and python clients. To fulfill this requirement: 1:During the

Re: [PR] [Fix][Engine-Server] close task when job finished to release resource. [seatunnel]

2025-02-10 Thread via GitHub
sohurdc commented on PR #8610: URL: https://github.com/apache/seatunnel/pull/8610#issuecomment-2647776707 see there, https://github.com/apache/seatunnel/pull/8637. this can be closed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[PR] [Fix][Connector-Hive] hive memory leak, the hive source config cannot… [seatunnel]

2025-02-10 Thread via GitHub
sohurdc opened a new pull request, #8637: URL: https://github.com/apache/seatunnel/pull/8637 ### Purpose of this pull request solve problem of hive memory leak. the hive source config cannot hold field of ReadStrategy which need to close. HiveSink hold the field o

Re: [I] [Bug] [Spark] org.apache.hadoop.hive.shims.HadoopShims.getHadoopConfNames()Ljava/util/Map [seatunnel]

2025-02-10 Thread via GitHub
mohamedabidilcl commented on issue #2387: URL: https://github.com/apache/seatunnel/issues/2387#issuecomment-2647656315 How did you resolve it please ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] [Umbrella] unified parameter class and refactor connector creation logic [seatunnel]

2025-02-10 Thread via GitHub
misi1987107 commented on issue #8576: URL: https://github.com/apache/seatunnel/issues/8576#issuecomment-2647265363 OK,I am trying to submit the first PR and I need some time to I need some time to learn the submission process. -- This is an automated message from the Apache Git Service.

Re: [PR] [feature][connectors-v2][ActiveMQ] add ActiveMQ source connector [seatunnel]

2025-02-10 Thread via GitHub
L-Gryps commented on code in PR #8581: URL: https://github.com/apache/seatunnel/pull/8581#discussion_r1948586730 ## seatunnel-connectors-v2/connector-activemq/src/main/java/org/apache/seatunnel/connectors/seatunnel/activemq/source/ActivemqSourceReader.java: ## @@ -0,0 +1,197 @@

Re: [I] [Feature][Transform] converting JSON list to multiple rows [seatunnel]

2025-02-10 Thread via GitHub
FrommyMind commented on issue #8635: URL: https://github.com/apache/seatunnel/issues/8635#issuecomment-2647217036 Could you kindly provide the following details to help us investigate the issue more efficiently? 1. **Seatunnel Version**: The specific version of the component you are cu

Re: [I] [Umbrella] unified parameter class and refactor connector creation logic [seatunnel]

2025-02-10 Thread via GitHub
liunaijie commented on issue #8576: URL: https://github.com/apache/seatunnel/issues/8576#issuecomment-2647212497 > Can you assign connector-file-local to me ?thanks Already assigned connector-file-local to you. Those `connector-file-xxx` are extends `connector-file-base` module. Co