Re: [I] [Bug] [Seatunnel Web; S3 File] S3 file does not render all the required options in the UI [seatunnel]

2023-12-04 Thread via GitHub
Carl-Zhou-CN commented on issue #5961: URL: https://github.com/apache/seatunnel/issues/5961#issuecomment-1840182927 Try to put in/opt/seatunnel/web/apache-seatunnel-web-1.0.0- bin/libs -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] [Bug] [Seatunnel Web; S3 File] S3 file does not render all the required options in the UI [seatunnel]

2023-12-04 Thread via GitHub
raheen1 commented on issue #5961: URL: https://github.com/apache/seatunnel/issues/5961#issuecomment-1840123570 I already have this jar file in the seatunnel/lib folder https://github.com/apache/seatunnel/assets/151616698/9d8f1147-81f3-474c-a95f-bf1568ef29b4";> -- This is an auto

Re: [I] [Bug] [Seatunnel Web; S3 File] S3 file does not render all the required options in the UI [seatunnel]

2023-12-04 Thread via GitHub
Carl-Zhou-CN commented on issue #5961: URL: https://github.com/apache/seatunnel/issues/5961#issuecomment-1840113705 ![image](https://github.com/apache/seatunnel/assets/67902676/191edba7-2423-4f33-9425-96724cefd925) Try doing this,metadata and data source jar package also need to copy

Re: [I] [Bug] [Seatunnel Web; S3 File] S3 file does not render all the required options in the UI [seatunnel]

2023-12-04 Thread via GitHub
raheen1 commented on issue #5961: URL: https://github.com/apache/seatunnel/issues/5961#issuecomment-1840105429 But the same config file works when I run from the command line. I think the error is stating that hadoop libraries might be missing, but I have all the libraries in my pom.xml fil

Re: [I] [Bug] [Seatunnel Web; S3 File] S3 file does not render all the required options in the UI [seatunnel]

2023-12-04 Thread via GitHub
raheen1 commented on issue #5961: URL: https://github.com/apache/seatunnel/issues/5961#issuecomment-1840099149 Not able to reach the site. But I understand what you mean. So, first, I need to establish a connection and then I will be able to pass the other parameters like `path`, `file_form

Re: [I] [Bug] [mysql cdc] can't read data from mysql cdc source [seatunnel]

2023-12-04 Thread via GitHub
Carl-Zhou-CN commented on issue #5831: URL: https://github.com/apache/seatunnel/issues/5831#issuecomment-1840097955 > I still can't find a solution,wait for seatunnel v2.3.4 release ? @wilsonfu88 Can you help to test whether the dev branch still has this problem? -- This is an auto

Re: [I] [Bug] [Seatunnel Web; S3 File] S3 file does not render all the required options in the UI [seatunnel]

2023-12-04 Thread via GitHub
Carl-Zhou-CN commented on issue #5961: URL: https://github.com/apache/seatunnel/issues/5961#issuecomment-1840088276 > [https://mp.weixin.qq.com/s/eNWGP_09Oh4pHdoQkmGPzg](url) https://mp.weixin.qq.com/s/eNWGP_09Oh4pHdoQkmGPzg -- This is an automated message from the Apache Git Servic

Re: [I] [Bug] [Seatunnel Web; S3 File] S3 file does not render all the required options in the UI [seatunnel]

2023-12-04 Thread via GitHub
raheen1 commented on issue #5961: URL: https://github.com/apache/seatunnel/issues/5961#issuecomment-1840085923 @Carl-Zhou-CN the link says "No results matched your search." https://github.com/apache/seatunnel/assets/151616698/ce3e7d76-9664-4248-a6f0-77632ae7eb4e";> -- This is an aut

Re: [I] [Bug] [Seatunnel Web; S3 File] S3 file does not render all the required options in the UI [seatunnel]

2023-12-04 Thread via GitHub
Carl-Zhou-CN commented on issue #5961: URL: https://github.com/apache/seatunnel/issues/5961#issuecomment-1840081930 @raheen1 May refer to [https://mp.weixin.qq.com/s/eNWGP_09Oh4pHdoQkmGPzg](url) ,DataSource ust save the connection information and really use it in the task editing phase --

[I] Read HdfsFile Data to Elasticsearch not report error,At the beginning, there were no errors,after report errors [seatunnel]

2023-12-04 Thread via GitHub
maqw666 opened a new issue, #5962: URL: https://github.com/apache/seatunnel/issues/5962 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] [Bug] [Seatunnel Web; S3 File] S3 file does not render all the required options in the UI [seatunnel]

2023-12-04 Thread via GitHub
raheen1 commented on issue #5961: URL: https://github.com/apache/seatunnel/issues/5961#issuecomment-1840016423 @Carl-Zhou-CN are you able to assist with this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[I] [Bug] [Seatunnel Web; S3 File] S3 file does not render all the required options in the UI [seatunnel]

2023-12-04 Thread via GitHub
raheen1 opened a new issue, #5961: URL: https://github.com/apache/seatunnel/issues/5961 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] [Feature][seatunnel-web] web端几乎不可用,什么时候提供完整的web界面,非常期待 [seatunnel]

2023-12-04 Thread via GitHub
wilsonfu88 commented on issue #5794: URL: https://github.com/apache/seatunnel/issues/5794#issuecomment-1839987325 感觉目前还是个半成品,期待新版本发布 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] [Improve] Replace SeaTunnelRowType with TableSchema in the JdbcRowConverter [seatunnel]

2023-12-04 Thread via GitHub
Hisoka-X merged PR #5957: URL: https://github.com/apache/seatunnel/pull/5957 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

(seatunnel) branch dev updated: [Improve] Replace SeaTunnelRowType with TableSchema in the JdbcRowConverter

2023-12-04 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 1cc1b1b8cd [Improve] Replace SeaTunnelRowType with

[PR] [Improve][Connector-V2] Clear expired profile and fix some profile expired parameters [seatunnel]

2023-12-04 Thread via GitHub
Carl-Zhou-CN opened a new pull request, #5960: URL: https://github.com/apache/seatunnel/pull/5960 …pired parameters ### Purpose of this pull request 1.Clear some useless configuration files 2.execution.checkpoint.interval convert to checkpoint.interval

Re: [PR] [Improve] Replace SeaTunnelRowType with TableSchema in the JdbcRowConverter [seatunnel]

2023-12-04 Thread via GitHub
ic4y commented on PR #5957: URL: https://github.com/apache/seatunnel/pull/5957#issuecomment-1839948005 The PR description has been updated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

(seatunnel) branch dev updated: [Docs][Connector-V2][Oss]Reconstruct the OssFile connector document (#5233)

2023-12-04 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new f4ea676a20 [Docs][Connector-V2][Oss]Reconstruct

Re: [PR] [Docs][Connector-V2][Oss]Reconstruct the OssFile connector document [seatunnel]

2023-12-04 Thread via GitHub
hailin0 merged PR #5233: URL: https://github.com/apache/seatunnel/pull/5233 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Docs][Connector-V2][Oss]Reconstruct the OssFile connector document [seatunnel]

2023-12-04 Thread via GitHub
Hisoka-X commented on code in PR #5233: URL: https://github.com/apache/seatunnel/pull/5233#discussion_r1414789505 ## docs/en/connector-v2/source/OssFile.md: ## @@ -279,11 +213,25 @@ Source plugin common parameters, please refer to [Source Common Options](common- endpoint =

Re: [PR] [Docs][Connector-V2][Oss]Reconstruct the OssFile connector document [seatunnel]

2023-12-04 Thread via GitHub
hailin0 commented on code in PR #5233: URL: https://github.com/apache/seatunnel/pull/5233#discussion_r1414787977 ## docs/en/connector-v2/source/OssFile.md: ## @@ -279,11 +213,25 @@ Source plugin common parameters, please refer to [Source Common Options](common- endpoint =

Re: [PR] [Improve] Replace SeaTunnelRowType with TableSchema in the JdbcRowConverter [seatunnel]

2023-12-04 Thread via GitHub
Hisoka-X commented on PR #5957: URL: https://github.com/apache/seatunnel/pull/5957#issuecomment-1839910846 > https://private-user-images.githubusercontent.com/14371345/287896933-82139e69-ca7d-44a8-b7de-19b00133d34c.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkI

Re: [PR] [Feature] LocalFile sink support multiple table [seatunnel]

2023-12-04 Thread via GitHub
Hisoka-X commented on code in PR #5931: URL: https://github.com/apache/seatunnel/pull/5931#discussion_r1414778629 ## seatunnel-connectors-v2/connector-file/connector-file-local/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/local/sink/LocalFileSink.java: ## @@ -17,

Re: [PR] [Feature] LocalFile sink support multiple table [seatunnel]

2023-12-04 Thread via GitHub
Hisoka-X commented on code in PR #5931: URL: https://github.com/apache/seatunnel/pull/5931#discussion_r1414778629 ## seatunnel-connectors-v2/connector-file/connector-file-local/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/local/sink/LocalFileSink.java: ## @@ -17,

Re: [PR] [feature][connector-jdbc] Replace SeaTunnelRowType with TableSchema in the JdbcRowConverter [seatunnel]

2023-12-04 Thread via GitHub
hailin0 commented on PR #5957: URL: https://github.com/apache/seatunnel/pull/5957#issuecomment-1839889500 https://github.com/apache/seatunnel/assets/14371345/82139e69-ca7d-44a8-b7de-19b00133d34c";> -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [I] [Bug] [connector-file] HdfsFile sink lost data [seatunnel]

2023-12-04 Thread via GitHub
zhilinli123 commented on issue #5952: URL: https://github.com/apache/seatunnel/issues/5952#issuecomment-1839890530 mysql table DDL and data volume? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [I] [Bug] [rest-api] /hazelcast/rest/maps/running-jobs Request failed [seatunnel]

2023-12-04 Thread via GitHub
liugddx commented on issue #5770: URL: https://github.com/apache/seatunnel/issues/5770#issuecomment-1839874591 > ?? This issue was fixed in #5950 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] [Bug] [rest-api] /hazelcast/rest/maps/running-jobs Request failed [seatunnel]

2023-12-04 Thread via GitHub
gaotong521 commented on issue #5770: URL: https://github.com/apache/seatunnel/issues/5770#issuecomment-1839858877 ?? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [I] [Bug] [Module Name] Bug title [seatunnel]

2023-12-04 Thread via GitHub
github-actions[bot] closed issue #5713: [Bug] [Module Name] Bug title URL: https://github.com/apache/seatunnel/issues/5713 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [I] [Feature][connector-file-s3] Support TableSinkFactory On S3File [seatunnel]

2023-12-04 Thread via GitHub
github-actions[bot] commented on issue #5736: URL: https://github.com/apache/seatunnel/issues/5736#issuecomment-1839790503 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [DOCS] [connector-v2-source-kafka] Kafka configuration format error [seatunnel]

2023-12-04 Thread via GitHub
github-actions[bot] commented on issue #5747: URL: https://github.com/apache/seatunnel/issues/5747#issuecomment-1839790456 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] [Module Name] Bug title [seatunnel]

2023-12-04 Thread via GitHub
github-actions[bot] commented on issue #5713: URL: https://github.com/apache/seatunnel/issues/5713#issuecomment-1839790528 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Feature][connector-file-s3] Support TableSinkFactory On S3File [seatunnel]

2023-12-04 Thread via GitHub
github-actions[bot] closed issue #5736: [Feature][connector-file-s3] Support TableSinkFactory On S3File URL: https://github.com/apache/seatunnel/issues/5736 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] [DOCS] [connector-v2-source-kafka] Kafka configuration format error [seatunnel]

2023-12-04 Thread via GitHub
github-actions[bot] closed issue #5747: [DOCS] [connector-v2-source-kafka] Kafka configuration format error URL: https://github.com/apache/seatunnel/issues/5747 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [I] [Bug] [rest-api] /hazelcast/rest/maps/running-jobs Request failed [seatunnel]

2023-12-04 Thread via GitHub
liugddx commented on issue #5770: URL: https://github.com/apache/seatunnel/issues/5770#issuecomment-1838917185 #5950 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [I] [Bug] [RestAPi] Error submitting job [seatunnel]

2023-12-04 Thread via GitHub
liugddx commented on issue #5584: URL: https://github.com/apache/seatunnel/issues/5584#issuecomment-1838915030 #5950 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] flink restapi/webui submit job failed [seatunnel]

2023-12-04 Thread via GitHub
liugddx commented on issue #4571: URL: https://github.com/apache/seatunnel/issues/4571#issuecomment-1838913658 #5950 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [I] [Feature][Connector-V2] Support multi-table sink feature for hdfs file [seatunnel]

2023-12-04 Thread via GitHub
dengd1937 commented on issue #5726: URL: https://github.com/apache/seatunnel/issues/5726#issuecomment-1838741665 > Hi, @dengd1937 , Is there any progress on this task? I have been delayed recently due to work matters, and I am currently working on HDFS E2E. I plan to submit it together.

Re: [I] [Bug] [mysql cdc] can't read data from mysql cdc source [seatunnel]

2023-12-04 Thread via GitHub
wilsonfu88 commented on issue #5831: URL: https://github.com/apache/seatunnel/issues/5831#issuecomment-1838741262 I still can't find a solution,wait for seatunnel v2.3.4 release ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [I] HdfsFile sink not found save_mode [seatunnel]

2023-12-04 Thread via GitHub
Carl-Zhou-CN commented on issue #5946: URL: https://github.com/apache/seatunnel/issues/5946#issuecomment-1838426789 Thanks @liunaijie, @PenneyHuang , closing this issue,Can you continue with #5390 -- This is an automated message from the Apache Git Service. To respond to the message, pl

Re: [I] HdfsFile sink not found save_mode [seatunnel]

2023-12-04 Thread via GitHub
Carl-Zhou-CN closed issue #5946: HdfsFile sink not found save_mode URL: https://github.com/apache/seatunnel/issues/5946 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [I] [Bug] [Flink Sink Writer] Kafka → Hive(Partition table). With Flink-1.15, FlinkSinkWriter.snapshotState() never be called [seatunnel]

2023-12-04 Thread via GitHub
zhaoli2333 commented on issue #5299: URL: https://github.com/apache/seatunnel/issues/5299#issuecomment-1838194104 Have you solved this problem? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [I] 启动报错 [seatunnel]

2023-12-04 Thread via GitHub
jyh129143 commented on issue #5958: URL: https://github.com/apache/seatunnel/issues/5958#issuecomment-1838139857 I changed the last command to "echo java ${JAVA_OPTS} -cp ${CLASS_PATH} ${APP_MAIN} ${args}",and the console print: java -Dhazelcast.client.config=/cygdrive/e/file/apache-

Re: [PR] [Feature][Core] Upgrade flink source translation [seatunnel]

2023-12-04 Thread via GitHub
TyrantLucifer commented on code in PR #5100: URL: https://github.com/apache/seatunnel/pull/5100#discussion_r1413568517 ## seatunnel-core/seatunnel-flink-starter/seatunnel-flink-starter-common/src/main/java/org/apache/seatunnel/core/starter/flink/execution/SourceExecuteProcessor.java: ##

Re: [PR] [Feature][Core] Upgrade flink source translation [seatunnel]

2023-12-04 Thread via GitHub
TyrantLucifer commented on code in PR #5100: URL: https://github.com/apache/seatunnel/pull/5100#discussion_r1413566331 ## seatunnel-connectors-v2/connector-common/src/main/java/org/apache/seatunnel/connectors/seatunnel/common/source/AbstractSingleSplitReader.java: ## @@ -25,6 +2

Re: [PR] [Feature][Core] Upgrade flink source translation [seatunnel]

2023-12-04 Thread via GitHub
TyrantLucifer commented on code in PR #5100: URL: https://github.com/apache/seatunnel/pull/5100#discussion_r1413564284 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/source/split/FileSourceSplitEnumerator.java:

Re: [PR] [Feature][Core] Upgrade flink source translation [seatunnel]

2023-12-04 Thread via GitHub
TyrantLucifer commented on code in PR #5100: URL: https://github.com/apache/seatunnel/pull/5100#discussion_r1413563310 ## seatunnel-connectors-v2/connector-amazondynamodb/src/main/java/org/apache/seatunnel/connectors/seatunnel/amazondynamodb/source/AmazonDynamoDBSourceReader.java: #

[I] 现在支持敏感字段数据屏蔽吗? [seatunnel]

2023-12-04 Thread via GitHub
Peng-666 opened a new issue, #5959: URL: https://github.com/apache/seatunnel/issues/5959 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] 启动报错 [seatunnel]

2023-12-04 Thread via GitHub
liunaijie commented on issue #5958: URL: https://github.com/apache/seatunnel/issues/5958#issuecomment-1838085828 > sorry,could you tell me where to get file:seatunnel.cmd?Or how can I generate it? oh, sorry. i just realize the `cmd` file is not in release package. For your issue,

Re: [I] 启动报错 [seatunnel]

2023-12-04 Thread via GitHub
jyh129143 commented on issue #5958: URL: https://github.com/apache/seatunnel/issues/5958#issuecomment-1838064243 sorry,could you tell me where to get file:seatunnel.cmd?Or how can I generate it? -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [I] [Bug] [Starter] Checkpoint Config Use HDFS Namespace [seatunnel]

2023-12-04 Thread via GitHub
liunaijie commented on issue #5906: URL: https://github.com/apache/seatunnel/issues/5906#issuecomment-1838058481 @svea-vip @daishuhuaimu pls refer this issue: https://github.com/apache/seatunnel/issues/3895 -- This is an automated message from the Apache Git Service. To respond to th

Re: [I] HdfsFile sink not found save_mode [seatunnel]

2023-12-04 Thread via GitHub
liunaijie commented on issue #5946: URL: https://github.com/apache/seatunnel/issues/5946#issuecomment-1838041082 hi @PenneyHuang. for now HDFS save_mode is not support. The support parameter you can refer this page: https://seatunnel.apache.org/docs/2.3.3/connector-v2/sink/HdfsFile S

Re: [I] 启动报错 [seatunnel]

2023-12-04 Thread via GitHub
liunaijie commented on issue #5958: URL: https://github.com/apache/seatunnel/issues/5958#issuecomment-1838031964 for windows, you can try to use `seatunnel.cmd` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a