Re: [I] [Bug] [S3File] [zeta-local] There is an occasional problem with S3File writing. An error was reported [seatunnel]

2024-04-09 Thread via GitHub
LeonYoah commented on issue #6678: URL: https://github.com/apache/seatunnel/issues/6678#issuecomment-2046648650 In addition, there's nothing wrong with debugging with idea, but that's what happens on the server. -- This is an automated message from the Apache Git Service. To respond to th

Re: [I] [Bug] [Tool] Failed to resolve parameter [org.apache.seatunnel.e2e.common.container.TestContainer arg0] [seatunnel]

2024-04-09 Thread via GitHub
dailai commented on issue #6677: URL: https://github.com/apache/seatunnel/issues/6677#issuecomment-2046645928 Why is "ls -q"? I was also successful running this test locally alone。Screenshot as follows: ![image](https://github.com/apache/seatunnel/assets/18141150/b6c2040c-65a0-440d-9080-

Re: [PR] [feature][datasource] Main add datasource-jdbc-snowflake [seatunnel-web]

2024-04-09 Thread via GitHub
smallcattle commented on PR #160: URL: https://github.com/apache/seatunnel-web/pull/160#issuecomment-2046642368 Can you add new datasource jdbc paimon or sink jdbc paimon functions. Implement the HIVE function for the paimon plugin -- This is an automated message from the Apache Git Se

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
zhilinli123 commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1558918545 ## docs/zh/connector-v2/sink/Jdbc.md: ## @@ -0,0 +1,353 @@ +# JDBC + +> JDBC 数据接收器 + +## 描述 + +通过jdbc写入数据。支持批处理模式和流处理模式,支持并发写入,支持精确一次语义(使用XA事务保证) + +## 使用依赖 + +##

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
zhilinli123 commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1558918765 ## docs/zh/connector-v2/sink/Jdbc.md: ## @@ -0,0 +1,353 @@ +# JDBC + +> JDBC 数据接收器 + +## 描述 + +通过jdbc写入数据。支持批处理模式和流处理模式,支持并发写入,支持精确一次语义(使用XA事务保证) + +## 使用依赖 + +##

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
zhilinli123 commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1558918002 ## docs/zh/connector-v2/sink/Jdbc.md: ## @@ -0,0 +1,353 @@ +# JDBC + +> JDBC 数据接收器 + +## 描述 + +通过jdbc写入数据。支持批处理模式和流处理模式,支持并发写入,支持精确一次语义(使用XA事务保证) + +## 使用依赖 + +##

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
zhilinli123 commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1558916324 ## docs/zh/connector-v2/sink/Email.md: ## @@ -0,0 +1,87 @@ +# Email + +> Email 数据接收器 + +## 描述 + +将接收的数据作为文件发送到电子邮件 + +已测试的电子邮件版本为 1.5.6 Review Comment: ## 支持版

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
zhilinli123 commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1558915440 ## docs/zh/connector-v2/sink/Elasticsearch.md: ## @@ -0,0 +1,218 @@ +# Elasticsearch + +## 描述 + +输出数据到 `Elasticsearch` + +## 主要特性 + +- [ ] [精确一次](../../concept/co

[I] [Bug] [S3File] [zeta-local] There is an occasional problem with S3File writing. An error was reported [seatunnel]

2024-04-09 Thread via GitHub
LeonYoah opened a new issue, #6678: URL: https://github.com/apache/seatunnel/issues/6678 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] [Bug] [Module Name] install plugins prompt "Exception in thread "main" java.util.zip.ZipException: error in opening zip file" [seatunnel]

2024-04-09 Thread via GitHub
lidongfu005 commented on issue #5775: URL: https://github.com/apache/seatunnel/issues/5775#issuecomment-2046618322 Install SeaTunnel connectors plugins, usage version is 2.3.4 install connector : connector-cdc-mysql Exception in thread "main" java.util.zip.ZipException: error in openin

Re: [I] [Bug] [JDBC] JDBC SQLSERVER use table_path reports error when filedname is KEY WORD [seatunnel]

2024-04-09 Thread via GitHub
bjdaijun commented on issue #6675: URL: https://github.com/apache/seatunnel/issues/6675#issuecomment-2046599139 Also Tested with SQLServer CDC, It's also reports error of the field "index". -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [I] [Bug] [JDBC] JDBC SQLSERVER use table_path reports error when filedname is KEY WORD [seatunnel]

2024-04-09 Thread via GitHub
bjdaijun commented on issue #6675: URL: https://github.com/apache/seatunnel/issues/6675#issuecomment-2046597937 > You can try add "query = "select [index] as index_1 from WD_3219.dbo.RawData"" in jdbc{} , because the example in JDBC use table_path as table name too. > > env { paralle

Re: [I] [Bug] [JDBC] JDBC SQLSERVER use table_path reports error when filedname is KEY WORD [seatunnel]

2024-04-09 Thread via GitHub
chenshu612 commented on issue #6675: URL: https://github.com/apache/seatunnel/issues/6675#issuecomment-2046576297 You can try add "query = "select [index] as index_1 from WD_3219.dbo.RawData"" in jdbc{} , because the example in JDBC use table_path as table name too. env { para

[I] [Bug] [Tool] Failed to resolve parameter [org.apache.seatunnel.e2e.common.container.TestContainer arg0] [seatunnel]

2024-04-09 Thread via GitHub
xiaochen-zhou opened a new issue, #6677: URL: https://github.com/apache/seatunnel/issues/6677 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happ

Re: [I] [SqlServer-CDC]当字段数量超过128,无法正常cdc [seatunnel]

2024-04-09 Thread via GitHub
bulolo commented on issue #6658: URL: https://github.com/apache/seatunnel/issues/6658#issuecomment-2046517277 > What is the database version? 2019 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[I] Provider org.apache.seatunnel.connectors.seatunnel.file.s3.sink.S3FileSink could not be instantiated [seatunnel]

2024-04-09 Thread via GitHub
guoyangjie opened a new issue, #6676: URL: https://github.com/apache/seatunnel/issues/6676 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

[I] [Bug] [JDBC] JDBC SQLSERVER use table_path reports error when filedname is KEY WORD [seatunnel]

2024-04-09 Thread via GitHub
bjdaijun opened a new issue, #6675: URL: https://github.com/apache/seatunnel/issues/6675 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] [Feature][Zeta Engine] Separate the responsibilities of Master and Worker to improve the stability of the cluster [seatunnel]

2024-04-09 Thread via GitHub
liunaijie commented on issue #6672: URL: https://github.com/apache/seatunnel/issues/6672#issuecomment-2046498694 the `createJoiner` method please also consider ths kubernetes case. https://github.com/apache/seatunnel/pull/6500/files#diff-02535afd997b497cf23932d7244a15c5a7a37799f64b07d

Re: [PR] [Improve][Zeta] when job finished, the checkpoint won't write to file [seatunnel]

2024-04-09 Thread via GitHub
Hisoka-X commented on PR #6674: URL: https://github.com/apache/seatunnel/pull/6674#issuecomment-204649 Please add test case to verify no file in checkpoint directory when job finished, also need add test case to make sure file would generate when job done with savepoint. -- This is a

Re: [I] [Bug] [connector-rabbitmq] Failed to trigger checkpoint and job cannot work [seatunnel]

2024-04-09 Thread via GitHub
liunaijie commented on issue #6671: URL: https://github.com/apache/seatunnel/issues/6671#issuecomment-2046486757 can you attach more detail log, those are flink class error log, if there has seatunnel class log would be better. -- This is an automated message from the Apache Git Service.

[PR] [Improve][Zeta] when job finished, the checkpoint won't write to file [seatunnel]

2024-04-09 Thread via GitHub
liunaijie opened a new pull request, #6674: URL: https://github.com/apache/seatunnel/pull/6674 ### Purpose of this pull request close #6670 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check lis

Re: [I] [Improve][Zeta] Does not save checkpoint file when job finished. [seatunnel]

2024-04-09 Thread via GitHub
Hisoka-X commented on issue #6670: URL: https://github.com/apache/seatunnel/issues/6670#issuecomment-2046472054 > @Hisoka-X From your description and the code, i find the checkpoint is write to file by this code: https://github.com/apache/seatunnel/blob/dev/seatunnel-engine/seatunnel-engine

Re: [I] [SqlServer-CDC]当字段数量超过128,无法正常cdc [seatunnel]

2024-04-09 Thread via GitHub
NickCodeJourney commented on issue #6658: URL: https://github.com/apache/seatunnel/issues/6658#issuecomment-2046467344 What is the database version? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [I] [Improve][Zeta] Does not save checkpoint file when job finished. [seatunnel]

2024-04-09 Thread via GitHub
liunaijie commented on issue #6670: URL: https://github.com/apache/seatunnel/issues/6670#issuecomment-2046467177 @Hisoka-X From your description and the code, i find the checkpoint is write to file by this code: https://github.com/apache/seatunnel/blob/dev/seatunnel-engine/seatunnel-engine-

Re: [PR] [Connector]Add hbase source connector [seatunnel]

2024-04-09 Thread via GitHub
Hisoka-X commented on PR #6348: URL: https://github.com/apache/seatunnel/pull/6348#issuecomment-2046440445 cc @TyrantLucifer as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] runs on flink 1.16.3 yarn-application 模式执行官方案例报错 [seatunnel]

2024-04-09 Thread via GitHub
chenshu612 commented on issue #6622: URL: https://github.com/apache/seatunnel/issues/6622#issuecomment-2046438384 你需要在config目录下,手动创建v2.streaming.conf.template这个文件,才能提交任务运行案例 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [Improve][Connector-V2][Iceberg] Support for S3 in hadoop catalog [seatunnel]

2024-04-09 Thread via GitHub
Hisoka-X commented on code in PR #5745: URL: https://github.com/apache/seatunnel/pull/5745#discussion_r1558756382 ## seatunnel-shade/seatunnel-hadoop3-3.1.4-uber/pom.xml: ## @@ -52,6 +52,11 @@ snappy-java 1.1.10.4 + +org.ap

Re: [I] runs on flink 1.16.3 yarn-application 模式执行官方案例报错 [seatunnel]

2024-04-09 Thread via GitHub
chenshu612 commented on issue #6622: URL: https://github.com/apache/seatunnel/issues/6622#issuecomment-2046413577 提交任务的命令有问题。报错原因是:'../config/v2.streaming.conf.template'这个文件不存在。你需要检查这个配置文件是否存在或命名是否正确或路径是否正确。 -- This is an automated message from the Apache Git Service. To respond to the me

Re: [PR] [Improve][Connector-v2] The hive connector support multiple filesystem [seatunnel]

2024-04-09 Thread via GitHub
dailai commented on PR #6648: URL: https://github.com/apache/seatunnel/pull/6648#issuecomment-2046319480 HDFS: ![hive_on_hdfs](https://github.com/apache/seatunnel/assets/18141150/81724208-4cf8-47c7-bebd-6d098c84c600) ![hive_on_hdfs_data](https://github.com/apache/seatunnel/assets/1814

Re: [PR] [Fix][Doc] Fixed links in some documents [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on PR #6673: URL: https://github.com/apache/seatunnel/pull/6673#issuecomment-2046305902 > @EricJoy2048 @liugddx Sorry to bother, I have a question. I added a documentation link [debezium documentation](https://debezium.io/documentation/reference/2.5/connectors/mysql.html#mys

Re: [PR] [Improve][Connector-V2][Iceberg] Support for S3 in hadoop catalog [seatunnel]

2024-04-09 Thread via GitHub
Carl-Zhou-CN commented on code in PR #5745: URL: https://github.com/apache/seatunnel/pull/5745#discussion_r1558620726 ## seatunnel-e2e/seatunnel-e2e-common/src/test/java/org/apache/seatunnel/e2e/common/container/seatunnel/SeaTunnelContainer.java: ## @@ -318,7 +318,11 @@ private

Re: [I] [Bug] [Seatunnel-Config] The config module easily get ConfigIncluder Class Error. [seatunnel]

2024-04-09 Thread via GitHub
woshishen9002 commented on issue #4750: URL: https://github.com/apache/seatunnel/issues/4750#issuecomment-2046285500 当我想要在idea中编译运行代码的时候,我同样遇到了这个问题。命令 : mvn clean install -DskipTests 解决方法: 1》.执行mvn clean install -DskipTests 2》.将已经编译的 seatunnel-config-base-2.3.4-SNAPSHOT.jar 手动安装

Re: [I] [Feature][Source Data] Expect for support for XML format from HTTP or LocalFile [seatunnel]

2024-04-09 Thread via GitHub
github-actions[bot] commented on issue #6473: URL: https://github.com/apache/seatunnel/issues/6473#issuecomment-2046239307 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] java.util.ArrayList cannot be cast to java.util.Map [seatunnel]

2024-04-09 Thread via GitHub
github-actions[bot] commented on issue #6478: URL: https://github.com/apache/seatunnel/issues/6478#issuecomment-2046239286 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [PR] [Connector]Add hbase source connector [seatunnel]

2024-04-09 Thread via GitHub
TaoZex commented on PR #6348: URL: https://github.com/apache/seatunnel/pull/6348#issuecomment-2046226684 I have modified the code according to the suggestion, thanks for @hailin0 @Hisoka-X review. I have communicated with @lihjChina on wechat. At present, he has used this pr in the product

Re: [I] [Bug] [Seatunnel Examples] Sample code execution error. No DataSerializerFactory registered for namespace: -30002 [seatunnel]

2024-04-09 Thread via GitHub
sgopalakrishnan3009 commented on issue #6345: URL: https://github.com/apache/seatunnel/issues/6345#issuecomment-2045570239 Running into the same issue `ERROR org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel-414517] [5.1] submit job 830041538716237825 er

[PR] [feature][datasource] Main add datasource-jdbc-snowflake [seatunnel-web]

2024-04-09 Thread via GitHub
haneeshmv opened a new pull request, #160: URL: https://github.com/apache/seatunnel-web/pull/160 ## Purpose of this pull request ## Check list * [X] Code changed are covered with tests, or it does not need tests for reason: * [X] If any new Jar binary package

(seatunnel) branch dev updated: [Hotfix] fix http source can not read yyyy-MM-dd HH:mm:ss format bug & Improve DateTime Utils (#6601)

2024-04-09 Thread liugddx
This is an automated email from the ASF dual-hosted git repository. liugddx pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 19888e7969 [Hotfix] fix http source can not read y

Re: [PR] [Hotfix] fix http source can not read yyyy-MM-dd HH:mm:ss format bug & Improve DateTime Utils [seatunnel]

2024-04-09 Thread via GitHub
liugddx merged PR #6601: URL: https://github.com/apache/seatunnel/pull/6601 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Hotfix] fix http source can not read yyyy-MM-dd HH:mm:ss format bug & Improve DateTime Utils [seatunnel]

2024-04-09 Thread via GitHub
Carl-Zhou-CN commented on code in PR #6601: URL: https://github.com/apache/seatunnel/pull/6601#discussion_r1557683616 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/source/reader/TextReadStrategy.java: #

Re: [PR] [Fix][Doc] Fixed links in some documents [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on PR #6673: URL: https://github.com/apache/seatunnel/pull/6673#issuecomment-2045222396 ![image](https://github.com/apache/seatunnel/assets/58384836/e551d32a-fd2c-4efc-972d-c445d75b660e) -- This is an automated message from the Apache Git Service. To respond to the mes

Re: [PR] [Fix][Doc] Fixed links in some documents [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on PR #6673: URL: https://github.com/apache/seatunnel/pull/6673#issuecomment-2045218635 @EricJoy2048 @liugddx Sorry to bother, I have a question. I added a documentation link [debezium documentation](https://debezium.io/documentation/reference/2.5/connectors/mysql.html#mysq

Re: [I] [OnlineMeeting&April.9]SeaTunnel community meeting Topic collect [seatunnel]

2024-04-09 Thread via GitHub
EricJoy2048 commented on issue #6655: URL: https://github.com/apache/seatunnel/issues/6655#issuecomment-2044958937 [STIP7-The Zeta Master is separated from the Worker](https://cwiki.apache.org/confluence/display/SEATUNNEL/STIP7-The+Zeta+Master+is+separated+from+the+Worker) https://cw

[PR] [Fix][Doc] Fixed links in some documents [seatunnel]

2024-04-09 Thread via GitHub
xxzuo opened a new pull request, #6673: URL: https://github.com/apache/seatunnel/pull/6673 ### Purpose of this pull request - Reference links have been added to the English document - Replace some English document links in Chinese documents with translated Chinese docum

Re: [I] [Doc][Improve] support chinese [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on issue #6378: URL: https://github.com/apache/seatunnel/issues/6378#issuecomment-2044833548 Sorry, I didn't see this issue before submitting the PR #6656, I have already translated these documents. -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
zhilinli123 commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557460490 ## docs/zh/connector-v2/formats/avro.md: ## @@ -0,0 +1,111 @@ +# Avro 格式 + +Avro是一种流行数据传输格式。现在seatunnel在kafka连接器中支持Avro格式 + +# 怎样用 + +## Kafka 使用示例 + +- 使用 Avro 格

Re: [PR] [Feature][starter] support user define parameter on spark/flink engine [seatunnel]

2024-04-09 Thread via GitHub
liunaijie commented on code in PR #6387: URL: https://github.com/apache/seatunnel/pull/6387#discussion_r1557358689 ## seatunnel-core/seatunnel-starter/src/test/java/org/apache/seatunnel/core/starter/seatunnel/args/ClientCommandArgsTest.java: ## Review Comment: delete this u

Re: [I] [SqlServer-CDC]当字段数量超过128,无法正常cdc [seatunnel]

2024-04-09 Thread via GitHub
bulolo commented on issue #6658: URL: https://github.com/apache/seatunnel/issues/6658#issuecomment-2044520635 > https://dev-files-1253767413.cos.ap-guangzhou.myqcloud.com/temp/ORDERDETAIL.sql https://dev-files-1253767413.cos.ap-guangzhou.myqcloud.com/temp/ORDERDETAIL2.sql 这2个是我同步的表及数

Re: [I] [SqlServer-CDC]当字段数量超过128,无法正常cdc [seatunnel]

2024-04-09 Thread via GitHub
bulolo commented on issue #6658: URL: https://github.com/apache/seatunnel/issues/6658#issuecomment-2044519566 https://dev-files-1253767413.cos.ap-guangzhou.myqcloud.com/temp/ORDERDETAIL.sql https://dev-files-1253767413.cos.ap-guangzhou.myqcloud.com/temp/ORDERDETAIL2.sql -- This is an

Re: [I] [SqlServer-CDC]当字段数量超过128,无法正常cdc [seatunnel]

2024-04-09 Thread via GitHub
bulolo commented on issue #6658: URL: https://github.com/apache/seatunnel/issues/6658#issuecomment-2044515569 > Provide the table‘s ddl 确保是多张表,字段超过128,就会报错,我是将字段慢慢缩减到128才发现的,128字段内,2个表正常同步 -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [I] [SqlServer-CDC]当字段数量超过128,无法正常cdc [seatunnel]

2024-04-09 Thread via GitHub
bulolo commented on issue #6658: URL: https://github.com/apache/seatunnel/issues/6658#issuecomment-2044512864 > Provide the table‘s ddl -- -- Table structure for ORDERDETAIL -- IF EXISTS (SELECT * FROM sys.all_objec

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557271892 ## docs/zh/connector-v2/sink/Jdbc.md: ## @@ -0,0 +1,354 @@ +# JDBC + +> JDBC 数据接收器 + +## 描述 + +通过jdbc写入数据。支持批处理模式和流处理模式,支持并发写入,支持精确一次语义(使用XA事务保证) + +## 使用依赖 + +### 用于Sp

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557267529 ## docs/zh/connector-v2/sink/Feishu.md: ## @@ -11,7 +11,7 @@ ## 主要特性 - [ ] [精确一次](../../../en/concept/connector-v2-features.md) Review Comment: ```suggestion

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557264785 ## docs/zh/connector-v2/sink/Elasticsearch.md: ## @@ -0,0 +1,218 @@ +# Elasticsearch + +## 描述 + +输出数据到 `Elasticsearch` + +## 主要特性 + +- [ ] [精确一次](../../concept/connecto

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557264465 ## docs/zh/connector-v2/sink/Elasticsearch.md: ## @@ -0,0 +1,218 @@ +# Elasticsearch + +## 描述 + +输出数据到 `Elasticsearch` + +## 主要特性 + +- [ ] [精确一次](../../concept/connecto

(seatunnel) branch dev updated: [Improve][Zeta]Optimize the logic of RestHttpGetCommandProcessor#getSeaTunnelServer() (#6666)

2024-04-09 Thread liugddx
This is an automated email from the ASF dual-hosted git repository. liugddx pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 66d8502da5 [Improve][Zeta]Optimize the logic of R

Re: [PR] [Improve][Zeta]Optimize the logic of RestHttpGetCommandProcessor#getSeaTunnelServer() [seatunnel]

2024-04-09 Thread via GitHub
liugddx merged PR #: URL: https://github.com/apache/seatunnel/pull/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557250046 ## docs/zh/connector-v2/formats/avro.md: ## @@ -0,0 +1,111 @@ +# Avro 格式 + +Avro是一种流行数据传输格式。现在seatunnel在kafka连接器中支持Avro格式 + +# 怎样用 + +## Kafka 使用示例 + +- 使用 Avro 格式从模拟数据

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557248504 ## docs/zh/connector-v2/formats/avro.md: ## @@ -0,0 +1,111 @@ +# Avro 格式 + +Avro是一种流行数据传输格式。现在seatunnel在kafka连接器中支持Avro格式 Review Comment: ```suggestion Avro 在流式数

[I] [Feature][Zeta Engine] Separate the responsibilities of Master and Worker to improve the stability of the cluster [seatunnel]

2024-04-09 Thread via GitHub
EricJoy2048 opened a new issue, #6672: URL: https://github.com/apache/seatunnel/issues/6672 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557180836 ## docs/zh/connector-v2/formats/debezium-json.md: ## @@ -0,0 +1,115 @@ +# Debezium 格式 + +变更数据捕获格式: +序列化模式、反序列化模式 + +Debezium 是一套分布式服务,用于捕获数据库中的变化,以便您的应用程序可以看到这些变化并对其做出响

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
corgy-w commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557179617 ## docs/zh/connector-v2/formats/ogg-json.md: ## @@ -0,0 +1,93 @@ +# Ogg 格式 + +[Oracle GoldenGate](https://www.oracle.com/integration/goldengate/) (a.k.a ogg) 是一项托管服

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557173857 ## docs/zh/connector-v2/formats/ogg-json.md: ## @@ -0,0 +1,93 @@ +# Ogg 格式 + +[Oracle GoldenGate](https://www.oracle.com/integration/goldengate/) (a.k.a ogg) 是一项托管服务,

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557170655 ## docs/zh/connector-v2/formats/ogg-json.md: ## @@ -0,0 +1,93 @@ +# Ogg 格式 + +[Oracle GoldenGate](https://www.oracle.com/integration/goldengate/) (a.k.a ogg) 是一项托管服务,

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557169086 ## docs/zh/connector-v2/formats/ogg-json.md: ## @@ -0,0 +1,93 @@ +# Ogg 格式 + +[Oracle GoldenGate](https://www.oracle.com/integration/goldengate/) (a.k.a ogg) 是一项托管服务,

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557168767 ## docs/zh/connector-v2/formats/ogg-json.md: ## @@ -0,0 +1,93 @@ +# Ogg 格式 + +[Oracle GoldenGate](https://www.oracle.com/integration/goldengate/) (a.k.a ogg) 是一项托管服务,

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557162862 ## docs/zh/connector-v2/formats/debezium-json.md: ## @@ -0,0 +1,115 @@ +# Debezium 格式 + +变更数据捕获格式: +序列化模式、反序列化模式 + +Debezium 是一套分布式服务,用于捕获数据库中的变化,以便您的应用程序可以看到这些变化并对其做出响

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557162432 ## docs/zh/connector-v2/formats/debezium-json.md: ## @@ -0,0 +1,115 @@ +# Debezium 格式 + +变更数据捕获格式: +序列化模式、反序列化模式 + +Debezium 是一套分布式服务,用于捕获数据库中的变化,以便您的应用程序可以看到这些变化并对其做出响

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557163435 ## docs/zh/connector-v2/formats/debezium-json.md: ## @@ -0,0 +1,115 @@ +# Debezium 格式 + +变更数据捕获格式: +序列化模式、反序列化模式 + +Debezium 是一套分布式服务,用于捕获数据库中的变化,以便您的应用程序可以看到这些变化并对其做出响

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557157509 ## docs/zh/connector-v2/formats/avro.md: ## @@ -0,0 +1,111 @@ +# Avro 格式 + +Avro是一种流行数据传输格式。现在seatunnel在kafka连接器中支持Avro格式 + +# 怎样用 + +## Kafka 使用示例 + +- 使用 avro 格式从模拟数据

Re: [PR] [Doc][Improve] Support chinese for sinks [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on code in PR #6663: URL: https://github.com/apache/seatunnel/pull/6663#discussion_r1557157081 ## docs/zh/connector-v2/formats/canal-json.md: ## @@ -0,0 +1,115 @@ +# Canal 格式 + +变更数据捕获格式: +序列化模式、反序列化模式 + +Canal是一款CDC(变更数据捕获)工具,能够实时捕获MySQL的数据变化并将其流式传输到其他系统中。Canal为

Re: [I] [Doc][Improve] support chinese [seatunnel]

2024-04-09 Thread via GitHub
xxzuo commented on issue #6378: URL: https://github.com/apache/seatunnel/issues/6378#issuecomment-2044372032 > > Please assign me connector-v2/formats/* , except for those already done. Thanks > > @xxzuo I also did this part, in the pr above :< just mentioned today. I think we need t

(seatunnel) branch dev updated: [Feature][Tool] Add connector check script for issue 6199 (#6635)

2024-04-09 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 65aedf6a79 [Feature][Tool] Add connector check

Re: [I] [Feature][Tool] Add connector check script [seatunnel]

2024-04-09 Thread via GitHub
hailin0 closed issue #6199: [Feature][Tool] Add connector check script URL: https://github.com/apache/seatunnel/issues/6199 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] [Feature][Tool] Add connector check script for issue 6199 [seatunnel]

2024-04-09 Thread via GitHub
hailin0 merged PR #6635: URL: https://github.com/apache/seatunnel/pull/6635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Feature][Tool] Add connector check script for issue 6199 [seatunnel]

2024-04-09 Thread via GitHub
hailin0 commented on code in PR #6635: URL: https://github.com/apache/seatunnel/pull/6635#discussion_r1557105364 ## seatunnel-e2e/seatunnel-core-e2e/seatunnel-starter-e2e/src/test/java/org/apache/seatunnel/core/starter/seatunnel/SeaTunnelConnectorTest.java: ## @@ -0,0 +1,301 @@

Re: [I] [OnlineMeeting&April.9]SeaTunnel community meeting Topic collect [seatunnel]

2024-04-09 Thread via GitHub
hailin0 commented on issue #6655: URL: https://github.com/apache/seatunnel/issues/6655#issuecomment-2044312494 > Please merge the two PRs: #5983 #5929 You can participate in review or help fix issues -- This is an automated message from the Apache Git Service. To respond to the mess

Re: [PR] [Feature][Tool] Add connector check script for issue 6199 [seatunnel]

2024-04-09 Thread via GitHub
dailai commented on code in PR #6635: URL: https://github.com/apache/seatunnel/pull/6635#discussion_r1557051881 ## seatunnel-e2e/seatunnel-core-e2e/seatunnel-starter-e2e/src/test/java/org/apache/seatunnel/core/starter/seatunnel/SeaTunnelConnectorTest.java: ## @@ -0,0 +1,301 @@ +

Re: [PR] [Feature] Hive Source/Sink support multiple table [seatunnel]

2024-04-09 Thread via GitHub
hailin0 commented on PR #5929: URL: https://github.com/apache/seatunnel/pull/5929#issuecomment-2044309078 Please add test case -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[I] [Bug] [connector-rabbitmq] failed to write record into target database [seatunnel]

2024-04-09 Thread via GitHub
alextinng opened a new issue, #6671: URL: https://github.com/apache/seatunnel/issues/6671 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] [Doc][Improve] support chinese [seatunnel]

2024-04-09 Thread via GitHub
corgy-w commented on issue #6378: URL: https://github.com/apache/seatunnel/issues/6378#issuecomment-2044292005 > Please assign me connector-v2/formats/* , except for those already done. Thanks @xxzuo I also did this part, in the pr above :< just mentioned today. I think we need to di

Re: [PR] [Feature][Tool] Add connector check script for issue 6199 [seatunnel]

2024-04-09 Thread via GitHub
dailai commented on code in PR #6635: URL: https://github.com/apache/seatunnel/pull/6635#discussion_r1557051881 ## seatunnel-e2e/seatunnel-core-e2e/seatunnel-starter-e2e/src/test/java/org/apache/seatunnel/core/starter/seatunnel/SeaTunnelConnectorTest.java: ## @@ -0,0 +1,301 @@ +

Re: [PR] [Feature][Tool] Add connector check script for issue 6199 [seatunnel]

2024-04-09 Thread via GitHub
hailin0 commented on code in PR #6635: URL: https://github.com/apache/seatunnel/pull/6635#discussion_r1557045543 ## seatunnel-e2e/seatunnel-core-e2e/seatunnel-starter-e2e/src/test/java/org/apache/seatunnel/core/starter/seatunnel/SeaTunnelConnectorTest.java: ## @@ -0,0 +1,301 @@

Re: [I] [OnlineMeeting&April.9]SeaTunnel community meeting Topic collect [seatunnel]

2024-04-09 Thread via GitHub
kissycn commented on issue #6655: URL: https://github.com/apache/seatunnel/issues/6655#issuecomment-2044278462 Please merge the two PRs: #5983 #5929 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[I] [Improve][Zeta] Does not save checkpoint file when job finished. [seatunnel]

2024-04-09 Thread via GitHub
Hisoka-X opened a new issue, #6670: URL: https://github.com/apache/seatunnel/issues/6670 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.