[GitHub] [seatunnel] MonsterChenzhuo opened a new pull request, #5143: [WIP][TEST] Locate the problem of e2e instability

2023-07-24 Thread via GitHub
MonsterChenzhuo opened a new pull request, #5143: URL: https://github.com/apache/seatunnel/pull/5143 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary pac

[GitHub] [seatunnel] hailin0 commented on pull request #5045: [Improve][Connector[File] Optimize files commit order

2023-07-24 Thread via GitHub
hailin0 commented on PR #5045: URL: https://github.com/apache/seatunnel/pull/5045#issuecomment-1647365304 @EricJoy2048 @Hisoka-X @ic4y PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [seatunnel] hailin0 merged pull request #5045: [Improve][Connector[File] Optimize files commit order

2023-07-24 Thread via GitHub
hailin0 merged PR #5045: URL: https://github.com/apache/seatunnel/pull/5045 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

[seatunnel] branch dev updated: [Improve][Connector[File] Optimize files commit order (#5045)

2023-07-24 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 1e18a8c530 [Improve][Connector[File] Optimize f

[GitHub] [seatunnel] hailin0 opened a new issue, #3743: [Feature][connector][kafka] Support read `debezium` format message from kafka

2023-07-24 Thread via GitHub
hailin0 opened a new issue, #3743: URL: https://github.com/apache/seatunnel/issues/3743 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

[GitHub] [seatunnel] 15767714253 opened a new issue, #5144: [Feature][Web] support seatunnel on k8s

2023-07-24 Thread via GitHub
15767714253 opened a new issue, #5144: URL: https://github.com/apache/seatunnel/issues/5144 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

[GitHub] [seatunnel-web] zhangchengming601 opened a new pull request, #92: [IMPROVE] Add plugin isolation function

2023-07-24 Thread via GitHub
zhangchengming601 opened a new pull request, #92: URL: https://github.com/apache/seatunnel-web/pull/92 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary p

[GitHub] [seatunnel] SharkAndCat opened a new issue, #5145: impala connector

2023-07-24 Thread via GitHub
SharkAndCat opened a new issue, #5145: URL: https://github.com/apache/seatunnel/issues/5145 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

[GitHub] [seatunnel] EricJoy2048 commented on a diff in pull request #5086: [Feature-WIP][Connector-V2][Doris] Add Doris ConnectorV2 Source

2023-07-24 Thread via GitHub
EricJoy2048 commented on code in PR #5086: URL: https://github.com/apache/seatunnel/pull/5086#discussion_r1272032391 ## seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/rest/RestService.java: ## @@ -524,7 +531,7 @@ public static List f

[GitHub] [seatunnel] lightzhao commented on pull request #4382: [Feature][Connector-v2][PulsarSink]Add Pulsar Sink Connector.

2023-07-24 Thread via GitHub
lightzhao commented on PR #4382: URL: https://github.com/apache/seatunnel/pull/4382#issuecomment-1647686975 It's been a long time, @TyrantLucifer @hailin0 @EricJoy2048 @Hisoka-X PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [seatunnel] bingquanzhao commented on a diff in pull request #5086: [Feature-WIP][Connector-V2][Doris] Add Doris ConnectorV2 Source

2023-07-24 Thread via GitHub
bingquanzhao commented on code in PR #5086: URL: https://github.com/apache/seatunnel/pull/5086#discussion_r1272117581 ## docs/en/connector-v2/source/Doris.md: ## @@ -0,0 +1,121 @@ +# Doris + +> Doris source connector + +## Description + +Used to read data from Doris. + +## Key f

[GitHub] [seatunnel] hailin0 commented on pull request #5066: [Feature][connector][kafka] Support read debezium format message from kafka

2023-07-24 Thread via GitHub
hailin0 commented on PR #5066: URL: https://github.com/apache/seatunnel/pull/5066#issuecomment-1647740389 good pr -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[GitHub] [seatunnel] jackyyyyyssss commented on a diff in pull request #5097: [Improve][Connector-v2][Jdbc] check url not null throw friendly message

2023-07-24 Thread via GitHub
jacky commented on code in PR #5097: URL: https://github.com/apache/seatunnel/pull/5097#discussion_r1272165143 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/source/JdbcSource.java: ## @@ -93,6 +98,19 @@ public Stri

[GitHub] [seatunnel] liugddx opened a new pull request, #5146: [Bugfix][AmazonDynamoDB] Fix the problem that all table data cannot be obtained

2023-07-24 Thread via GitHub
liugddx opened a new pull request, #5146: URL: https://github.com/apache/seatunnel/pull/5146 close #5124 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar bi

[GitHub] [seatunnel] ic4y opened a new pull request, #5147: [Feature][CDC base] Support string type shard fields.

2023-07-24 Thread via GitHub
ic4y opened a new pull request, #5147: URL: https://github.com/apache/seatunnel/pull/5147 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary package adding

[GitHub] [seatunnel] ic4y commented on pull request #5123: [Feature][Iceberg Sink] Add iceberg sink connector

2023-07-24 Thread via GitHub
ic4y commented on PR #5123: URL: https://github.com/apache/seatunnel/pull/5123#issuecomment-1647924622 > Repeated with #5072 The feature gap between the two pull requests is quite significant, it may take some time to discuss how to merge them. I'm also currently implementing save mo

[GitHub] [seatunnel] github-actions[bot] closed issue #4913: kafka-source 接入的数据格式是xml类型,应该如何配置能解析成表做处理

2023-07-24 Thread via GitHub
github-actions[bot] closed issue #4913: kafka-source 接入的数据格式是xml类型,应该如何配置能解析成表做处理 URL: https://github.com/apache/seatunnel/issues/4913 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [seatunnel] github-actions[bot] closed issue #4605: [Feature][CDC] Support flink running cdc job

2023-07-24 Thread via GitHub
github-actions[bot] closed issue #4605: [Feature][CDC] Support flink running cdc job URL: https://github.com/apache/seatunnel/issues/4605 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [seatunnel] github-actions[bot] commented on issue #4913: kafka-source 接入的数据格式是xml类型,应该如何配置能解析成表做处理

2023-07-24 Thread via GitHub
github-actions[bot] commented on issue #4913: URL: https://github.com/apache/seatunnel/issues/4913#issuecomment-1648794303 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

[GitHub] [seatunnel] github-actions[bot] commented on issue #4587: [Feature][Core] Design of Dirty Data Collection

2023-07-24 Thread via GitHub
github-actions[bot] commented on issue #4587: URL: https://github.com/apache/seatunnel/issues/4587#issuecomment-1648794339 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

[GitHub] [seatunnel] chaorongzhi opened a new pull request, #5148: [Fix][Zeta] Resolve out-of-heap memory overflow

2023-07-24 Thread via GitHub
chaorongzhi opened a new pull request, #5148: URL: https://github.com/apache/seatunnel/pull/5148 ## Purpose of this pull request I will run about 15 batch synchronization tasks per minute. When I add MaxMetaspaceSize = 2g in jvm_options, OOM will appear after about 1.5 hours

[GitHub] [seatunnel] Hisoka-X merged pull request #5143: [Hotfix][Mongodb cdc] Solve startup resume token is negative

2023-07-24 Thread via GitHub
Hisoka-X merged PR #5143: URL: https://github.com/apache/seatunnel/pull/5143 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

[seatunnel] branch dev updated: [Hotfix][Mongodb cdc] Solve startup resume token is negative (#5143)

2023-07-24 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new e964c03dca [Hotfix][Mongodb cdc] Solve startup resu

[GitHub] [seatunnel] EricJoy2048 merged pull request #5066: [Feature][connector][kafka] Support read debezium format message from kafka

2023-07-24 Thread via GitHub
EricJoy2048 merged PR #5066: URL: https://github.com/apache/seatunnel/pull/5066 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seat

[seatunnel] branch dev updated: [Feature][connector][kafka] Support read debezium format message from kafka (#5066)

2023-07-24 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 53a1f0c6c1 [Feature][connector][kafka] Support

[GitHub] [seatunnel] suyonggong opened a new issue, #5149: how to stop the mysql_cdc task

2023-07-24 Thread via GitHub
suyonggong opened a new issue, #5149: URL: https://github.com/apache/seatunnel/issues/5149 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

[GitHub] [seatunnel] bingquanzhao commented on a diff in pull request #5086: [Feature-WIP][Connector-V2][Doris] Add Doris ConnectorV2 Source

2023-07-24 Thread via GitHub
bingquanzhao commented on code in PR #5086: URL: https://github.com/apache/seatunnel/pull/5086#discussion_r1272925705 ## seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/rest/RestService.java: ## @@ -524,7 +531,7 @@ public static List

[GitHub] [seatunnel] EricJoy2048 commented on pull request #5101: [Doc] Improve S3File Source & S3File Sink document

2023-07-24 Thread via GitHub
EricJoy2048 commented on PR #5101: URL: https://github.com/apache/seatunnel/pull/5101#issuecomment-1648925829 > LGTM It would be better to fix these typos. Thanks, I finished it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [seatunnel] hailin0 commented on pull request #4516: [Feature][Connector-V2] connector-kafka source support data conversion extracted by kafka connect source

2023-07-24 Thread via GitHub
hailin0 commented on PR #4516: URL: https://github.com/apache/seatunnel/pull/4516#issuecomment-1648958563 @sunxiaojian please resolve the conflict -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [seatunnel] hailin0 commented on pull request #3981: [Feature][connector][kafka] Support read debezium format message from kafka

2023-07-24 Thread via GitHub
hailin0 commented on PR #3981: URL: https://github.com/apache/seatunnel/pull/3981#issuecomment-1648960791 Sorry, this PR has been merged https://github.com/apache/seatunnel/pull/5066 -- This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [seatunnel] TaoZex closed pull request #3981: [Feature][connector][kafka] Support read debezium format message from kafka

2023-07-24 Thread via GitHub
TaoZex closed pull request #3981: [Feature][connector][kafka] Support read debezium format message from kafka URL: https://github.com/apache/seatunnel/pull/3981 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [seatunnel] hailin0 opened a new pull request, #5150: [Feature][CDC] Support tables without primary keys (with unique keys)…

2023-07-24 Thread via GitHub
hailin0 opened a new pull request, #5150: URL: https://github.com/apache/seatunnel/pull/5150 … (#163) ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar bi

[GitHub] [seatunnel] hailin0 commented on pull request #5150: [Feature][CDC] Support tables without primary keys (with unique keys)

2023-07-24 Thread via GitHub
hailin0 commented on PR #5150: URL: https://github.com/apache/seatunnel/pull/5150#issuecomment-1648981927 PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

[GitHub] [seatunnel] Hisoka-X commented on pull request #4778: [Improve][Docs][Kafka]Reconstruct the kafka connector document

2023-07-24 Thread via GitHub
Hisoka-X commented on PR #4778: URL: https://github.com/apache/seatunnel/pull/4778#issuecomment-1649194711 Hi, please resolve conflict, thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [seatunnel] Hisoka-X commented on pull request #5118: [Bug][Improve][LocalFileSink]Fix LocalFile Sink file_format_type.

2023-07-24 Thread via GitHub
Hisoka-X commented on PR #5118: URL: https://github.com/apache/seatunnel/pull/5118#issuecomment-1649197990 Over LGTM, maybe you should take a look @TyrantLucifer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL