[GitHub] [incubator-seatunnel] hailin0 commented on pull request #3742: [Improve][Connector-V2][Kafka] Support extract topic from SeaTunnelRow field

hailin0 commented on PR #3742: URL: https://github.com/apache/incubator-seatunnel/pull/3742#issuecomment-1356077729 > > Add e2e testcase > > Writing e2e test for this feature is not easy because the kafka sink connector send records without callback function, so I took a screenshot t

[incubator-seatunnel] branch dev updated: [hotfix][connector-v2][elasticsearch] Fix bulk refresh operation not locked (#3738)

This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new b6cab90d2 [hotfix][connector-v2][elas

[GitHub] [incubator-seatunnel] hailin0 merged pull request #3738: [hotfix][connector-v2][elasticsearch] Fix bulk refresh operation not locked

hailin0 merged PR #3738: URL: https://github.com/apache/incubator-seatunnel/pull/3738 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[GitHub] [incubator-seatunnel] TaoZex commented on a diff in pull request #3742: [Improve][Connector-V2][Kafka] Support extract topic from SeaTunnelRow field

TaoZex commented on code in PR #3742: URL: https://github.com/apache/incubator-seatunnel/pull/3742#discussion_r1051318828 ## docs/en/connector-v2/sink/Kafka.md: ## @@ -33,6 +33,12 @@ By default, we will use 2pc to guarantee the message is sent to kafka exactly on Kafka Topi

[GitHub] [incubator-seatunnel] TaoZex commented on pull request #3742: [Improve][Connector-V2][Kafka] Support extract topic from SeaTunnelRow field

TaoZex commented on PR #3742: URL: https://github.com/apache/incubator-seatunnel/pull/3742#issuecomment-1356046589 > Add e2e testcase Writing e2e test for this feature is not easy because the kafka sink connector send records without callback function, so I took a screenshot to prov

[GitHub] [incubator-seatunnel] TaoZex closed issue #3138: [Improve][Connector-V2-kafka] Support more formats for message(json、csv、...)

TaoZex closed issue #3138: [Improve][Connector-V2-kafka] Support more formats for message(json、csv、...) URL: https://github.com/apache/incubator-seatunnel/issues/3138 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [incubator-seatunnel] TaoZex commented on issue #3138: [Improve][Connector-V2-kafka] Support more formats for message(json、csv、...)

TaoZex commented on issue #3138: URL: https://github.com/apache/incubator-seatunnel/issues/3138#issuecomment-1356037911 Closed by https://github.com/apache/incubator-seatunnel/pull/3711 -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #3742: [Improve][Connector-V2][Kafka] Support extract topic from SeaTunnelRow field

hailin0 commented on code in PR #3742: URL: https://github.com/apache/incubator-seatunnel/pull/3742#discussion_r1051310096 ## docs/en/connector-v2/sink/Kafka.md: ## @@ -33,6 +33,12 @@ By default, we will use 2pc to guarantee the message is sent to kafka exactly on Kafka Top

[GitHub] [incubator-seatunnel] 521daichen opened a new issue, #3748: [Bug] [Module Name] Bug title

521daichen opened a new issue, #3748: URL: https://github.com/apache/incubator-seatunnel/issues/3748 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.

[GitHub] [incubator-seatunnel] 521daichen opened a new issue, #3747: [Bug] [UDF] Seatunnel 2.3.0-beta version, does v2 not support udf?

521daichen opened a new issue, #3747: URL: https://github.com/apache/incubator-seatunnel/issues/3747 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.

[GitHub] [incubator-seatunnel] Grypse commented on issue #3729: [Feature][SeaTunnel-engine][checkpoint-storage] add oss support for checkpoint storage

Grypse commented on issue #3729: URL: https://github.com/apache/incubator-seatunnel/issues/3729#issuecomment-1356013296 https://github.com/apache/incubator-seatunnel/pull/3732 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [incubator-seatunnel] Grypse commented on issue #3729: [Feature][SeaTunnel-engine][checkpoint-storage] add oss support for checkpoint storage

Grypse commented on issue #3729: URL: https://github.com/apache/incubator-seatunnel/issues/3729#issuecomment-1356012691 @hailin0 The PR of this issue has been created, Please help me to review. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #3745: [Improve][Connector-V2]console sink output content to slf4j log

hailin0 commented on code in PR #3745: URL: https://github.com/apache/incubator-seatunnel/pull/3745#discussion_r1051302971 ## seatunnel-connectors-v2/connector-console/src/main/java/org/apache/seatunnel/connectors/seatunnel/console/sink/ConsoleSinkWriter.java: ## @@ -53,7 +55,7

[GitHub] [incubator-seatunnel] hailin0 commented on pull request #3745: [Improve][Connector-V2]console sink output content to slf4j log

hailin0 commented on PR #3745: URL: https://github.com/apache/incubator-seatunnel/pull/3745#issuecomment-1355993141 Please check ci error -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [incubator-seatunnel] hailin0 commented on issue #3744: [Bug] [Seatunnel-dist] cannot load sql transform plugin

hailin0 commented on issue #3744: URL: https://github.com/apache/incubator-seatunnel/issues/3744#issuecomment-1355988455 https://github.com/apache/incubator-seatunnel/issues/3178 transform-v2 currently unsupported sql transform -- This is an automated message from the Apache Git Se

[GitHub] [incubator-seatunnel] hailin0 commented on issue #3737: [Improve][Connector-V2][Console] Improve console connector sink output format

hailin0 commented on issue #3737: URL: https://github.com/apache/incubator-seatunnel/issues/3737#issuecomment-1355986833 > Please assign this to me! Assigned -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [incubator-seatunnel] TaoZex commented on issue #3743: [Feature][connector][kafka] Support read cdc format message from kafka

TaoZex commented on issue #3743: URL: https://github.com/apache/incubator-seatunnel/issues/3743#issuecomment-1355973768 I want to try support read debezium format message from kafka. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2960: [Improve][Connector-V2-kafka] Support read message metadata(key、timestamp、headers)

github-actions[bot] commented on issue #2960: URL: https://github.com/apache/incubator-seatunnel/issues/2960#issuecomment-1355864622 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3268: [Feature][starter][spark] Support transform-v2 for spark

github-actions[bot] commented on issue #3268: URL: https://github.com/apache/incubator-seatunnel/issues/3268#issuecomment-1355864604 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. --

[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #3268: [Feature][starter][spark] Support transform-v2 for spark

github-actions[bot] closed issue #3268: [Feature][starter][spark] Support transform-v2 for spark URL: https://github.com/apache/incubator-seatunnel/issues/3268 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-seatunnel] Grypse opened a new pull request, #3745: [Improve][Connector-V2]console sink output content to slf4j log

Grypse opened a new pull request, #3745: URL: https://github.com/apache/incubator-seatunnel/pull/3745 ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary package adding in your PR, please add License Notice acc

[GitHub] [incubator-seatunnel] TaoZex commented on pull request #3742: [Improve][Connector-V2][Kafka] Support extract topic from SeaTunnelRow field

TaoZex commented on PR #3742: URL: https://github.com/apache/incubator-seatunnel/pull/3742#issuecomment-1355095881 Writing e2e test for this feature is not easy because the kafka sink connector send records without callback function, so I took a screenshot to prove that the feature is avai

[GitHub] [incubator-seatunnel] TyrantLucifer commented on a diff in pull request #3696: [Doc][Improve] improve pom

TyrantLucifer commented on code in PR #3696: URL: https://github.com/apache/incubator-seatunnel/pull/3696#discussion_r1050797260 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/sink/writer/AbstractWriteStrategy.

[GitHub] [incubator-seatunnel] Grypse opened a new issue, #3744: [Bug] [Seatunnel-dist] cannot load sql transform plugin

Grypse opened a new issue, #3744: URL: https://github.com/apache/incubator-seatunnel/issues/3744 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.

[GitHub] [incubator-seatunnel] Grypse commented on issue #3737: [Improve][Connector-V2][Console] Improve console connector sink output format

Grypse commented on issue #3737: URL: https://github.com/apache/incubator-seatunnel/issues/3737#issuecomment-1354758353 Please assign this to me! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [incubator-seatunnel] sonarcloud[bot] commented on pull request #3740: [hotfix][ST-Engine] fix job restart of all node down

sonarcloud[bot] commented on PR #3740: URL: https://github.com/apache/incubator-seatunnel/pull/3740#issuecomment-1354701061 Kudos, SonarCloud Quality Gate passed!    [![Quality Gate passed](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/QualityGateBadge/passed-16

[GitHub] [incubator-seatunnel] hailin0 opened a new issue, #3743: [Feature][connector][kafka] Support read cdc format message from kafka

hailin0 opened a new issue, #3743: URL: https://github.com/apache/incubator-seatunnel/issues/3743 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requi

[GitHub] [incubator-seatunnel] TaoZex opened a new pull request, #3742: [Improve][Connector-V2][Kafka] Support extract topic from SeaTunnelRow field

TaoZex opened a new pull request, #3742: URL: https://github.com/apache/incubator-seatunnel/pull/3742 ## Purpose of this pull request Support extract topic from SeaTunnelRow field ## Check list * [ ] Code changed are covered with tests, or it does not need tes

[GitHub] [incubator-seatunnel] hailin0 commented on issue #3700: [Feature][cdc] Support read dameng database binlog

hailin0 commented on issue #3700: URL: https://github.com/apache/incubator-seatunnel/issues/3700#issuecomment-1354671093 reference log miner https://eco.dameng.com/document/dm/zh-cn/pm/dbms_logmnr-package.html -- This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-seatunnel] hailin0 commented on issue #3726: [Feature][connector][doris] Support write cdc changelog event in doris sink

hailin0 commented on issue #3726: URL: https://github.com/apache/incubator-seatunnel/issues/3726#issuecomment-1354668853 reference https://doris.apache.org/docs/dev/data-operate/import/import-way/stream-load-manual -- This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-seatunnel] hailin0 opened a new issue, #3741: [Improve][Connector][Doris] Improve doris connector sink

hailin0 opened a new issue, #3741: URL: https://github.com/apache/incubator-seatunnel/issues/3741 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requi

[GitHub] [incubator-seatunnel] ic4y opened a new pull request, #3740: [hotfix][ST-Engine] fix job restart of all node down

ic4y opened a new pull request, #3740: URL: https://github.com/apache/incubator-seatunnel/pull/3740 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary pack

[incubator-seatunnel] 01/01: [hotfix][ST-Engine] fix job restart of all node down

This is an automated email from the ASF dual-hosted git repository. ic4y pushed a commit to branch dev_jobrestart in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git commit c13d2704f14bd8510f6042c2c7cdeae0847aa2c3 Author: liuli AuthorDate: Fri Dec 16 19:53:19 2022 +0800

[incubator-seatunnel] branch dev_jobrestart created (now c13d2704f)

This is an automated email from the ASF dual-hosted git repository. ic4y pushed a change to branch dev_jobrestart in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git at c13d2704f [hotfix][ST-Engine] fix job restart of all node down This branch includes the following

[GitHub] [incubator-seatunnel] TaoZex commented on a diff in pull request #3696: [Doc][Improve] improve pom

TaoZex commented on code in PR #3696: URL: https://github.com/apache/incubator-seatunnel/pull/3696#discussion_r1050627166 ## docs/en/seatunnel-engine/cluster-mode.md: ## @@ -1,6 +1,24 @@ --- -sidebar_position: 4 +sidebar_position: 3 --- # Run Job With Cluster Mode +This

[GitHub] [incubator-seatunnel] TaoZex closed pull request #3147: [Feature][Connector-V2] Support extract topic from SeaTunnelRow fields

TaoZex closed pull request #3147: [Feature][Connector-V2] Support extract topic from SeaTunnelRow fields URL: https://github.com/apache/incubator-seatunnel/pull/3147 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [incubator-seatunnel] TyrantLucifer commented on pull request #3637: [Feature][ST-Engine] Support engine restart job information will not be lost

TyrantLucifer commented on PR #3637: URL: https://github.com/apache/incubator-seatunnel/pull/3637#issuecomment-1354502821 > LGTM CI had not been passed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [incubator-seatunnel] EricJoy2048 commented on a diff in pull request #3637: [Feature][ST-Engine] Support engine restart job information will not be lost

EricJoy2048 commented on code in PR #3637: URL: https://github.com/apache/incubator-seatunnel/pull/3637#discussion_r1050571583 ## seatunnel-e2e/seatunnel-engine-e2e/connector-seatunnel-e2e-base/src/test/java/org/apache/seatunnel/engine/e2e/ClusterFaultToleranceIT.java: ## @@ -6

[GitHub] [incubator-seatunnel] liugddx commented on pull request #3637: [Feature][ST-Engine] Support engine restart job information will not be lost

liugddx commented on PR #3637: URL: https://github.com/apache/incubator-seatunnel/pull/3637#issuecomment-1354478105 @CalvinKirs PTAL,thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [incubator-seatunnel] liugddx commented on a diff in pull request #3637: [Feature][ST-Engine] Support engine restart job information will not be lost

liugddx commented on code in PR #3637: URL: https://github.com/apache/incubator-seatunnel/pull/3637#discussion_r1050553633 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/persistence/FileMapStoreFactory.java: ## @@ -0,0 +1,31 @@ +/*

[GitHub] [incubator-seatunnel] EricJoy2048 commented on a diff in pull request #3637: [Feature][ST-Engine] Support engine restart job information will not be lost

EricJoy2048 commented on code in PR #3637: URL: https://github.com/apache/incubator-seatunnel/pull/3637#discussion_r1050548745 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/persistence/FileMapStoreFactory.java: ## @@ -0,0 +1,31 @@