[incubator-seatunnel] branch dev updated (0f0afb58a -> 5a024bdf8)

2022-12-21 Thread liugddx
This is an automated email from the ASF dual-hosted git repository. liugddx pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from 0f0afb58a [feature][connector-v2] add sqlServer CDC (#3686) add 5a024bdf8 [Feature][Shade] Add seatunn

[GitHub] [incubator-seatunnel] liugddx merged pull request #3755: [Feature][Shade] Add seatunnel hadoop3 uber

2022-12-21 Thread GitBox
liugddx merged PR #3755: URL: https://github.com/apache/incubator-seatunnel/pull/3755 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[GitHub] [incubator-seatunnel] EricJoy2048 commented on a diff in pull request #3755: [Feature][Shade] Add seatunnel hadoop3 uber

2022-12-21 Thread GitBox
EricJoy2048 commented on code in PR #3755: URL: https://github.com/apache/incubator-seatunnel/pull/3755#discussion_r1055172519 ## seatunnel-engine/seatunnel-engine-storage/checkpoint-storage-plugins/checkpoint-storage-hdfs/pom.xml: ## @@ -31,16 +31,11 @@ checkpoint-storage

[GitHub] [incubator-seatunnel] ic4y commented on issue #3754: [Umbrella][Improve][Connector] Provide test cases for `exactly-once`.

2022-12-21 Thread GitBox
ic4y commented on issue #3754: URL: https://github.com/apache/incubator-seatunnel/issues/3754#issuecomment-1362495511 SavePoint is supported in #3779, I think it is more appropriate to use savePoint to stop the job and restore with savepoint it to test exactly-once -- This is an automate

[incubator-seatunnel] branch dev updated (40c5d0079 -> 0f0afb58a)

2022-12-21 Thread ic4y
This is an automated email from the ASF dual-hosted git repository. ic4y pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from 40c5d0079 [Hotfix] [Engine] Fix Checkpoint failed reason can't be found. (#3769) add 0f0afb58a [feature]

[GitHub] [incubator-seatunnel] ic4y merged pull request #3686: [feature][connector-v2] add sqlServer CDC

2022-12-21 Thread GitBox
ic4y merged PR #3686: URL: https://github.com/apache/incubator-seatunnel/pull/3686 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@s

[incubator-seatunnel] branch 2.3.0-release updated (28cfaae4f -> e366002bc)

2022-12-21 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a change to branch 2.3.0-release in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git discard 28cfaae4f [Release][2.3.0][release-note] Add 2.3.0 release-note add 40c5d0079 [Hotfix]

[incubator-seatunnel] 01/01: [Release][2.3.0][release-note] Add 2.3.0 release-note

2022-12-21 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a commit to branch 2.3.0-release in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git commit e366002bc74089a9e873f70fb0a3f5e428a07cbd Author: tyrantlucifer AuthorDate: Mon Dec 19 20:22:0

[incubator-seatunnel] branch dev updated: [Hotfix] [Engine] Fix Checkpoint failed reason can't be found. (#3769)

2022-12-21 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 40c5d0079 [Hotfix] [Engine] Fix Ch

[GitHub] [incubator-seatunnel] TyrantLucifer merged pull request #3769: [Improve] [Engine] Fix Checkpoint failed reason can't be found.

2022-12-21 Thread GitBox
TyrantLucifer merged PR #3769: URL: https://github.com/apache/incubator-seatunnel/pull/3769 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[GitHub] [incubator-seatunnel] Hisoka-X commented on a diff in pull request #3734: [Improve][Connector-V2][File] Speed up more than 2x for writing orc file.

2022-12-21 Thread GitBox
Hisoka-X commented on code in PR #3734: URL: https://github.com/apache/incubator-seatunnel/pull/3734#discussion_r1055111378 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/sink/writer/AbstractWriteStrategy.java:

[GitHub] [incubator-seatunnel] Hisoka-X commented on a diff in pull request #3734: [Improve][Connector-V2][File] Speed up more than 2x for writing orc file.

2022-12-21 Thread GitBox
Hisoka-X commented on code in PR #3734: URL: https://github.com/apache/incubator-seatunnel/pull/3734#discussion_r1055105668 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/sink/writer/AbstractWriteStrategy.java:

[GitHub] [incubator-seatunnel] Hisoka-X commented on pull request #3716: [fix][seatunnel 2.1.0]: ⬆️ elasticsearch-spark.version 6.8.3 -> 7.0.0

2022-12-21 Thread GitBox
Hisoka-X commented on PR #3716: URL: https://github.com/apache/incubator-seatunnel/pull/3716#issuecomment-1362384851 Hi, 2.1.0 already release long time. We will not update the code for branch 2.1.0. But, thanks for your contribute. -- This is an automated message from the Apache Git Ser

[GitHub] [incubator-seatunnel] Hisoka-X closed pull request #3716: [fix][seatunnel 2.1.0]: ⬆️ elasticsearch-spark.version 6.8.3 -> 7.0.0

2022-12-21 Thread GitBox
Hisoka-X closed pull request #3716: [fix][seatunnel 2.1.0]: ⬆️ elasticsearch-spark.version 6.8.3 -> 7.0.0 URL: https://github.com/apache/incubator-seatunnel/pull/3716 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [incubator-seatunnel] liugddx commented on pull request #3732: [Feature][seatunnel-engine][checkpoint-storage]add oss support for checkpoint storing.

2022-12-21 Thread GitBox
liugddx commented on PR #3732: URL: https://github.com/apache/incubator-seatunnel/pull/3732#issuecomment-1362381675 @TyrantLucifer PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [incubator-seatunnel] Hisoka-X closed issue #1191: [Feature][flink] flink source, sink supports parallelism parameters

2022-12-21 Thread GitBox
Hisoka-X closed issue #1191: [Feature][flink] flink source, sink supports parallelism parameters URL: https://github.com/apache/incubator-seatunnel/issues/1191 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-seatunnel] Hisoka-X commented on issue #1191: [Feature][flink] flink source, sink supports parallelism parameters

2022-12-21 Thread GitBox
Hisoka-X commented on issue #1191: URL: https://github.com/apache/incubator-seatunnel/issues/1191#issuecomment-1362373654 Already Done. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [incubator-seatunnel] Hisoka-X closed issue #1605: [Feature][Connector] Add Clickhouse sink split mode exactly once support

2022-12-21 Thread GitBox
Hisoka-X closed issue #1605: [Feature][Connector] Add Clickhouse sink split mode exactly once support URL: https://github.com/apache/incubator-seatunnel/issues/1605 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [incubator-seatunnel] Hisoka-X commented on issue #1605: [Feature][Connector] Add Clickhouse sink split mode exactly once support

2022-12-21 Thread GitBox
Hisoka-X commented on issue #1605: URL: https://github.com/apache/incubator-seatunnel/issues/1605#issuecomment-1362372761 No longer support v1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [incubator-seatunnel] Hisoka-X commented on issue #3712: [Bug] [Connector-V2] [Clickhouse-Sink] sink to clickhouse cluster error

2022-12-21 Thread GitBox
Hisoka-X commented on issue #3712: URL: https://github.com/apache/incubator-seatunnel/issues/3712#issuecomment-1362371137 Any update? @john8628 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [incubator-seatunnel] chaorongzhi commented on issue #3785: [Bug] [connectors-kafka] Base on SeaTunnel Engine Local Mode, kafka source is not working well

2022-12-21 Thread GitBox
chaorongzhi commented on issue #3785: URL: https://github.com/apache/incubator-seatunnel/issues/3785#issuecomment-1362369586 > These some bug with local mode, I will fix this. You can try use cluster mode. It work fine. ok, I will try it. -- This is an automated message from the A

[GitHub] [incubator-seatunnel] Hisoka-X commented on issue #3785: [Bug] [connectors-kafka] Base on SeaTunnel Engine Local Mode, kafka source is not working well

2022-12-21 Thread GitBox
Hisoka-X commented on issue #3785: URL: https://github.com/apache/incubator-seatunnel/issues/3785#issuecomment-1362368182 These some bug with local mode, I will fix this. You can try use cluster mode. It work fine. -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [incubator-seatunnel] chaorongzhi opened a new issue, #3785: [Bug] [connectors-kafka] Base on SeaTunnel Engine Local Mode, kafka source is not working well

2022-12-21 Thread GitBox
chaorongzhi opened a new issue, #3785: URL: https://github.com/apache/incubator-seatunnel/issues/3785 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.

[GitHub] [incubator-seatunnel] ic4y opened a new pull request, #3784: [Improve][ST-Engine] Improve job restart of all node down

2022-12-21 Thread GitBox
ic4y opened a new pull request, #3784: URL: https://github.com/apache/incubator-seatunnel/pull/3784 ## Purpose of this pull request ## Check list * [x] Code changed are covered with tests, or it does not need tests for reason: * [x] If any new Jar binary pack

[GitHub] [incubator-seatunnel] Hisoka-X commented on pull request #3676: [Feature][Engine Starter] update SeaTunnel Starter and change -e to -m

2022-12-21 Thread GitBox
Hisoka-X commented on PR #3676: URL: https://github.com/apache/incubator-seatunnel/pull/3676#issuecomment-1362358561 @FWLamb Hi, Please fix ci problem. Thanks ![image](https://user-images.githubusercontent.com/32387433/209048339-2d11d7e9-aa74-4240-93d0-0656ad455fee.png) -- This is

[GitHub] [incubator-seatunnel] ic4y closed pull request #3740: [hotfix][ST-Engine] fix job restart of all node down

2022-12-21 Thread GitBox
ic4y closed pull request #3740: [hotfix][ST-Engine] fix job restart of all node down URL: https://github.com/apache/incubator-seatunnel/pull/3740 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [incubator-seatunnel] Hisoka-X commented on a diff in pull request #3782: [Improve] [Connector-V2] File Connector add lzo compression way.

2022-12-21 Thread GitBox
Hisoka-X commented on code in PR #3782: URL: https://github.com/apache/incubator-seatunnel/pull/3782#discussion_r1055046802 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/config/BaseFileSinkConfig.java: ###

[GitHub] [incubator-seatunnel] Hisoka-X commented on a diff in pull request #3783: [Improve] [Connector-V2] Kafka client user configured clientid is preferred

2022-12-21 Thread GitBox
Hisoka-X commented on code in PR #3783: URL: https://github.com/apache/incubator-seatunnel/pull/3783#discussion_r1055045859 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/source/KafkaConsumerThread.java: ## @@ -68,7 +68,

[GitHub] [incubator-seatunnel] liugddx commented on a diff in pull request #3755: [Feature][Shade] Add seatunnel hadoop3 uber

2022-12-21 Thread GitBox
liugddx commented on code in PR #3755: URL: https://github.com/apache/incubator-seatunnel/pull/3755#discussion_r1055045034 ## seatunnel-e2e/seatunnel-flink-connector-v2-e2e/connector-iceberg-flink-e2e/pom.xml: ## @@ -41,8 +41,10 @@ test -

[GitHub] [incubator-seatunnel] lightzhao opened a new pull request, #3783: User configured clientid is preferred

2022-12-21 Thread GitBox
lightzhao opened a new pull request, #3783: URL: https://github.com/apache/incubator-seatunnel/pull/3783 If the clientid is configured on the user side, the clientid on the user side is preferred; otherwise, the default clientid is set. ## Purpose of this pull request

[GitHub] [incubator-seatunnel] hailin0 commented on pull request #3781: [Feature][Transform-V2] add FieldMapper Transform

2022-12-21 Thread GitBox
hailin0 commented on PR #3781: URL: https://github.com/apache/incubator-seatunnel/pull/3781#issuecomment-1362301497 Please check code style -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3263: [Umbrella][flink] Upgrade flink

2022-12-21 Thread GitBox
github-actions[bot] commented on issue #3263: URL: https://github.com/apache/incubator-seatunnel/issues/3263#issuecomment-1362248165 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3002: [Umbrella] [Dirty data] This is new feature for dirty data

2022-12-21 Thread GitBox
github-actions[bot] commented on issue #3002: URL: https://github.com/apache/incubator-seatunnel/issues/3002#issuecomment-1362248226 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity

[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #3414: [Feature][Module Name] Will future v2 connectors support more flink features?

2022-12-21 Thread GitBox
github-actions[bot] closed issue #3414: [Feature][Module Name] Will future v2 connectors support more flink features? URL: https://github.com/apache/incubator-seatunnel/issues/3414 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3414: [Feature][Module Name] Will future v2 connectors support more flink features?

2022-12-21 Thread GitBox
github-actions[bot] commented on issue #3414: URL: https://github.com/apache/incubator-seatunnel/issues/3414#issuecomment-1362247988 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. --

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3463: [Bug][Spark]Driver stacktrace:at org.apache.spark.scheduler.DAGScheduler.failJobAndIndependentStages;Caused by: java.lang.O

2022-12-21 Thread GitBox
github-actions[bot] commented on issue #3463: URL: https://github.com/apache/incubator-seatunnel/issues/3463#issuecomment-1362247683 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3458: [Bug] [Spark] java.nio.file.AccessDeniedException: /service/software/seatunnel/plugins.tar.gz

2022-12-21 Thread GitBox
github-actions[bot] commented on issue #3458: URL: https://github.com/apache/incubator-seatunnel/issues/3458#issuecomment-1362247768 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity

[GitHub] [incubator-seatunnel] liugddx commented on issue #3754: [Umbrella][Improve][Connector] Provide test cases for `exactly-once`.

2022-12-21 Thread GitBox
liugddx commented on issue #3754: URL: https://github.com/apache/incubator-seatunnel/issues/3754#issuecomment-1361276305 > I have three options here, > > 1. the first is to write use cases directly behind `ClusterFaultToleranceIT`. > 2. The second is to add verification to our e2e

[GitHub] [incubator-seatunnel] liugddx commented on issue #3754: [Umbrella][Improve][Connector] Provide test cases for `exactly-once`.

2022-12-21 Thread GitBox
liugddx commented on issue #3754: URL: https://github.com/apache/incubator-seatunnel/issues/3754#issuecomment-1361275569 I have three options here, 1. the first is to write use cases directly behind `ClusterFaultToleranceIT`. 2. The second is to add verification to our e2e.

[GitHub] [incubator-seatunnel] TyrantLucifer commented on a diff in pull request #3750: [Improve][Connector-V2][JDBC] Add exactly-once for JDBC source connector

2022-12-21 Thread GitBox
TyrantLucifer commented on code in PR #3750: URL: https://github.com/apache/incubator-seatunnel/pull/3750#discussion_r1054288897 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/source/JdbcSourceSplitEnumerator.java: ## @@ -

[incubator-seatunnel] branch 2.3.0-release updated (950167d9a -> 28cfaae4f)

2022-12-21 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a change to branch 2.3.0-release in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git discard 950167d9a [Release][2.3.0][release-note] Add 2.3.0 release-note add 6193ceaec improve

[incubator-seatunnel] 01/01: [Release][2.3.0][release-note] Add 2.3.0 release-note

2022-12-21 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a commit to branch 2.3.0-release in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git commit 28cfaae4f630b0d14863483956e8c92d72292f1c Author: tyrantlucifer AuthorDate: Mon Dec 19 20:22:0

[GitHub] [incubator-seatunnel] lightzhao opened a new pull request, #3782: add lzo compression way.

2022-12-21 Thread GitBox
lightzhao opened a new pull request, #3782: URL: https://github.com/apache/incubator-seatunnel/pull/3782 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #3781: [Feature][Transform-V2] add FieldMapper Transform

2022-12-21 Thread GitBox
hailin0 commented on code in PR #3781: URL: https://github.com/apache/incubator-seatunnel/pull/3781#discussion_r1054150331 ## seatunnel-transforms-v2/src/main/java/org/apache/seatunnel/transform/FieldMapperTransform.java: ## @@ -0,0 +1,123 @@ +/* + * Licensed to the Apache Soft

[GitHub] [incubator-seatunnel] EricJoy2048 opened a new pull request, #3781: [Feature][Transform-V2] add FieldMapper Transform

2022-12-21 Thread GitBox
EricJoy2048 opened a new pull request, #3781: URL: https://github.com/apache/incubator-seatunnel/pull/3781 FieldMapper Transform can let user config input and output field mapper. For example ``` source { FakeSource { result_table_name = "fake" row.num = 100

[GitHub] [incubator-seatunnel-website] EricJoy2048 closed pull request #182: [Doc][Improve] set sidebarCollapsed=false

2022-12-21 Thread GitBox
EricJoy2048 closed pull request #182: [Doc][Improve] set sidebarCollapsed=false URL: https://github.com/apache/incubator-seatunnel-website/pull/182 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the