[incubator-seatunnel] branch dev updated: [feature][connector][cdc] add cdc reader jdbc related (#3433)

2022-11-14 Thread zongwen
This is an automated email from the ASF dual-hosted git repository. zongwen pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 7bf00fb19 [feature][connector][cdc] add

[GitHub] [incubator-seatunnel] ashulin merged pull request #3433: [feature][connector] add cdc reader jdbc related

2022-11-14 Thread GitBox
ashulin merged PR #3433: URL: https://github.com/apache/incubator-seatunnel/pull/3433 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[GitHub] [incubator-seatunnel-website] EricJoy2048 closed pull request #173: [Improve] Remove v1 doc from seatunnel 2.3.0-beta

2022-11-14 Thread GitBox
EricJoy2048 closed pull request #173: [Improve] Remove v1 doc from seatunnel 2.3.0-beta URL: https://github.com/apache/incubator-seatunnel-website/pull/173 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[incubator-seatunnel] branch dev updated: [Feature][Sentry Sink V2] Add Sentry Sink Option Rules (#3318)

2022-11-14 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 850f48381 [Feature][Sentry Sink V2] A

[GitHub] [incubator-seatunnel] EricJoy2048 merged pull request #3318: [Feature][Sentry Sink V2] Add Sentry Sink Option Rules

2022-11-14 Thread GitBox
EricJoy2048 merged PR #3318: URL: https://github.com/apache/incubator-seatunnel/pull/3318 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[incubator-seatunnel-website] branch remove_v1_doc1 updated (28a28e2caa -> 216e2ccc98)

2022-11-14 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a change to branch remove_v1_doc1 in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-website.git from 28a28e2caa remove v1 content from 2.3.0-beta docs add efbd519bff [Doc] Fix some

[incubator-seatunnel-website] branch remove_v1_doc1 created (now 28a28e2caa)

2022-11-14 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a change to branch remove_v1_doc1 in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-website.git at 28a28e2caa remove v1 content from 2.3.0-beta docs This branch includes the followin

[GitHub] [incubator-seatunnel] EricJoy2048 commented on a diff in pull request #3353: [WIP][Feature][API] add common options

2022-11-14 Thread GitBox
EricJoy2048 commented on code in PR #3353: URL: https://github.com/apache/incubator-seatunnel/pull/3353#discussion_r1022349526 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/factory/TableSinkFactory.java: ## @@ -32,11 +33,28 @@ /** * We will never us

[GitHub] [incubator-seatunnel] liugddx commented on a diff in pull request #3089: [Feature][Connector-V2][JDBC] support sqlite Source & Sink

2022-11-14 Thread GitBox
liugddx commented on code in PR #3089: URL: https://github.com/apache/incubator-seatunnel/pull/3089#discussion_r995719643 ## seatunnel-e2e/seatunnel-flink-connector-v2-e2e/connector-jdbc-flink-e2e/src/test/java/org/apache/seatunnel/e2e/flink/v2/jdbc/JdbcSqliteIT.java: ## @@ -0,

[GitHub] [incubator-seatunnel] TaoZex closed pull request #3439: [HotFix][Api][Option] Fix OptionValidation error code

2022-11-14 Thread GitBox
TaoZex closed pull request #3439: [HotFix][Api][Option] Fix OptionValidation error code URL: https://github.com/apache/incubator-seatunnel/pull/3439 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [incubator-seatunnel] nutsjian commented on pull request #3089: [Feature][Connector-V2][JDBC] support sqlite Source & Sink

2022-11-14 Thread GitBox
nutsjian commented on PR #3089: URL: https://github.com/apache/incubator-seatunnel/pull/3089#issuecomment-1314757326 @Hisoka-X @EricJoy2048 conflict resolved, please help me rerun the CI workflows, thx. -- This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [incubator-seatunnel] Hisoka-X commented on a diff in pull request #3416: [Connector-V2] [Clickhouse] Improve Clickhouse File Connector

2022-11-14 Thread GitBox
Hisoka-X commented on code in PR #3416: URL: https://github.com/apache/incubator-seatunnel/pull/3416#discussion_r1022298099 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/sink/file/ClickhouseFileSinkWriter.java: ##

[GitHub] [incubator-seatunnel] Hisoka-X commented on a diff in pull request #3416: [Connector-V2] [Clickhouse] Improve Clickhouse File Connector

2022-11-14 Thread GitBox
Hisoka-X commented on code in PR #3416: URL: https://github.com/apache/incubator-seatunnel/pull/3416#discussion_r1022297132 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/sink/file/ClickhouseFileSinkWriter.java: ##

[GitHub] [incubator-seatunnel] Z1Wu commented on a diff in pull request #3416: [Connector-V2] [Clickhouse] Improve Clickhouse File Connector

2022-11-14 Thread GitBox
Z1Wu commented on code in PR #3416: URL: https://github.com/apache/incubator-seatunnel/pull/3416#discussion_r1022293438 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/sink/file/ClickhouseFileSinkWriter.java: ##

[GitHub] [incubator-seatunnel] Z1Wu commented on a diff in pull request #3416: [Connector-V2] [Clickhouse] Improve Clickhouse File Connector

2022-11-14 Thread GitBox
Z1Wu commented on code in PR #3416: URL: https://github.com/apache/incubator-seatunnel/pull/3416#discussion_r1022293438 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/sink/file/ClickhouseFileSinkWriter.java: ##

[GitHub] [incubator-seatunnel] Z1Wu commented on a diff in pull request #3416: [Connector-V2] [Clickhouse] Improve Clickhouse File Connector

2022-11-14 Thread GitBox
Z1Wu commented on code in PR #3416: URL: https://github.com/apache/incubator-seatunnel/pull/3416#discussion_r1022292350 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/sink/file/ClickhouseFileSinkWriter.java: ##

[GitHub] [incubator-seatunnel] hailin0 merged pull request #3394: [Feature][Connector V2] expose configurable options in Iceberg

2022-11-14 Thread GitBox
hailin0 merged PR #3394: URL: https://github.com/apache/incubator-seatunnel/pull/3394 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[incubator-seatunnel] branch dev updated (4f824fea3 -> bd9a313de)

2022-11-14 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from 4f824fea3 [feature][api] add option validation for the ReadonlyConfig (#3417) add bd9a313de [Featu

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #3387: [Feature][Connector V2] expose configurable options in IoTDB

2022-11-14 Thread GitBox
hailin0 commented on code in PR #3387: URL: https://github.com/apache/incubator-seatunnel/pull/3387#discussion_r1022271529 ## seatunnel-connectors-v2/connector-iotdb/src/main/java/org/apache/seatunnel/connectors/seatunnel/iotdb/config/SinkConfig.java: ## @@ -35,28 +38,28 @@ @T

[GitHub] [incubator-seatunnel] TaoZex opened a new pull request, #3439: [BugFix][Api][Option] Fix OptionValidation error code

2022-11-14 Thread GitBox
TaoZex opened a new pull request, #3439: URL: https://github.com/apache/incubator-seatunnel/pull/3439 ## Purpose of this pull request Fix OptionValidation error code ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason:

[GitHub] [incubator-seatunnel] Hisoka-X commented on issue #3242: [Bug] [Clickhouse-File] clickhouse-file connector-v2 generated data part name conflict

2022-11-14 Thread GitBox
Hisoka-X commented on issue #3242: URL: https://github.com/apache/incubator-seatunnel/issues/3242#issuecomment-1314693507 > Maybe we don't need to generate random number, I currently use a task Id get from `SinkWriter.Context` as a work-around. > > ```java > this.taskIndex = conte

[GitHub] [incubator-seatunnel] hailin0 commented on issue #3242: [Bug] [Clickhouse-File] clickhouse-file connector-v2 generated data part name conflict

2022-11-14 Thread GitBox
hailin0 commented on issue #3242: URL: https://github.com/apache/incubator-seatunnel/issues/3242#issuecomment-1314689959 > Maybe we don't need to generate random number, I currently use a task Id get from `SinkWriter.Context` as a work-around. > > ```java > this.taskIndex = contex

[GitHub] [incubator-seatunnel] s7monk opened a new issue, #3438: [Feature][Connector V2] Read HdfsFile data limit network bandwidth

2022-11-14 Thread GitBox
s7monk opened a new issue, #3438: URL: https://github.com/apache/incubator-seatunnel/issues/3438 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requir

[incubator-seatunnel] branch dev updated: [feature][api] add option validation for the ReadonlyConfig (#3417)

2022-11-14 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 4f824fea3 [feature][api] add option v

[GitHub] [incubator-seatunnel] EricJoy2048 merged pull request #3417: [feature][api] add option validation for the ReadonlyConfig

2022-11-14 Thread GitBox
EricJoy2048 merged PR #3417: URL: https://github.com/apache/incubator-seatunnel/pull/3417 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [incubator-seatunnel] Hisoka-X commented on pull request #3089: [Feature][Connector-V2][JDBC] support sqlite Source & Sink

2022-11-14 Thread GitBox
Hisoka-X commented on PR #3089: URL: https://github.com/apache/incubator-seatunnel/pull/3089#issuecomment-1314679839 Please resolve conflict, Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [incubator-seatunnel] Hisoka-X merged pull request #3331: [Improve][Connector-V2][Assert] Unified exception for assert connector

2022-11-14 Thread GitBox
Hisoka-X merged PR #3331: URL: https://github.com/apache/incubator-seatunnel/pull/3331 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr.

[incubator-seatunnel] branch dev updated: [Improve][Connector-V2][Assert] Unified exception for assert connector (#3331)

2022-11-14 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new e74c9bc6f [Improve][Connector-V2][Assert]

[GitHub] [incubator-seatunnel] Hisoka-X closed issue #3330: [Improve][Connector-V2][Assert] Unified exception for assert sink connector

2022-11-14 Thread GitBox
Hisoka-X closed issue #3330: [Improve][Connector-V2][Assert] Unified exception for assert sink connector URL: https://github.com/apache/incubator-seatunnel/issues/3330 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #3017: [Feature][Connector-V2] Jdbc connector support SAP HANA Source & SAP HANA Sink.

2022-11-14 Thread GitBox
hailin0 commented on code in PR #3017: URL: https://github.com/apache/incubator-seatunnel/pull/3017#discussion_r1022254878 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/dialect/saphana/SapHanaTypeMapper.java: ##

[incubator-seatunnel] branch dev updated: [Feature][connector-v2] add tablestore source and sink (#3309)

2022-11-14 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new ebebf0b63 [Feature][connector-v2] add

[GitHub] [incubator-seatunnel] EricJoy2048 merged pull request #3309: [Feature][connector-v2] add tablestore source and sink

2022-11-14 Thread GitBox
EricJoy2048 merged PR #3309: URL: https://github.com/apache/incubator-seatunnel/pull/3309 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [incubator-seatunnel] s7monk commented on a diff in pull request #3046: [Feature][Connector-V2][Iceberg]Modify the scope of flink-shaded-hadoop-2 to provided to be compatible with hadoop3.x

2022-11-14 Thread GitBox
s7monk commented on code in PR #3046: URL: https://github.com/apache/incubator-seatunnel/pull/3046#discussion_r1022252539 ## docs/en/connector-v2/source/Iceberg.md: ## @@ -161,6 +161,19 @@ source { } ``` +:::tip + +In order to be compatible with different versions of Hadoop

[incubator-seatunnel] branch dev updated: [Improve][Connector-V2][My Hours]Add http method enum && Improve My Hours connector option rule (#3390)

2022-11-14 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new a86c9d90f [Improve][Connector-V2][My

[GitHub] [incubator-seatunnel] EricJoy2048 merged pull request #3390: [Improve][Connector-V2][My Hours]Add http method enum && Improve My Hours connector option rule

2022-11-14 Thread GitBox
EricJoy2048 merged PR #3390: URL: https://github.com/apache/incubator-seatunnel/pull/3390 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[incubator-seatunnel] branch dev updated (28868797b -> 17bc5adce)

2022-11-14 Thread ic4y
This is an automated email from the ASF dual-hosted git repository. ic4y pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from 28868797b [Improve][Connector-V2][Cassandra] Unified exception for cassandra source & sink connector (#3435)

[GitHub] [incubator-seatunnel] ic4y merged pull request #3333: [Improve][Connector-V2][AmazonDynamoDB] Unified exception for AmazonDynamoDB source & sink connector

2022-11-14 Thread GitBox
ic4y merged PR #: URL: https://github.com/apache/incubator-seatunnel/pull/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@s

[GitHub] [incubator-seatunnel] ic4y closed issue #3332: [Improve][Connector-V2][AmazonDynamoDB] Unified exception for AmazonDynamoDB source & sink connector

2022-11-14 Thread GitBox
ic4y closed issue #3332: [Improve][Connector-V2][AmazonDynamoDB] Unified exception for AmazonDynamoDB source & sink connector URL: https://github.com/apache/incubator-seatunnel/issues/3332 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [incubator-seatunnel] EricJoy2048 closed issue #3434: [Improve][Connector-V2][Cassandra] Unified exception for Cassandra source & sink connector

2022-11-14 Thread GitBox
EricJoy2048 closed issue #3434: [Improve][Connector-V2][Cassandra] Unified exception for Cassandra source & sink connector URL: https://github.com/apache/incubator-seatunnel/issues/3434 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[incubator-seatunnel] branch dev updated (d82f8fa03 -> 28868797b)

2022-11-14 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from d82f8fa03 [Improve][Core][Exceptiom Management] Add Exception Management API & Unified Exception in API

[GitHub] [incubator-seatunnel] EricJoy2048 merged pull request #3435: [Improve][Connector-V2][Cassandra] Unified exception for cassandra source & sink connector

2022-11-14 Thread GitBox
EricJoy2048 merged PR #3435: URL: https://github.com/apache/incubator-seatunnel/pull/3435 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #3410: [Feature][Connector V2] expose configurable options in JDBC

2022-11-14 Thread GitBox
hailin0 commented on code in PR #3410: URL: https://github.com/apache/incubator-seatunnel/pull/3410#discussion_r1022243278 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/config/JdbcConfig.java: ## @@ -25,74 +27,76 @@ pu

[GitHub] [incubator-seatunnel] bravekong commented on pull request #732: change es sink plugin index_type default value from log to _doc

2022-11-14 Thread GitBox
bravekong commented on PR #732: URL: https://github.com/apache/incubator-seatunnel/pull/732#issuecomment-1314635256 @CalvinKirs I don't think so. The es version 5.6.16 I used reports errors using the default _doc. There is no problem using log. Although es 7 internal index is _do

[GitHub] [incubator-seatunnel] Carl-Zhou-CN closed pull request #3125: [Improve][Connector-V2-kafka] Support for dynamic discover topic & partition in streaming mode

2022-11-14 Thread GitBox
Carl-Zhou-CN closed pull request #3125: [Improve][Connector-V2-kafka] Support for dynamic discover topic & partition in streaming mode URL: https://github.com/apache/incubator-seatunnel/pull/3125 -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [incubator-seatunnel] nutsjian commented on pull request #3089: [Feature][Connector-V2][JDBC] support sqlite Source & Sink

2022-11-14 Thread GitBox
nutsjian commented on PR #3089: URL: https://github.com/apache/incubator-seatunnel/pull/3089#issuecomment-1314597596 @EricJoy2048 please help me rerun ci workflows, if the unit test error has been resolved. thx. ```bash 2022-11-11T02:48:26.4091671Z [ERROR] Failed to execute goal o

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2868: [Bug] [Connector-V2] Hive Source Connector Need read data used the hive schema not file schema when read ORC/Parquet Table

2022-11-14 Thread GitBox
github-actions[bot] commented on issue #2868: URL: https://github.com/apache/incubator-seatunnel/issues/2868#issuecomment-1314589643 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. --

[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #2868: [Bug] [Connector-V2] Hive Source Connector Need read data used the hive schema not file schema when read ORC/Parquet Table

2022-11-14 Thread GitBox
github-actions[bot] closed issue #2868: [Bug] [Connector-V2] Hive Source Connector Need read data used the hive schema not file schema when read ORC/Parquet Table URL: https://github.com/apache/incubator-seatunnel/issues/2868 -- This is an automated message from the Apache Git Service. To re

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2876: Run e2etestcase for windows docker problem for help

2022-11-14 Thread GitBox
github-actions[bot] commented on issue #2876: URL: https://github.com/apache/incubator-seatunnel/issues/2876#issuecomment-1314589611 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. --

[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #2876: Run e2etestcase for windows docker problem for help

2022-11-14 Thread GitBox
github-actions[bot] closed issue #2876: Run e2etestcase for windows docker problem for help URL: https://github.com/apache/incubator-seatunnel/issues/2876 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [incubator-seatunnel] cason0126 commented on issue #3271: [Umbrella][Feature][Connector-V2] Support create table automaticly

2022-11-14 Thread GitBox
cason0126 commented on issue #3271: URL: https://github.com/apache/incubator-seatunnel/issues/3271#issuecomment-1314125088 To solve this problem, we should first list a default policy that How SeaTunnel handle with data type mapping between Source and Sink , SeaTunnel should allow users

[GitHub] [incubator-seatunnel] TyrantLucifer opened a new pull request, #3437: [Improve][Docs][Error-Quick-Reference-Manual] Add Error quick reference manual to help users

2022-11-14 Thread GitBox
TyrantLucifer opened a new pull request, #3437: URL: https://github.com/apache/incubator-seatunnel/pull/3437 ## Purpose of this pull request Add Error quick reference manual to help users ## Check list * [ ] Code changed are covered with tests, or it does

[GitHub] [incubator-seatunnel] cason0126 commented on issue #3360: [Feature][Web Server] Add SeaTunnel Job Executor

2022-11-14 Thread GitBox
cason0126 commented on issue #3360: URL: https://github.com/apache/incubator-seatunnel/issues/3360#issuecomment-1314103155 Does job information including jvm resource parameters like -Xms -Xmx?If Job Information includes these paras ,Whether scripts in #3155 #3307 should accept these para

[GitHub] [incubator-seatunnel] TyrantLucifer opened a new pull request, #3436: [Improve][Docs][Coding-Guide] Add a section that presents how to develop a high quality connector

2022-11-14 Thread GitBox
TyrantLucifer opened a new pull request, #3436: URL: https://github.com/apache/incubator-seatunnel/pull/3436 ## Purpose of this pull request Improve coding-guide && Add introduction of how to throw exception in connector ## Check list * [ ] Code changed a

[GitHub] [incubator-seatunnel] TyrantLucifer commented on pull request #3435: [Improve][Connector-V2][Cassandra] Unified exception for cassandra source & sink connector

2022-11-14 Thread GitBox
TyrantLucifer commented on PR #3435: URL: https://github.com/apache/incubator-seatunnel/pull/3435#issuecomment-1314019258 @EricJoy2048 @Hisoka-X @FWLamb PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [incubator-seatunnel] TyrantLucifer commented on pull request #3333: [Improve][Connector-V2][AmazonDynamoDB] Unified exception for AmazonDynamoDB source & sink connector

2022-11-14 Thread GitBox
TyrantLucifer commented on PR #: URL: https://github.com/apache/incubator-seatunnel/pull/#issuecomment-1314017896 @Hisoka-X @EricJoy2048 @liugddx PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [incubator-seatunnel] TyrantLucifer commented on pull request #3331: [Improve][Connector-V2][Assert] Unified exception for assert connector

2022-11-14 Thread GitBox
TyrantLucifer commented on PR #3331: URL: https://github.com/apache/incubator-seatunnel/pull/3331#issuecomment-1314016986 @EricJoy2048 @Hisoka-X PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [incubator-seatunnel] TyrantLucifer opened a new pull request, #3435: [Improve][Connector-V2][Cassandra] Unified exception for cassandra source & sink connector

2022-11-14 Thread GitBox
TyrantLucifer opened a new pull request, #3435: URL: https://github.com/apache/incubator-seatunnel/pull/3435 ## Purpose of this pull request Unified exception for cassandra source & sink connector sub-task of #2930 close #3434 ## Check list

[GitHub] [incubator-seatunnel] john8628 commented on a diff in pull request #3396: [Feature][starter][flink] Support transform-v2 for flink

2022-11-14 Thread GitBox
john8628 commented on code in PR #3396: URL: https://github.com/apache/incubator-seatunnel/pull/3396#discussion_r1021662920 ## seatunnel-e2e/seatunnel-flink-connector-v2-e2e/connector-iotdb-flink-e2e/src/test/resources/iotdb/iotdb_source_to_sink.conf: ## @@ -54,9 +54,7 @@ sourc

[GitHub] [incubator-seatunnel] Z1Wu commented on issue #3242: [Bug] [Clickhouse-File] clickhouse-file connector-v2 generated data part name conflict

2022-11-14 Thread GitBox
Z1Wu commented on issue #3242: URL: https://github.com/apache/incubator-seatunnel/issues/3242#issuecomment-1313802644 Maybe we don't need to generate random number, I currently use a task Id get from `SinkWriter.Context` as a work-around. ``` java this.taskIndex = context.getIndexOfSu

[GitHub] [incubator-seatunnel] TaoZex closed pull request #3231: [Improve][Core][spark-starter] Fix the command line generated by SparkStarter

2022-11-14 Thread GitBox
TaoZex closed pull request #3231: [Improve][Core][spark-starter] Fix the command line generated by SparkStarter URL: https://github.com/apache/incubator-seatunnel/pull/3231 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [incubator-seatunnel] ic4y opened a new pull request, #3433: [feature][connector] add cdc reader jdbc related

2022-11-14 Thread GitBox
ic4y opened a new pull request, #3433: URL: https://github.com/apache/incubator-seatunnel/pull/3433 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary pack

[GitHub] [incubator-seatunnel] FWLamb commented on pull request #3362: [Feature][Connector-V2][Teradata] Add Teradata Source And Sink Connector

2022-11-14 Thread GitBox
FWLamb commented on PR #3362: URL: https://github.com/apache/incubator-seatunnel/pull/3362#issuecomment-1313465163 https://user-images.githubusercontent.com/58908699/201641044-d306f0b0-61e1-4376-9197-cdf43325ee10.png";> -- This is an automated message from the Apache Git Service. To r

[incubator-seatunnel] branch dev updated (4513015cc -> d82f8fa03)

2022-11-14 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from 4513015cc [Hotfix][CI] fix ci error when remove modules (#3401) add d82f8fa03 [Improve][Core][Ex

[GitHub] [incubator-seatunnel] TyrantLucifer merged pull request #3045: [Improve][Core][Exceptiom Management] Add Exception Management API & Unified Exception in API Module

2022-11-14 Thread GitBox
TyrantLucifer merged PR #3045: URL: https://github.com/apache/incubator-seatunnel/pull/3045 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[GitHub] [incubator-seatunnel] TyrantLucifer closed issue #3043: [Improve][Core][Exceptiom Management] Design Exception Management API

2022-11-14 Thread GitBox
TyrantLucifer closed issue #3043: [Improve][Core][Exceptiom Management] Design Exception Management API URL: https://github.com/apache/incubator-seatunnel/issues/3043 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [incubator-seatunnel] Hisoka-X opened a new pull request, #3432: [Connector] [Dependency] Add Miss Dependency Cassandra

2022-11-14 Thread GitBox
Hisoka-X opened a new pull request, #3432: URL: https://github.com/apache/incubator-seatunnel/pull/3432 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary

[GitHub] [incubator-seatunnel] TaoZex commented on issue #3430: [Feature][SeaTunnel Engine] Add test to test stream job recover when all cluster node done and restart

2022-11-14 Thread GitBox
TaoZex commented on issue #3430: URL: https://github.com/apache/incubator-seatunnel/issues/3430#issuecomment-1313345942 I want to try this task, it will help me understand engine better. Please assign it to me,thanks. -- This is an automated message from the Apache Git Service. To respon

[GitHub] [incubator-seatunnel] xiaomaiyun commented on issue #3090: [Feature][doc] “env” lists all optional parameters

2022-11-14 Thread GitBox
xiaomaiyun commented on issue #3090: URL: https://github.com/apache/incubator-seatunnel/issues/3090#issuecomment-1313313855 > This is a Spark or Flink parameter, which we can find explicitly at https://spark.apache.org/docs/latest/configuration.html, and the parameters inside Connector hav

[GitHub] [incubator-seatunnel] xiaomaiyun commented on issue #3090: [Feature][doc] “env” lists all optional parameters

2022-11-14 Thread GitBox
xiaomaiyun commented on issue #3090: URL: https://github.com/apache/incubator-seatunnel/issues/3090#issuecomment-1313312972 > For flink parameters, I can't seem to find all the parameters [here](https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/) . https://

[GitHub] [incubator-seatunnel] Hisoka-X commented on a diff in pull request #3410: [Feature][Connector V2] expose configurable options in JDBC

2022-11-14 Thread GitBox
Hisoka-X commented on code in PR #3410: URL: https://github.com/apache/incubator-seatunnel/pull/3410#discussion_r1021214501 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/config/JdbcConfig.java: ## @@ -25,74 +27,74 @@ p

[incubator-seatunnel] branch dev updated (9b1821f47 -> 4513015cc)

2022-11-14 Thread kirs
This is an automated email from the ASF dual-hosted git repository. kirs pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from 9b1821f47 [feature][connector][cdc] add CDC enumerator base classes (#3419) add 4513015cc [Hotfix][CI] f

[GitHub] [incubator-seatunnel] CalvinKirs merged pull request #3401: [Hotfix][CI] fix ci error when remove modules

2022-11-14 Thread GitBox
CalvinKirs merged PR #3401: URL: https://github.com/apache/incubator-seatunnel/pull/3401 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [incubator-seatunnel] EricJoy2048 commented on a diff in pull request #3309: [Feature][connector-v2] add tablestore source and sink

2022-11-14 Thread GitBox
EricJoy2048 commented on code in PR #3309: URL: https://github.com/apache/incubator-seatunnel/pull/3309#discussion_r1021195267 ## seatunnel-connectors-v2/connector-tablestore/src/main/java/org/apache/seatunnel/connectors/seatunnel/tablestore/config/TablestoreConfig.java: ## @@

[GitHub] [incubator-seatunnel] Hisoka-X opened a new issue, #3431: [Feature][Metrics] SeaTunnel Metrics for Connector V2

2022-11-14 Thread GitBox
Hisoka-X opened a new issue, #3431: URL: https://github.com/apache/incubator-seatunnel/issues/3431 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requ

[GitHub] [incubator-seatunnel] EricJoy2048 opened a new issue, #3430: [Feature][SeaTunnel Engine] Add test to test stream job recover when all cluster node done and restart

2022-11-14 Thread GitBox
EricJoy2048 opened a new issue, #3430: URL: https://github.com/apache/incubator-seatunnel/issues/3430 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature r