[GitHub] [incubator-seatunnel] EricJoy2048 opened a new issue, #3429: [Feature][Web] Add option rule wrapper and wrapper seatunnel option rules to web form json

2022-11-13 Thread GitBox
EricJoy2048 opened a new issue, #3429: URL: https://github.com/apache/incubator-seatunnel/issues/3429 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature r

[GitHub] [incubator-seatunnel] EricJoy2048 closed issue #3428: [Feature][Metrics] SeaTunnel Metrics Design

2022-11-13 Thread GitBox
EricJoy2048 closed issue #3428: [Feature][Metrics] SeaTunnel Metrics Design URL: https://github.com/apache/incubator-seatunnel/issues/3428 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #3411: [Feature][Connector V2] Add GoogleSheets Sink

2022-11-13 Thread GitBox
hailin0 commented on code in PR #3411: URL: https://github.com/apache/incubator-seatunnel/pull/3411#discussion_r1021148103 ## seatunnel-connectors-v2/connector-google-sheets/src/main/java/org/apache/seatunnel/connectors/seatunnel/google/sheets/sink/SheetsSinkWriter.java: ## @@

[incubator-seatunnel] branch 2.1.4-prepare updated: [Hotfix][Connector-V1][Kafka] When json or avro are selected for kafka schema, a ClassCastException error is reported (#3423)

2022-11-13 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a commit to branch 2.1.4-prepare in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/2.1.4-prepare by this push: new 5c7b1f6c8 [Hot

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #3411: [Feature][Connector V2] Add GoogleSheets Sink

2022-11-13 Thread GitBox
hailin0 commented on code in PR #3411: URL: https://github.com/apache/incubator-seatunnel/pull/3411#discussion_r1021148103 ## seatunnel-connectors-v2/connector-google-sheets/src/main/java/org/apache/seatunnel/connectors/seatunnel/google/sheets/sink/SheetsSinkWriter.java: ## @@

[GitHub] [incubator-seatunnel] TyrantLucifer merged pull request #3423: [2.1.4][Bug] [seatunnel-connectors-flink-kafka] When json or avro are selected for kafka schema, a ClassCastException error is r

2022-11-13 Thread GitBox
TyrantLucifer merged PR #3423: URL: https://github.com/apache/incubator-seatunnel/pull/3423 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[incubator-seatunnel] branch 2.1.4-prepare updated: [Hotfix][Connector-V1][Hbase] When the written df is empty, the directory does not exist when the load file is loaded (#3169) (#3424)

2022-11-13 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a commit to branch 2.1.4-prepare in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/2.1.4-prepare by this push: new 1c8bce621 [Hot

[GitHub] [incubator-seatunnel] TyrantLucifer merged pull request #3424: [2.1.4][Hotfix][Connector-V1][Hbase] When the written df is empty, the directory does not exist when the load file is loaded (#3

2022-11-13 Thread GitBox
TyrantLucifer merged PR #3424: URL: https://github.com/apache/incubator-seatunnel/pull/3424 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[incubator-seatunnel] branch 2.1.4-prepare updated: [Bug][Connector-V1][Hbase] Exception caused by compatibility with hadoop3.x (#3427)

2022-11-13 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a commit to branch 2.1.4-prepare in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/2.1.4-prepare by this push: new d49c4b1b4 [Bug

[GitHub] [incubator-seatunnel] TyrantLucifer merged pull request #3427: [2.1.4][Bug] [seatunnel-connector-spark-hbase] Exception caused by compatibility with hadoop3.x (#3262)

2022-11-13 Thread GitBox
TyrantLucifer merged PR #3427: URL: https://github.com/apache/incubator-seatunnel/pull/3427 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[GitHub] [incubator-seatunnel] liugddx commented on a diff in pull request #3309: [Feature][connector-v2] add tablestore source and sink

2022-11-13 Thread GitBox
liugddx commented on code in PR #3309: URL: https://github.com/apache/incubator-seatunnel/pull/3309#discussion_r1021139681 ## seatunnel-connectors-v2/connector-tablestore/src/main/java/org/apache/seatunnel/connectors/seatunnel/tablestore/sink/TablestoreSinkFactory.java: ## @@ -

[incubator-seatunnel-web] branch main updated: [Feature] Add seatunnel main repository as seatunnel-web submodule (#13)

2022-11-13 Thread dijiekstra
This is an automated email from the ASF dual-hosted git repository. dijiekstra pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-web.git The following commit(s) were added to refs/heads/main by this push: new 9ac96114 [Feature] Add seatunne

[GitHub] [incubator-seatunnel-web] dijiekstra merged pull request #13: [Feature] Add seatunnel main repository as seatunnel-web submodule

2022-11-13 Thread GitBox
dijiekstra merged PR #13: URL: https://github.com/apache/incubator-seatunnel-web/pull/13 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[incubator-seatunnel-web] branch 1_add_submodule updated (e9ddb432 -> d00b2f88)

2022-11-13 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a change to branch 1_add_submodule in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-web.git from e9ddb432 ignore submodule license header check add d00b2f88 ignore submodule licens

[GitHub] [incubator-seatunnel] CalvinKirs commented on a diff in pull request #3418: [WIP][Engine]Support IMap File Storage

2022-11-13 Thread GitBox
CalvinKirs commented on code in PR #3418: URL: https://github.com/apache/incubator-seatunnel/pull/3418#discussion_r1021124692 ## seatunnel-engine/seatunnel-engine-storage/imap-storage-api/src/main/java/org/apache/seatunnel/engine/imap/storage/api/IMapStorage.java: ## @@ -0,0 +1

[GitHub] [incubator-seatunnel] TaoZex closed pull request #3421: [Improve][Connector-V2][StarRocks]Add row numbers check in StarRock e2e

2022-11-13 Thread GitBox
TaoZex closed pull request #3421: [Improve][Connector-V2][StarRocks]Add row numbers check in StarRock e2e URL: https://github.com/apache/incubator-seatunnel/pull/3421 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[incubator-seatunnel-web] branch 1_add_submodule updated (a4710c16 -> e9ddb432)

2022-11-13 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a change to branch 1_add_submodule in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-web.git from a4710c16 add submodule add e9ddb432 ignore submodule license header check No new r

[incubator-seatunnel-web] branch main updated (fad2edf9 -> a57686c3)

2022-11-13 Thread zhongjiajie
This is an automated email from the ASF dual-hosted git repository. zhongjiajie pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-web.git from fad2edf9 Solve the dependency version is not defined in the pom file (#11) add a57686c3 [Fea

[GitHub] [incubator-seatunnel-web] zhongjiajie merged pull request #14: [Feat][UI] Complete job management.

2022-11-13 Thread GitBox
zhongjiajie merged PR #14: URL: https://github.com/apache/incubator-seatunnel-web/pull/14 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[incubator-seatunnel] branch dev updated: [feature][connector][cdc] add CDC enumerator base classes (#3419)

2022-11-13 Thread zongwen
This is an automated email from the ASF dual-hosted git repository. zongwen pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 9b1821f47 [feature][connector][cdc] add

[GitHub] [incubator-seatunnel] ashulin closed issue #3254: [feature][CDC] The basic implementation of the CDC source enumerator in the incremental phase

2022-11-13 Thread GitBox
ashulin closed issue #3254: [feature][CDC] The basic implementation of the CDC source enumerator in the incremental phase URL: https://github.com/apache/incubator-seatunnel/issues/3254 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [incubator-seatunnel] ashulin merged pull request #3419: [feature][connector][cdc] add CDC enumerator base classes

2022-11-13 Thread GitBox
ashulin merged PR #3419: URL: https://github.com/apache/incubator-seatunnel/pull/3419 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[GitHub] [incubator-seatunnel] ashulin closed issue #3253: [feature][CDC] The basic implementation of the CDC source enumerator in the snapshot phase

2022-11-13 Thread GitBox
ashulin closed issue #3253: [feature][CDC] The basic implementation of the CDC source enumerator in the snapshot phase URL: https://github.com/apache/incubator-seatunnel/issues/3253 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [incubator-seatunnel-web] songjianet opened a new pull request, #14: [Feat][UI] Complete job management.

2022-11-13 Thread GitBox
songjianet opened a new pull request, #14: URL: https://github.com/apache/incubator-seatunnel-web/pull/14 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binar

[GitHub] [incubator-seatunnel] ic4y commented on a diff in pull request #3309: [Feature][connector-v2] add tablestore source and sink

2022-11-13 Thread GitBox
ic4y commented on code in PR #3309: URL: https://github.com/apache/incubator-seatunnel/pull/3309#discussion_r1021102675 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/source/JdbcSource.java: ## @@ -139,7 +130,7 @@ private

[incubator-seatunnel] branch 2.1.4-prepare updated: [Hotfix][Connector-V1][Flink] Transfrom-flink-udf function properties get error (#3422)

2022-11-13 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a commit to branch 2.1.4-prepare in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/2.1.4-prepare by this push: new e35e026ea [Hot

[GitHub] [incubator-seatunnel] TyrantLucifer merged pull request #3422: [2.1.4][BUG][transform] transfrom-flink-udf function properties get error

2022-11-13 Thread GitBox
TyrantLucifer merged PR #3422: URL: https://github.com/apache/incubator-seatunnel/pull/3422 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[incubator-seatunnel] branch 2.1.4-prepare updated: [Hotfix][Connector-V1][Spark-Code] Fix the problem of calling the getData() method twice (#3425)

2022-11-13 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a commit to branch 2.1.4-prepare in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/2.1.4-prepare by this push: new abccc0648 [Hot

[GitHub] [incubator-seatunnel] TyrantLucifer merged pull request #3425: [2.1.4][hotfix][spark] fix the problem of calling the getData() method twice

2022-11-13 Thread GitBox
TyrantLucifer merged PR #3425: URL: https://github.com/apache/incubator-seatunnel/pull/3425 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[incubator-seatunnel] branch 2.1.4-prepare updated: [Improve][Connector-V1][Spark-Hbase] Handling null values (#3426)

2022-11-13 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a commit to branch 2.1.4-prepare in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/2.1.4-prepare by this push: new 5ebd7563f [Imp

[GitHub] [incubator-seatunnel] TyrantLucifer merged pull request #3426: [2.1.4][Improve][Connector-V1][Spark-Hbase] Handling null values (#3099)

2022-11-13 Thread GitBox
TyrantLucifer merged PR #3426: URL: https://github.com/apache/incubator-seatunnel/pull/3426 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[GitHub] [incubator-seatunnel] CalvinKirs opened a new pull request, #3427: [Bug] [seatunnel-connector-spark-hbase] Exception caused by compatibility with hadoop3.x (#3262)

2022-11-13 Thread GitBox
CalvinKirs opened a new pull request, #3427: URL: https://github.com/apache/incubator-seatunnel/pull/3427 #3262 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

[incubator-seatunnel] branch dev updated (b85317bcb -> 89db0eafe)

2022-11-13 Thread kirs
This is an automated email from the ASF dual-hosted git repository. kirs pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from b85317bcb [feature][connector][socket] Add Socket Connector Option Rules (#3317) add 89db0eafe [Bug] [se

[GitHub] [incubator-seatunnel] CalvinKirs closed issue #3209: [Bug] [sink HBase] java.lang.IllegalAccessError: class org.apache.hadoop.hdfs.web.HftpFileSystem cannot access its superinterface org.apac

2022-11-13 Thread GitBox
CalvinKirs closed issue #3209: [Bug] [sink HBase] java.lang.IllegalAccessError: class org.apache.hadoop.hdfs.web.HftpFileSystem cannot access its superinterface org.apache.hadoop.hdfs.web.TokenAspect$TokenManagementDelegator URL: https://github.com/apache/incubator-seatunnel/issues/3209 -- T

[GitHub] [incubator-seatunnel] CalvinKirs merged pull request #3262: [Bug] [Connector-V1-Spark-Hbase] Exception caused by compatibility with hadoop3.x

2022-11-13 Thread GitBox
CalvinKirs merged PR #3262: URL: https://github.com/apache/incubator-seatunnel/pull/3262 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [incubator-seatunnel] CalvinKirs opened a new pull request, #3426: [2.1.4][Improve][Connector-V1][Spark-Hbase] Handling null values (#3099)

2022-11-13 Thread GitBox
CalvinKirs opened a new pull request, #3426: URL: https://github.com/apache/incubator-seatunnel/pull/3426 PR #3099 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [incubator-seatunnel] CalvinKirs opened a new pull request, #3425: [2.1.4][hotfix][spark] fix the problem of calling the getData() method twice

2022-11-13 Thread GitBox
CalvinKirs opened a new pull request, #3425: URL: https://github.com/apache/incubator-seatunnel/pull/3425 pr #2764 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [incubator-seatunnel] CalvinKirs opened a new pull request, #3424: [Hotfix][Connector-V1][Hbase] When the written df is empty, the directory does not exist when the load file is loaded (#3169

2022-11-13 Thread GitBox
CalvinKirs opened a new pull request, #3424: URL: https://github.com/apache/incubator-seatunnel/pull/3424 PR #3169 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [incubator-seatunnel] CalvinKirs opened a new pull request, #3423: [Bug] [seatunnel-connectors-flink-kafka] When json or avro are selected for kafka schema, a ClassCastException error is repo

2022-11-13 Thread GitBox
CalvinKirs opened a new pull request, #3423: URL: https://github.com/apache/incubator-seatunnel/pull/3423 pr #3243 issue #3214 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [incubator-seatunnel] CalvinKirs opened a new pull request, #3422: [BUG][transform] transfrom-flink-udf function properties get error

2022-11-13 Thread GitBox
CalvinKirs opened a new pull request, #3422: URL: https://github.com/apache/incubator-seatunnel/pull/3422 pr #3310 issue #3250 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #3411: [Feature][Connector V2] Add GoogleSheets Sink

2022-11-13 Thread GitBox
hailin0 commented on code in PR #3411: URL: https://github.com/apache/incubator-seatunnel/pull/3411#discussion_r1021058854 ## seatunnel-connectors-v2/connector-google-sheets/src/main/java/org/apache/seatunnel/connectors/seatunnel/google/sheets/config/SheetsConfig.java: ## @@ -3

[GitHub] [incubator-seatunnel-web] github-actions[bot] commented on a diff in pull request #13: [Feature] Add seatunnel main repository as seatunnel-web submodule

2022-11-13 Thread GitBox
github-actions[bot] commented on code in PR #13: URL: https://github.com/apache/incubator-seatunnel-web/pull/13#discussion_r1021060480 ## .gitmodules: ## @@ -0,0 +1,6 @@ +[submodule "seatunnel-main"] Review Comment: ```suggestion # Licensed to the Apache Software Foundat

[incubator-seatunnel-web] branch 1_add_submodule created (now a4710c16)

2022-11-13 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a change to branch 1_add_submodule in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-web.git at a4710c16 add submodule This branch includes the following new commits: new baf799

[incubator-seatunnel-web] 02/02: add submodule

2022-11-13 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch 1_add_submodule in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-web.git commit a4710c16da55863bc7195455d4e4acc1904eb38f Author: gaojun AuthorDate: Mon Nov 14 12:13:27 20

[incubator-seatunnel-web] 01/02: remove submodule

2022-11-13 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch 1_add_submodule in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-web.git commit baf750d6a59a8aeabee130db96a386354d8d Author: gaojun AuthorDate: Mon Nov 14 12:11:55 20

[GitHub] [incubator-seatunnel] TaoZex commented on pull request #3406: [Bugfix][Connector-V2][StarRocks]Fix StarRocks StreamLoad retry bug and fix doc

2022-11-13 Thread GitBox
TaoZex commented on PR #3406: URL: https://github.com/apache/incubator-seatunnel/pull/3406#issuecomment-1313062558 > Nice work, you can also fix the e2e check row count by the way, or submit another pr to fix it. Thanks for your advice: https://github.com/apache/incubator-seatunnel/

[GitHub] [incubator-seatunnel] TaoZex opened a new pull request, #3421: [Improve][Connector-V2][StarRocks]Add row numbers check in StarRock e2e

2022-11-13 Thread GitBox
TaoZex opened a new pull request, #3421: URL: https://github.com/apache/incubator-seatunnel/pull/3421 ## Purpose of this pull request https://github.com/apache/incubator-seatunnel/pull/3406 Add row numbers check in StarRock e2e ## Check list * [ ] Code changed

[GitHub] [incubator-seatunnel] TaoZex commented on a diff in pull request #3390: [Improve][Connector-V2][My Hours]Add http method enum && Improve My Hours connector option rule

2022-11-13 Thread GitBox
TaoZex commented on code in PR #3390: URL: https://github.com/apache/incubator-seatunnel/pull/3390#discussion_r1021052117 ## seatunnel-connectors-v2/connector-http/connector-http-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/http/config/HttpConfig.java: ## @@ -23

[GitHub] [incubator-seatunnel] john8628 commented on a diff in pull request #3410: [Feature][Connector V2] expose configurable options in JDBC

2022-11-13 Thread GitBox
john8628 commented on code in PR #3410: URL: https://github.com/apache/incubator-seatunnel/pull/3410#discussion_r1021051888 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/config/JdbcConfig.java: ## @@ -25,74 +27,74 @@ p

[incubator-seatunnel] branch 2.1.4-prepare created (now f1cfb9c4b)

2022-11-13 Thread kirs
This is an automated email from the ASF dual-hosted git repository. kirs pushed a change to branch 2.1.4-prepare in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git at f1cfb9c4b [maven-release-plugin] prepare for next development iteration No new revisions were added

[GitHub] [incubator-seatunnel] dependabot[bot] commented on pull request #3269: Bump logback-core from 1.2.3 to 1.2.9

2022-11-13 Thread GitBox
dependabot[bot] commented on PR #3269: URL: https://github.com/apache/incubator-seatunnel/pull/3269#issuecomment-1313055264 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor

[GitHub] [incubator-seatunnel] CalvinKirs closed pull request #3269: Bump logback-core from 1.2.3 to 1.2.9

2022-11-13 Thread GitBox
CalvinKirs closed pull request #3269: Bump logback-core from 1.2.3 to 1.2.9 URL: https://github.com/apache/incubator-seatunnel/pull/3269 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #3394: [Feature][Connector V2] expose configurable options in Iceberg

2022-11-13 Thread GitBox
hailin0 commented on code in PR #3394: URL: https://github.com/apache/incubator-seatunnel/pull/3394#discussion_r1021050531 ## seatunnel-connectors-v2/connector-iceberg/src/main/java/org/apache/seatunnel/connectors/seatunnel/iceberg/config/CommonConfig.java: ## @@ -20,27 +20,62

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #3394: [Feature][Connector V2] expose configurable options in Iceberg

2022-11-13 Thread GitBox
hailin0 commented on code in PR #3394: URL: https://github.com/apache/incubator-seatunnel/pull/3394#discussion_r1021050531 ## seatunnel-connectors-v2/connector-iceberg/src/main/java/org/apache/seatunnel/connectors/seatunnel/iceberg/config/CommonConfig.java: ## @@ -20,27 +20,62

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #3418: [WIP][Engine]Support IMap File Storage

2022-11-13 Thread GitBox
hailin0 commented on code in PR #3418: URL: https://github.com/apache/incubator-seatunnel/pull/3418#discussion_r1021023999 ## seatunnel-engine/seatunnel-engine-storage/imap-storage-api/src/main/java/org/apache/seatunnel/engine/imap/storage/api/IMapStorage.java: ## @@ -0,0 +1,68

[incubator-seatunnel] branch dev updated (e454b80dc -> b85317bcb)

2022-11-13 Thread zongwen
This is an automated email from the ASF dual-hosted git repository. zongwen pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from e454b80dc [feature][Connector-v2][cdc] Add cdc base reader (#3407) add b85317bcb [feature][connector][

[GitHub] [incubator-seatunnel] ashulin merged pull request #3317: [Feature][Socket Connector V2] Add Socket Connector Option Rules

2022-11-13 Thread GitBox
ashulin merged PR #3317: URL: https://github.com/apache/incubator-seatunnel/pull/3317 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[incubator-seatunnel] branch dev updated (cc0cb8cdb -> e454b80dc)

2022-11-13 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from cc0cb8cdb [Feature][Connector-V2][Kafka] Add Kafka option rules (#3388) add e454b80dc [feature][Con

[GitHub] [incubator-seatunnel] EricJoy2048 merged pull request #3407: [feature][Connector-v2][cdc] Add cdc base reader

2022-11-13 Thread GitBox
EricJoy2048 merged PR #3407: URL: https://github.com/apache/incubator-seatunnel/pull/3407 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [incubator-seatunnel] ic4y commented on a diff in pull request #3226: [Feature][Connector-V2][Slack] Add Slack sink connector

2022-11-13 Thread GitBox
ic4y commented on code in PR #3226: URL: https://github.com/apache/incubator-seatunnel/pull/3226#discussion_r1021041320 ## seatunnel-connectors-v2/connector-slack/src/main/java/org/apache/seatunnel/connectors/seatunnel/config/SlackConfig.java: ## @@ -0,0 +1,46 @@ +/* + * Licens

[GitHub] [incubator-seatunnel] Hisoka-X commented on a diff in pull request #3390: [Improve][Connector-V2][My Hours]Add http method enum && Improve My Hours connector option rule

2022-11-13 Thread GitBox
Hisoka-X commented on code in PR #3390: URL: https://github.com/apache/incubator-seatunnel/pull/3390#discussion_r1021041128 ## seatunnel-connectors-v2/connector-http/connector-http-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/http/config/HttpConfig.java: ## @@ -

[GitHub] [incubator-seatunnel] Hisoka-X merged pull request #3388: [Feature][Connector-V2][Kafka] Add Kafka option rules

2022-11-13 Thread GitBox
Hisoka-X merged PR #3388: URL: https://github.com/apache/incubator-seatunnel/pull/3388 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr.

[incubator-seatunnel] branch dev updated: [Feature][Connector-V2][Kafka] Add Kafka option rules (#3388)

2022-11-13 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new cc0cb8cdb [Feature][Connector-V2][Kafka]

[incubator-seatunnel] branch dev updated (071f9aa05 -> 5d187f69b)

2022-11-13 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from 071f9aa05 [Bugfix][Connector-V2][StarRocks]Fix StarRocks StreamLoad retry bug and fix doc (#3406) add

[GitHub] [incubator-seatunnel] Hisoka-X merged pull request #3402: [Improve][Connector-V2][StarRocks]Add StarRocks connector option rules

2022-11-13 Thread GitBox
Hisoka-X merged PR #3402: URL: https://github.com/apache/incubator-seatunnel/pull/3402 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr.

[GitHub] [incubator-seatunnel] TaoZex commented on pull request #3390: [Improve][Connector-V2][My Hours]Add http method enum && Improve My Hours connector option rule

2022-11-13 Thread GitBox
TaoZex commented on PR #3390: URL: https://github.com/apache/incubator-seatunnel/pull/3390#issuecomment-1312978766 @EricJoy2048 @Hisoka-X PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [incubator-seatunnel] TaoZex commented on pull request #3388: [Feature][Connector-V2][Kafka] Add Kafka option rules

2022-11-13 Thread GitBox
TaoZex commented on PR #3388: URL: https://github.com/apache/incubator-seatunnel/pull/3388#issuecomment-1312977672 @Hisoka-X PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [incubator-seatunnel] TaoZex commented on pull request #3402: [Improve][Connector-V2][StarRocks]Add StarRocks connector option rules

2022-11-13 Thread GitBox
TaoZex commented on PR #3402: URL: https://github.com/apache/incubator-seatunnel/pull/3402#issuecomment-1312977070 @Hisoka-X PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [incubator-seatunnel] TaoZex commented on pull request #3346: [Feature][Connector-V2][Lemlist]Add Lemlist source connector

2022-11-13 Thread GitBox
TaoZex commented on PR #3346: URL: https://github.com/apache/incubator-seatunnel/pull/3346#issuecomment-1312975982 > Thanks, can you help add the e2e test > > reference #3340 Thanks. I have added e2e test.PTAL. -- This is an automated message from the Apache Git Service. To

[GitHub] [incubator-seatunnel] liugddx opened a new issue, #3420: [Feature][Deployment] add Helm for V2 connector

2022-11-13 Thread GitBox
liugddx opened a new issue, #3420: URL: https://github.com/apache/incubator-seatunnel/issues/3420 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requi

[GitHub] [incubator-seatunnel] ashulin opened a new pull request, #3419: [feature][connector][cdc] add CDC enumerator base classes

2022-11-13 Thread GitBox
ashulin opened a new pull request, #3419: URL: https://github.com/apache/incubator-seatunnel/pull/3419 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary p

[incubator-seatunnel] branch dev updated (91240a3dc -> 071f9aa05)

2022-11-13 Thread ic4y
This is an automated email from the ASF dual-hosted git repository. ic4y pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from 91240a3dc [Improve][Connector-V2][IotDB]Add IotDB sink parameter check (#3412) add 071f9aa05 [Bugfix][Co

[GitHub] [incubator-seatunnel] ic4y merged pull request #3406: [Bugfix][Connector-V2][StarRocks]Fix StarRocks StreamLoad retry bug and fix doc

2022-11-13 Thread GitBox
ic4y merged PR #3406: URL: https://github.com/apache/incubator-seatunnel/pull/3406 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@s

[GitHub] [incubator-seatunnel] ic4y commented on pull request #3406: [Bugfix][Connector-V2][StarRocks]Fix StarRocks StreamLoad retry bug and fix doc

2022-11-13 Thread GitBox
ic4y commented on PR #3406: URL: https://github.com/apache/incubator-seatunnel/pull/3406#issuecomment-1312960025 Nice work, you can also fix the e2e check row count by the way, or submit another pr to fix it. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-seatunnel] EricJoy2048 commented on a diff in pull request #3416: [Connector-V2] [Clickhouse] Improve Clickhouse File Connector

2022-11-13 Thread GitBox
EricJoy2048 commented on code in PR #3416: URL: https://github.com/apache/incubator-seatunnel/pull/3416#discussion_r1021025729 ## docs/en/connector-v2/sink/ClickhouseFile.md: ## @@ -122,3 +122,7 @@ Sink plugin common parameters, please refer to [Sink Common Options](common-opt

[GitHub] [incubator-seatunnel] FWLamb commented on a diff in pull request #3394: [Feature][Connector V2] expose configurable options in Iceberg

2022-11-13 Thread GitBox
FWLamb commented on code in PR #3394: URL: https://github.com/apache/incubator-seatunnel/pull/3394#discussion_r1021026820 ## seatunnel-connectors-v2/connector-iceberg/src/main/java/org/apache/seatunnel/connectors/seatunnel/iceberg/config/CommonConfig.java: ## @@ -20,27 +20,62 @

[GitHub] [incubator-seatunnel] liugddx commented on pull request #3408: [Feature][Connector V2] add gitlab source connector

2022-11-13 Thread GitBox
liugddx commented on PR #3408: URL: https://github.com/apache/incubator-seatunnel/pull/3408#issuecomment-1312957162 > The test of restful api focuses on request rules, not result parsing.Can we store keys in `Actions secrets` and replace them with config? https://docs.github.com/cn/actions

[GitHub] [incubator-seatunnel] EricJoy2048 commented on a diff in pull request #3394: [Feature][Connector V2] expose configurable options in Iceberg

2022-11-13 Thread GitBox
EricJoy2048 commented on code in PR #3394: URL: https://github.com/apache/incubator-seatunnel/pull/3394#discussion_r1021024433 ## seatunnel-connectors-v2/connector-iceberg/src/main/java/org/apache/seatunnel/connectors/seatunnel/iceberg/config/CommonConfig.java: ## @@ -20,27 +20

[incubator-seatunnel] branch dev updated: [Improve][Connector-V2][IotDB]Add IotDB sink parameter check (#3412)

2022-11-13 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 91240a3dc [Improve][Connector-V2][Iot

[GitHub] [incubator-seatunnel] EricJoy2048 merged pull request #3412: [Improve][Connector-V2][IotDB]Add IotDB sink parameter check

2022-11-13 Thread GitBox
EricJoy2048 merged PR #3412: URL: https://github.com/apache/incubator-seatunnel/pull/3412 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [incubator-seatunnel] Hisoka-X commented on a diff in pull request #3410: [Feature][Connector V2] expose configurable options in JDBC

2022-11-13 Thread GitBox
Hisoka-X commented on code in PR #3410: URL: https://github.com/apache/incubator-seatunnel/pull/3410#discussion_r1021021082 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/config/JdbcConfig.java: ## @@ -25,74 +27,74 @@ p

[GitHub] [incubator-seatunnel] FWLamb commented on a diff in pull request #3392: [Feature][Connector V2] Expose configurable options in influx db

2022-11-13 Thread GitBox
FWLamb commented on code in PR #3392: URL: https://github.com/apache/incubator-seatunnel/pull/3392#discussion_r1021019189 ## seatunnel-connectors-v2/connector-influxdb/src/main/java/org/apache/seatunnel/connectors/seatunnel/influxdb/sink/InfluxDBSinkFactory.java: ## @@ -0,0 +1,

[GitHub] [incubator-seatunnel] FWLamb commented on a diff in pull request #3392: [Feature][Connector V2] Expose configurable options in influx db

2022-11-13 Thread GitBox
FWLamb commented on code in PR #3392: URL: https://github.com/apache/incubator-seatunnel/pull/3392#discussion_r1021018973 ## seatunnel-connectors-v2/connector-influxdb/src/main/java/org/apache/seatunnel/connectors/seatunnel/influxdb/sink/InfluxDBSinkFactory.java: ## @@ -0,0 +1,

[GitHub] [incubator-seatunnel] 531651225 commented on a diff in pull request #3392: [Feature][Connector V2] Expose configurable options in influx db

2022-11-13 Thread GitBox
531651225 commented on code in PR #3392: URL: https://github.com/apache/incubator-seatunnel/pull/3392#discussion_r1021014526 ## docs/en/connector-v2/sink/InfluxDB.md: ## @@ -13,20 +13,21 @@ Write data to InfluxDB. ## Options -| name| type | requ

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3090: [Feature][doc] “env” lists all optional parameters

2022-11-13 Thread GitBox
github-actions[bot] commented on issue #3090: URL: https://github.com/apache/incubator-seatunnel/issues/3090#issuecomment-1312875481 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3095: [Bug] [seatunnel-connector-flink-jdbc] No suitable driver found for hive2

2022-11-13 Thread GitBox
github-actions[bot] commented on issue #3095: URL: https://github.com/apache/incubator-seatunnel/issues/3095#issuecomment-1312875461 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity

[GitHub] [incubator-seatunnel] CalvinKirs opened a new pull request, #3418: [Engine]Support IMap File Storage

2022-11-13 Thread GitBox
CalvinKirs opened a new pull request, #3418: URL: https://github.com/apache/incubator-seatunnel/pull/3418 #2557 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any

[GitHub] [incubator-seatunnel] CalvinKirs opened a new issue, #2557: [Engine][Storage-WAL]Storage system support K-V storage

2022-11-13 Thread GitBox
CalvinKirs opened a new issue, #2557: URL: https://github.com/apache/incubator-seatunnel/issues/2557 ## Abstract WAL (Write Ahead Logging) is generated due to the requirement of master node data storage persistence. We need to use the file system to complete the node data persistence.

[GitHub] [incubator-seatunnel] ashulin opened a new pull request, #3417: [feature][api] add option validation for the ReadonlyConfig

2022-11-13 Thread GitBox
ashulin opened a new pull request, #3417: URL: https://github.com/apache/incubator-seatunnel/pull/3417 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary p

[GitHub] [incubator-seatunnel] maruko-code commented on issue #2819: [Feature][ElasticSearch] Add Connector-V2 ElasticSearch sink e2e Test

2022-11-13 Thread GitBox
maruko-code commented on issue #2819: URL: https://github.com/apache/incubator-seatunnel/issues/2819#issuecomment-1312759391 I'm back -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [incubator-seatunnel] Hisoka-X commented on issue #2789: [Improve] [Connector-V2-Clickhouse] Improve Clickhouse Connector

2022-11-13 Thread GitBox
Hisoka-X commented on issue #2789: URL: https://github.com/apache/incubator-seatunnel/issues/2789#issuecomment-1312737251 Hi @wuxizhi777 Any new progress? If you need some help, please let us know. Thanks! -- This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [incubator-seatunnel] Hisoka-X opened a new pull request, #3416: [Connector-V2] [Clickhouse] Improve Clickhouse File Connector

2022-11-13 Thread GitBox
Hisoka-X opened a new pull request, #3416: URL: https://github.com/apache/incubator-seatunnel/pull/3416 ## Purpose of this pull request 1. Close #3242 2. Adjust ClickhouseFile sink to adapt to agg committer 3. Save memory ## Check list * [ ] Code changed ar

[GitHub] [incubator-seatunnel] nishuihanqiu commented on issue #875: [Feature]support latest version of Spark 3.2.0

2022-11-13 Thread GitBox
nishuihanqiu commented on issue #875: URL: https://github.com/apache/incubator-seatunnel/issues/875#issuecomment-1312735235 support spark3.20, spark3.1.2 and spark2.4.7, please see https://github.com/nishuihanqiu/incubator-seatunnel with branch 2.1.3-spark3, that is [2.1.3-spark3](https:/

[GitHub] [incubator-seatunnel] Hisoka-X commented on issue #3242: [Bug] [Clickhouse-File] clickhouse-file connector-v2 generated data part name conflict

2022-11-13 Thread GitBox
Hisoka-X commented on issue #3242: URL: https://github.com/apache/incubator-seatunnel/issues/3242#issuecomment-1312735094 I add random number on directory to fix it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [incubator-seatunnel] ttbbbb commented on issue #3415: Support paging read with `offset`

2022-11-13 Thread GitBox
tt commented on issue #3415: URL: https://github.com/apache/incubator-seatunnel/issues/3415#issuecomment-1312715982 please assign it to me, thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [incubator-seatunnel] monawang6 opened a new issue, #3414: [Feature][Module Name] Will future v2 connectors support more flink features?

2022-11-13 Thread GitBox
monawang6 opened a new issue, #3414: URL: https://github.com/apache/incubator-seatunnel/issues/3414 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature req

[GitHub] [incubator-seatunnel] Hisoka-X commented on a diff in pull request #3348: [Connector-V2] [Factory] Add Factory for AmazonDynamodb

2022-11-13 Thread GitBox
Hisoka-X commented on code in PR #3348: URL: https://github.com/apache/incubator-seatunnel/pull/3348#discussion_r1020883147 ## seatunnel-connectors-v2/connector-amazondynamodb/src/main/java/org/apache/seatunnel/connectors/seatunnel/amazondynamodb/source/AmazonDynamoDBSourceFactory.java

[GitHub] [incubator-seatunnel] ashulin commented on a diff in pull request #3348: [Connector-V2] [Factory] Add Factory for AmazonDynamodb

2022-11-13 Thread GitBox
ashulin commented on code in PR #3348: URL: https://github.com/apache/incubator-seatunnel/pull/3348#discussion_r1020882004 ## seatunnel-connectors-v2/connector-amazondynamodb/src/main/java/org/apache/seatunnel/connectors/seatunnel/amazondynamodb/source/AmazonDynamoDBSourceFactory.java:

[GitHub] [incubator-seatunnel] ashulin commented on a diff in pull request #3353: [Feature][API] add common options

2022-11-13 Thread GitBox
ashulin commented on code in PR #3353: URL: https://github.com/apache/incubator-seatunnel/pull/3353#discussion_r1020869216 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/factory/TableSinkFactory.java: ## @@ -32,11 +33,28 @@ /** * We will never use th

[GitHub] [incubator-seatunnel] ashulin commented on a diff in pull request #3353: [Feature][API] add common options

2022-11-13 Thread GitBox
ashulin commented on code in PR #3353: URL: https://github.com/apache/incubator-seatunnel/pull/3353#discussion_r1020869295 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/factory/TableSourceFactory.java: ## @@ -36,4 +37,21 @@ public interface TableSourceFactory ex

  1   2   >