[GitHub] [incubator-seatunnel] hailin0 commented on pull request #4424: [Feature][API] Add options check before create source and sink in FactoryUtil

2023-03-26 Thread via GitHub
hailin0 commented on PR #4424: URL: https://github.com/apache/incubator-seatunnel/pull/4424#issuecomment-1484603107 check ci error -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [incubator-seatunnel] lightzhao commented on pull request #3990: [Improve][Connector][PulsarSource]Improve pulsar deserialization

2023-03-26 Thread via GitHub
lightzhao commented on PR #3990: URL: https://github.com/apache/incubator-seatunnel/pull/3990#issuecomment-1484598738 > Please fix ci Cannot perform ci check after update. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #4111: [Feature][Json-format] support read format for pulsar

2023-03-26 Thread via GitHub
hailin0 commented on code in PR #4111: URL: https://github.com/apache/incubator-seatunnel/pull/4111#discussion_r1148847900 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-pulsar-e2e/src/test/java/org/apache/seatunnel/e2e/connector/pulsar/CanalToPulsarIT.java: ## @@ -0,0 +

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #4111: [Feature][Json-format] support read format for pulsar

2023-03-26 Thread via GitHub
hailin0 commented on code in PR #4111: URL: https://github.com/apache/incubator-seatunnel/pull/4111#discussion_r1148812504 ## seatunnel-connectors-v2/connector-pulsar/pom.xml: ## @@ -100,5 +100,23 @@ + + +org.apache.

[GitHub] [incubator-seatunnel] hailin0 commented on a diff in pull request #3981: [Feature][connector][kafka] Support read debezium format message from kafka

2023-03-26 Thread via GitHub
hailin0 commented on code in PR #3981: URL: https://github.com/apache/incubator-seatunnel/pull/3981#discussion_r1126095803 ## seatunnel-formats/seatunnel-format-json/src/main/java/org/apache/seatunnel/format/json/debezium/DebeziumJsonDeserializationSchema.java: ## @@ -0,0 +1,15

[GitHub] [incubator-seatunnel] chenchurong commented on issue #4385: [Bug] [Connector-V2] Source Kafka

2023-03-26 Thread via GitHub
chenchurong commented on issue #4385: URL: https://github.com/apache/incubator-seatunnel/issues/4385#issuecomment-1484584791 > You can try seatunnel 2.3.1 and we fix it. excuse me ,can i only replace connector-kafka-2.3.0.jar to connector-kafka-2.3.1.jar ? -- This is an automated

[GitHub] [incubator-seatunnel] ic4y commented on issue #4403: [Bug] [connector-v2] [MySQL-CDC] The zeta engine is buggy in Cluster mode with MySQL-CDC as source and clickhouse as sink.

2023-03-26 Thread via GitHub
ic4y commented on issue #4403: URL: https://github.com/apache/incubator-seatunnel/issues/4403#issuecomment-1484582847 > @ic4y PTAL This issue has been fixed. It is recommended to use the latest dev branch for testing. -- This is an automated message from the Apache Git Service. To

[GitHub] [incubator-seatunnel] Hisoka-X commented on issue #4410: [Bug] [connectors-v2] ClickHouse to HIVE : java.io.UncheckedIOException: Failed to read column #10 of 601: state String

2023-03-26 Thread via GitHub
Hisoka-X commented on issue #4410: URL: https://github.com/apache/incubator-seatunnel/issues/4410#issuecomment-1484557325 This is bug from clickhouse jdbc https://github.com/ClickHouse/clickhouse-java/issues/976. Please check your server log. -- This is an automated message from the Apa

[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #4385: [Bug] [Connector-V2] Source Kafka

2023-03-26 Thread via GitHub
EricJoy2048 commented on issue #4385: URL: https://github.com/apache/incubator-seatunnel/issues/4385#issuecomment-1484540982 You can try seatunnel 2.3.1 and we fix it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #4388: how to read incremental data from source table and sink to sink table using apache seatunnel?

2023-03-26 Thread via GitHub
EricJoy2048 commented on issue #4388: URL: https://github.com/apache/incubator-seatunnel/issues/4388#issuecomment-1484539508 You can use CDC connector like MySQL CDC Source Connector https://seatunnel.incubator.apache.org/docs/connector-v2/source/MySQL-CDC. -- This is an automate

[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #4403: [Bug] [connector-v2] [MySQL-CDC] The zeta engine is buggy in Cluster mode with MySQL-CDC as source and clickhouse as sink.

2023-03-26 Thread via GitHub
EricJoy2048 commented on issue #4403: URL: https://github.com/apache/incubator-seatunnel/issues/4403#issuecomment-1484536190 @ic4y PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #4410: [Bug] [connectors-v2] ClickHouse to HIVE : java.io.UncheckedIOException: Failed to read column #10 of 601: state String

2023-03-26 Thread via GitHub
EricJoy2048 commented on issue #4410: URL: https://github.com/apache/incubator-seatunnel/issues/4410#issuecomment-1484535315 @Hisoka-X PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #4406: [Bug] [hdfs to s3] java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem not found

2023-03-26 Thread via GitHub
EricJoy2048 commented on issue #4406: URL: https://github.com/apache/incubator-seatunnel/issues/4406#issuecomment-1484533034 I suggest you use SeaTunnel 2.3.1 version , and there are more improve about S3File Sink and the document is clearer analysis https://seatunnel.incubator.apache.org/

[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #4406: [Bug] [hdfs to s3] java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem not found

2023-03-26 Thread via GitHub
EricJoy2048 commented on issue #4406: URL: https://github.com/apache/incubator-seatunnel/issues/4406#issuecomment-1484530404 > whne I add these jar to plugins,I got new error: `2023-03-24 11:36:34,319 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel (6914

[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #4406: [Bug] [hdfs to s3] java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem not found

2023-03-26 Thread via GitHub
EricJoy2048 commented on issue #4406: URL: https://github.com/apache/incubator-seatunnel/issues/4406#issuecomment-1484529531 Hi, please ensure the $SEATUNNEL_HOME/lib/ dir have this jars: https://user-images.githubusercontent.com/32193458/227850691-1877221d-5b6e-4f6d-ba4f-f42b9639b28b.png

[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #4409: [Feature request][V2sink-StarRocks/Doris] Ensure exactly-once semantics

2023-03-26 Thread via GitHub
EricJoy2048 commented on issue #4409: URL: https://github.com/apache/incubator-seatunnel/issues/4409#issuecomment-1484526548 I found some pull request about this feature https://github.com/apache/incubator-seatunnel/pull/3850. Only write data when checkpoint is a way to ensure exactly-once

[GitHub] [incubator-seatunnel] EricJoy2048 closed pull request #4418: [WIP]88 filter row kink catalog

2023-03-26 Thread via GitHub
EricJoy2048 closed pull request #4418: [WIP]88 filter row kink catalog URL: https://github.com/apache/incubator-seatunnel/pull/4418 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[incubator-seatunnel-website] branch add_apache_security_link updated (85c870f6bf -> c7749debf9)

2023-03-26 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a change to branch add_apache_security_link in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-website.git omit 85c870f6bf Add apache security link add c7749debf9 Add apache securit

[GitHub] [incubator-seatunnel] chaorongzhi commented on issue #3731: [Bug] [mysql-cdc] slave server-id conflict

2023-03-26 Thread via GitHub
chaorongzhi commented on issue #3731: URL: https://github.com/apache/incubator-seatunnel/issues/3731#issuecomment-1484401372 > @ashulin Has this issue been resolved? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on issue #4416: [Feature][Zeta][REST-API] Submit a job.

2023-03-26 Thread via GitHub
MonsterChenzhuo commented on issue #4416: URL: https://github.com/apache/incubator-seatunnel/issues/4416#issuecomment-1484399293 please assign to me; thx。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on issue #4417: [Feature][Zeta][REST-API] Stop a running job.

2023-03-26 Thread via GitHub
MonsterChenzhuo commented on issue #4417: URL: https://github.com/apache/incubator-seatunnel/issues/4417#issuecomment-1484399348 please assign to me; thx。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-seatunnel] lightzhao commented on pull request #4382: [Feature][Connector-v2][PulsarSink]Add Pulsar Sink Connector.

2023-03-26 Thread via GitHub
lightzhao commented on PR #4382: URL: https://github.com/apache/incubator-seatunnel/pull/4382#issuecomment-1484399309 Hello everyone, it has been running stably in the test environment for two weeks, who has time to help review. -- This is an automated message from the Apache Git Service

[incubator-seatunnel] branch dev updated: [hotfix][api] fixed generic class loss for lists (#4421)

2023-03-26 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 87505e66a [hotfix][api] fixed generic

[GitHub] [incubator-seatunnel] hailin0 merged pull request #4421: [Hotfix][API] Fix parse list option missing generics

2023-03-26 Thread via GitHub
hailin0 merged PR #4421: URL: https://github.com/apache/incubator-seatunnel/pull/4421 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[GitHub] [incubator-seatunnel] EricJoy2048 opened a new issue, #4425: [Feature][Transform] SQLTransform Support CatalogTable

2023-03-26 Thread via GitHub
EricJoy2048 opened a new issue, #4425: URL: https://github.com/apache/incubator-seatunnel/issues/4425 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature r

[incubator-seatunnel-website] branch add_apache_security_link updated (56440ae779 -> 85c870f6bf)

2023-03-26 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a change to branch add_apache_security_link in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-website.git discard 56440ae779 Add apache security link add 85c870f6bf Add apache securit

[GitHub] [incubator-seatunnel] chenchurong commented on issue #4385: [Bug] [Connector-V2] Source Kafka

2023-03-26 Thread via GitHub
chenchurong commented on issue #4385: URL: https://github.com/apache/incubator-seatunnel/issues/4385#issuecomment-1484336041 > Has the problem been solved?I meet it too in2.3.0 hi, has u soulved this problem ? -- This is an automated message from the Apache Git Service. To respond to t

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2347: [Feature]JDBC Savemode Supports replace

2023-03-26 Thread via GitHub
github-actions[bot] commented on issue #2347: URL: https://github.com/apache/incubator-seatunnel/issues/2347#issuecomment-1484291812 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity

[GitHub] [incubator-seatunnel] github-actions[bot] commented on pull request #3436: [Improve][Docs][Coding-Guide] Add a section that presents how to develop a high quality connector

2023-03-26 Thread via GitHub
github-actions[bot] commented on PR #3436: URL: https://github.com/apache/incubator-seatunnel/pull/3436#issuecomment-1484291776 This pull request has been automatically marked as stale because it has not had recent activity for 120 days. It will be closed in 7 days if no further activity o

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #4202: [Bug] [zeta] seatunnel cluster failed to submit the osstoclickhouse task

2023-03-26 Thread via GitHub
github-actions[bot] commented on issue #4202: URL: https://github.com/apache/incubator-seatunnel/issues/4202#issuecomment-1484291745 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity

[GitHub] [incubator-seatunnel] linyu003 commented on issue #4247: [Bug] [KafkaSink] Failed to write data due to opening transaction

2023-03-26 Thread via GitHub
linyu003 commented on issue #4247: URL: https://github.com/apache/incubator-seatunnel/issues/4247#issuecomment-1484169191 I am watching on this issue now. I have reproduced the problem by the config below. ``` env { execution.parallelism = 1 job.mode = "STREAMING"

[GitHub] [incubator-seatunnel-website] dependabot[bot] commented on pull request #214: Bump webpack from 5.69.1 to 5.76.1

2023-03-26 Thread via GitHub
dependabot[bot] commented on PR #214: URL: https://github.com/apache/incubator-seatunnel-website/pull/214#issuecomment-1484135429 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or

[GitHub] [incubator-seatunnel-website] TyrantLucifer closed pull request #214: Bump webpack from 5.69.1 to 5.76.1

2023-03-26 Thread via GitHub
TyrantLucifer closed pull request #214: Bump webpack from 5.69.1 to 5.76.1 URL: https://github.com/apache/incubator-seatunnel-website/pull/214 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [incubator-seatunnel] ashulin opened a new pull request, #4421: [hotfix][api] fixed generic class loss for lists

2023-03-26 Thread via GitHub
ashulin opened a new pull request, #4421: URL: https://github.com/apache/incubator-seatunnel/pull/4421 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary p

[GitHub] [incubator-seatunnel] EricJoy2048 closed pull request #4419: Revert "[Feature][API] Add copy method to Catalog codes"

2023-03-26 Thread via GitHub
EricJoy2048 closed pull request #4419: Revert "[Feature][API] Add copy method to Catalog codes" URL: https://github.com/apache/incubator-seatunnel/pull/4419 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-seatunnel] sonarcloud[bot] commented on pull request #4419: Revert "[Feature][API] Add copy method to Catalog codes"

2023-03-26 Thread via GitHub
sonarcloud[bot] commented on PR #4419: URL: https://github.com/apache/incubator-seatunnel/pull/4419#issuecomment-1484074279 Kudos, SonarCloud Quality Gate passed!    [![Quality Gate passed](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/QualityGateBadge/passed-16

[incubator-seatunnel] branch revert-4414-91_add_copy_method created (now 9a53f7ef0)

2023-03-26 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a change to branch revert-4414-91_add_copy_method in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git at 9a53f7ef0 Revert "[Feature][API] Add copy method to Catalog codes (#4414)"

[GitHub] [incubator-seatunnel] EricJoy2048 opened a new pull request, #4419: Revert "[Feature][API] Add copy method to Catalog codes"

2023-03-26 Thread via GitHub
EricJoy2048 opened a new pull request, #4419: URL: https://github.com/apache/incubator-seatunnel/pull/4419 Reverts apache/incubator-seatunnel#4414 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [incubator-seatunnel] kpretty commented on pull request #4233: [Fix][Connector-V2][ES]source deserializer error and inappropriate

2023-03-26 Thread via GitHub
kpretty commented on PR #4233: URL: https://github.com/apache/incubator-seatunnel/pull/4233#issuecomment-1484066225 @iture123 there is indeed a problem, I have moved the logic of timestamp processing into `parseDate` -- This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-seatunnel] EricJoy2048 closed pull request #4393: [WIP]86 catalog split transform

2023-03-26 Thread via GitHub
EricJoy2048 closed pull request #4393: [WIP]86 catalog split transform URL: https://github.com/apache/incubator-seatunnel/pull/4393 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[incubator-seatunnel] branch dev updated: [Feature][API] Add copy method to Catalog codes (#4414)

2023-03-26 Thread liugddx
This is an automated email from the ASF dual-hosted git repository. liugddx pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new b8c6bbd1e [Feature][API] Add copy method

[GitHub] [incubator-seatunnel] liugddx merged pull request #4414: [Feature][API] Add copy method to Catalog codes

2023-03-26 Thread via GitHub
liugddx merged PR #4414: URL: https://github.com/apache/incubator-seatunnel/pull/4414 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[incubator-seatunnel-website] branch add_apache_security_link created (now 56440ae779)

2023-03-26 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a change to branch add_apache_security_link in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-website.git at 56440ae779 Add apache security link This branch includes the following ne

[incubator-seatunnel-website] 01/01: Add apache security link

2023-03-26 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch add_apache_security_link in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-website.git commit 56440ae7792f43f061451a50e92eed007bb48461 Author: gaojun AuthorDate: Sun Mar

[GitHub] [incubator-seatunnel] kpretty closed pull request #4233: [Fix][Connector-V2][ES]source deserializer error and inappropriate

2023-03-26 Thread via GitHub
kpretty closed pull request #4233: [Fix][Connector-V2][ES]source deserializer error and inappropriate URL: https://github.com/apache/incubator-seatunnel/pull/4233 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [incubator-seatunnel-website] TyrantLucifer merged pull request #218: [Release][2.3.1] Add release 2.3.1 docs

2023-03-26 Thread via GitHub
TyrantLucifer merged PR #218: URL: https://github.com/apache/incubator-seatunnel-website/pull/218 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commit

[incubator-seatunnel-web] branch main updated: [Feature] Add README and fix some bugs (#46)

2023-03-26 Thread songjian
This is an automated email from the ASF dual-hosted git repository. songjian pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-web.git The following commit(s) were added to refs/heads/main by this push: new 61bfaca1 [Feature] Add README and

[GitHub] [incubator-seatunnel-web] songjianet merged pull request #46: [Feature] Add README and fix some bugs

2023-03-26 Thread via GitHub
songjianet merged PR #46: URL: https://github.com/apache/incubator-seatunnel-web/pull/46 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [incubator-seatunnel-web] TyrantLucifer opened a new pull request, #46: [Feature] Add README and fix some bugs

2023-03-26 Thread via GitHub
TyrantLucifer opened a new pull request, #46: URL: https://github.com/apache/incubator-seatunnel-web/pull/46 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar bi