[GitHub] [seatunnel] Hisoka-X merged pull request #4881: [Bug][doris] fix abort incorrect transaction label when load failed
Hisoka-X merged PR #4881: URL: https://github.com/apache/seatunnel/pull/4881 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[seatunnel] branch dev updated: [Bug][Connector-V2][Doris] update last checkpoint id when doing snapshot (#4881)
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 0360e7e51 [Bug][Connector-V2][Doris] update last checkpoint id when doing snapshot (#4881) 0360e7e51 is described below commit 0360e7e5185bd016458a20d3b597b4ccee83dfeb Author: gnehil AuthorDate: Sun Jun 4 23:15:32 2023 +0800 [Bug][Connector-V2][Doris] update last checkpoint id when doing snapshot (#4881) --- .../seatunnel/connectors/doris/sink/writer/DorisSinkWriter.java | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/sink/writer/DorisSinkWriter.java b/seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/sink/writer/DorisSinkWriter.java index ac0927f08..876a12f77 100644 --- a/seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/sink/writer/DorisSinkWriter.java +++ b/seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/sink/writer/DorisSinkWriter.java @@ -59,7 +59,7 @@ public class DorisSinkWriter implements SinkWriter DORIS_SUCCESS_STATUS = new ArrayList<>(Arrays.asList(LoadStatus.SUCCESS, LoadStatus.PUBLISH_TIMEOUT)); -private final long lastCheckpointId; +private long lastCheckpointId; private DorisStreamLoad dorisStreamLoad; volatile boolean loading; private final DorisConfig dorisConfig; @@ -156,7 +156,8 @@ public class DorisSinkWriter implements SinkWriter
[GitHub] [seatunnel] github-actions[bot] commented on issue #4706: [Bug] [Connector-v2] [pulsar-source] Unreasonable shutdown of consumer results in: `consumer not ready. State: Closed`
github-actions[bot] commented on issue #4706: URL: https://github.com/apache/seatunnel/issues/4706#issuecomment-1575859423 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [seatunnel] github-actions[bot] commented on issue #4684: org.apache.pulsar.client.impl.ConsumerImpl - [my-topic] [my-topic] Closed Consumer (not connected)
github-actions[bot] commented on issue #4684: URL: https://github.com/apache/seatunnel/issues/4684#issuecomment-1575859483 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [seatunnel] github-actions[bot] closed issue #4684: org.apache.pulsar.client.impl.ConsumerImpl - [my-topic] [my-topic] Closed Consumer (not connected)
github-actions[bot] closed issue #4684: org.apache.pulsar.client.impl.ConsumerImpl - [my-topic] [my-topic] Closed Consumer (not connected) URL: https://github.com/apache/seatunnel/issues/4684 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [seatunnel] github-actions[bot] commented on issue #4669: There is an issue with the data format supported by seatunnel's HTTP source
github-actions[bot] commented on issue #4669: URL: https://github.com/apache/seatunnel/issues/4669#issuecomment-1575859510 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [seatunnel] github-actions[bot] commented on issue #4656: [Bug] [connector-jdbc] Specify offline mode to execute discovery as a streaming task
github-actions[bot] commented on issue #4656: URL: https://github.com/apache/seatunnel/issues/4656#issuecomment-1575859564 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [seatunnel] github-actions[bot] closed issue #4656: [Bug] [connector-jdbc] Specify offline mode to execute discovery as a streaming task
github-actions[bot] closed issue #4656: [Bug] [connector-jdbc] Specify offline mode to execute discovery as a streaming task URL: https://github.com/apache/seatunnel/issues/4656 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [seatunnel] github-actions[bot] commented on issue #4649: [Feature][Connector][Http] Support multi-line text splits
github-actions[bot] commented on issue #4649: URL: https://github.com/apache/seatunnel/issues/4649#issuecomment-1575859637 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [seatunnel] zhilinli123 commented on a diff in pull request #4826: [Bug][flink-runtime][connectors-v2] Flink register table Environment The running mode is set to`job.mode`
zhilinli123 commented on code in PR #4826:
URL: https://github.com/apache/seatunnel/pull/4826#discussion_r1217329238
##
seatunnel-core/seatunnel-flink-starter/seatunnel-flink-starter-common/src/main/java/org/apache/seatunnel/core/starter/flink/execution/SourceExecuteProcessor.java:
##
@@ -71,13 +71,17 @@ public List> execute(List>
upstreamDataStreams)
} else {
sourceFunction = new SeaTunnelParallelSource(internalSource);
}
+boolean bounded =
+internalSource.getBoundedness()
+==
org.apache.seatunnel.api.source.Boundedness.BOUNDED
+? true
+: false;
Review Comment:
Done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [seatunnel] SinyoWong commented on issue #4451: [Bug] [Connector-hive-v2] can't get table from hive3.x by the seatunnel 2.3.1-release
SinyoWong commented on issue #4451: URL: https://github.com/apache/seatunnel/issues/4451#issuecomment-1575944718 Hi, big bro, we are searching for help! @TyrantLucifer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [seatunnel] nielifeng opened a new pull request, #4883: Update README.md
nielifeng opened a new pull request, #4883: URL: https://github.com/apache/seatunnel/pull/4883 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary package adding in your PR, please add License Notice according [New License Guide](https://github.com/apache/seatunnel/blob/dev/docs/en/contribution/new-license.md) * [ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/seatunnel/tree/dev/docs * [ ] If you are contributing the connector code, please check that the following files are updated: 1. Update change log that in connector document. For more details you can refer to [connector-v2](https://github.com/apache/seatunnel/tree/dev/docs/en/connector-v2) 2. Update [plugin-mapping.properties](https://github.com/apache/seatunnel/blob/dev/plugin-mapping.properties) and add new connector information in it 3. Update the pom file of [seatunnel-dist](https://github.com/apache/seatunnel/blob/dev/seatunnel-dist/pom.xml) * [ ] Update the [`release-note`](https://github.com/apache/seatunnel/blob/dev/release-note.md). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[seatunnel] 01/01: Update README.md
This is an automated email from the ASF dual-hosted git repository. nielifeng pushed a commit to branch nielifeng-patch-1 in repository https://gitbox.apache.org/repos/asf/seatunnel.git commit b4c0af811af315fa69067f6f2a3f23ca9f815aac Author: lifeng <53861852+nielif...@users.noreply.github.com> AuthorDate: Mon Jun 5 11:15:25 2023 +0800 Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index d9230f4d1..dd7aa33ba 100644 --- a/README.md +++ b/README.md @@ -1,4 +1,4 @@ -# Apache SeaTunnel (Incubating) +# Apache SeaTunnel https://seatunnel.apache.org/image/logo.png"; alt="seatunnel logo" height="200px" align="right" />
[seatunnel] branch nielifeng-patch-1 created (now b4c0af811)
This is an automated email from the ASF dual-hosted git repository. nielifeng pushed a change to branch nielifeng-patch-1 in repository https://gitbox.apache.org/repos/asf/seatunnel.git at b4c0af811 Update README.md This branch includes the following new commits: new b4c0af811 Update README.md The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[GitHub] [seatunnel] exxiang commented on issue #4879: [Bug] [seatunnel-connectors-v2] java.lang.NoClassDefFoundError: org/apache/spark/sql/connector/write/Write
exxiang commented on issue #4879: URL: https://github.com/apache/seatunnel/issues/4879#issuecomment-1575985522 Have you tried placing Spark's jar in the connectors directory？ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [seatunnel] MrLiuzy opened a new issue, #4884: with 2.3.1 run SeaTunnelEngineExample got Unrecognized client message received with type: 0xde0200
MrLiuzy opened a new issue, #4884: URL: https://github.com/apache/seatunnel/issues/4884 When run the example org.apache.seatunnel.example.engine.SeaTunnelEngineExample in seatunnel-engine-examples, I got the follow error: ``` 2023-06-05 11:26:23,709 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Fatal Error, 2023-06-05 11:26:23,709 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Please submit bug report in https://github.com/apache/incubator-seatunnel/issues 2023-06-05 11:26:23,709 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Reason:SeaTunnel job executed failed 2023-06-05 11:26:23,710 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Exception StackTrace:org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:181) at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40) at org.apache.seatunnel.example.engine.SeaTunnelEngineExample.main(SeaTunnelEngineExample.java:43) Caused by: java.util.concurrent.CompletionException: java.lang.UnsupportedOperationException: Unrecognized client message received with type: 0xde0200 at com.hazelcast.spi.impl.AbstractInvocationFuture.wrapInCompletionException(AbstractInvocationFuture.java:1347) at com.hazelcast.spi.impl.AbstractInvocationFuture.cascadeException(AbstractInvocationFuture.java:1340) at com.hazelcast.spi.impl.AbstractInvocationFuture.unblockApply(AbstractInvocationFuture.java:842) at com.hazelcast.spi.impl.AbstractInvocationFuture.thenApplyAsync(AbstractInvocationFuture.java:137) at com.hazelcast.client.impl.spi.impl.ClientInvocationFuture.thenApplyAsync(ClientInvocationFuture.java:116) at com.hazelcast.spi.impl.AbstractInvocationFuture.thenApply(AbstractInvocationFuture.java:123) at org.apache.seatunnel.engine.client.SeaTunnelHazelcastClient.requestAndGetCompletableFuture(SeaTunnelHazelcastClient.java:123) at org.apache.seatunnel.engine.client.SeaTunnelHazelcastClient.requestOnMasterAndGetCompletableFuture(SeaTunnelHazelcastClient.java:132) at org.apache.seatunnel.engine.client.job.ClientJobProxy.submitJob(ClientJobProxy.java:80) at org.apache.seatunnel.engine.client.job.ClientJobProxy.(ClientJobProxy.java:54) at org.apache.seatunnel.engine.client.job.JobClient.createJobProxy(JobClient.java:61) at org.apache.seatunnel.engine.client.job.JobExecutionEnvironment.execute(JobExecutionEnvironment.java:151) at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:140) ... 2 more Caused by: java.lang.UnsupportedOperationException: Unrecognized client message received with type: 0xde0200 at com.hazelcast.client.impl.protocol.task.NoSuchMessageTask.processMessage(NoSuchMessageTask.java:45) at com.hazelcast.client.impl.protocol.task.AbstractMessageTask.initializeAndProcessMessage(AbstractMessageTask.java:153) at com.hazelcast.client.impl.protocol.task.AbstractMessageTask.run(AbstractMessageTask.java:116) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) at com.hazelcast.internal.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:76) at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) 2023-06-05 11:26:23,710 ERROR org.apache.seatunnel.core.starter.SeaTunnel - === Exception in thread "main" org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:181) at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40) at org.apache.seatunnel.example.engine.SeaTunnelEngineExample.main(SeaTunnelEngineExample.java:43) Caused by: java.util.concurrent.CompletionException: java.lang.UnsupportedOperationException: Unrecognized client message received with type: 0xde0200 at com.hazelcast.spi.impl.AbstractInvocationFuture.wrapInCompletionException(AbstractInvocationFuture.java:1347) at com.hazelcast.spi.impl.AbstractInvocationFuture.cascadeException(AbstractInvocationFuture.java:1340) at com.hazelcast.spi.impl.AbstractInvocationFuture.unblockApply(AbstractInvocationFuture.java:842) at com.hazelcast.spi.impl.AbstractInvocationFuture.thenApplyAsync(AbstractInvocationFuture.java:137) at com.hazelcast.client.impl.spi.impl.ClientI
[GitHub] [seatunnel] 981433814 commented on issue #4879: [Bug] [seatunnel-connectors-v2] java.lang.NoClassDefFoundError: org/apache/spark/sql/connector/write/Write
981433814 commented on issue #4879: URL: https://github.com/apache/seatunnel/issues/4879#issuecomment-1575996095 I have tried putting spark-core and spark-sql under the seatunnel lib package and plugin, nothing works -- 原始邮件 -- 发件人: "apache/seatunnel" ***@***.***>; 发送时间: 2023年6月5日(星期一) 中午11:28 ***@***.***>; ***@***.**@***.***>; 主题: Re: [apache/seatunnel] [Bug] [seatunnel-connectors-v2] java.lang.NoClassDefFoundError: org/apache/spark/sql/connector/write/Write (Issue #4879) Have you tried placing Spark's jar in the connectors directory？ — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [seatunnel] exxiang commented on issue #4879: [Bug] [seatunnel-connectors-v2] java.lang.NoClassDefFoundError: org/apache/spark/sql/connector/write/Write
exxiang commented on issue #4879: URL: https://github.com/apache/seatunnel/issues/4879#issuecomment-1576075774 My version is apache-seatunnel-incubating-2.3.1 and spark-3.4.0-bin-hadoop3, my work is ok,You can try setting SPARK_HOME -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [seatunnel] Hisoka-X commented on pull request #4883: Update README.md
Hisoka-X commented on PR #4883: URL: https://github.com/apache/seatunnel/pull/4883#issuecomment-1576119227 This PR is replicate of #4882 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [seatunnel] Hisoka-X closed pull request #4883: Update README.md
Hisoka-X closed pull request #4883: Update README.md URL: https://github.com/apache/seatunnel/pull/4883 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [seatunnel] hailin0 merged pull request #4882: [Core][Docs]Remove incubator in README file
hailin0 merged PR #4882: URL: https://github.com/apache/seatunnel/pull/4882 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[seatunnel] branch dev updated (0360e7e51 -> 59d65d6ac)
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git from 0360e7e51 [Bug][Connector-V2][Doris] update last checkpoint id when doing snapshot (#4881) add 59d65d6ac [Hotfix][Zeta] Fix deploy operation timeout but task already finished bug (#4867) No new revisions were added by this update. Summary of changes: .../server/checkpoint/CheckpointCoordinator.java | 76 +- .../checkpoint/CheckpointCoordinatorStatus.java| 11 +++- .../server/checkpoint/CheckpointManager.java | 8 ++- .../engine/server/dag/physical/PhysicalVertex.java | 13 +++- .../seatunnel/engine/server/master/JobMaster.java | 3 +- .../server/scheduler/PipelineBaseScheduler.java| 4 -- .../engine/server/task/SeaTunnelTask.java | 3 +- .../server/task/SinkAggregatedCommitterTask.java | 3 +- .../server/task/SourceSplitEnumeratorTask.java | 3 +- .../server/checkpoint/CheckpointManagerTest.java | 4 +- 10 files changed, 111 insertions(+), 17 deletions(-)
[GitHub] [seatunnel] hailin0 merged pull request #4867: [Hotfix][Zeta] Fix deploy operation timeout but task already finished bug
hailin0 merged PR #4867: URL: https://github.com/apache/seatunnel/pull/4867 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[seatunnel] branch dev updated: [Core][Docs]Remove incubator in README file (#4882)
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new f4077cbbb [Core][Docs]Remove incubator in README file (#4882) f4077cbbb is described below commit f4077ce5ea518073ee0035134ba0890e52b7 Author: TaoZex <45089228+tao...@users.noreply.github.com> AuthorDate: Mon Jun 5 14:26:57 2023 +0800 [Core][Docs]Remove incubator in README file (#4882) --- README.md | 14 +++--- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/README.md b/README.md index d9230f4d1..f8eda8ea6 100644 --- a/README.md +++ b/README.md @@ -1,8 +1,8 @@ -# Apache SeaTunnel (Incubating) +# Apache SeaTunnel https://seatunnel.apache.org/image/logo.png"; alt="seatunnel logo" height="200px" align="right" /> -[](https://github.com/apache/incubator-seatunnel/actions/workflows/backend.yml) +[](https://github.com/apache/seatunnel/actions/workflows/backend.yml) [](https://the-asf.slack.com/archives/C053HND1D6X) [](https://twitter.com/ASFSeaTunnel) @@ -31,14 +31,14 @@ SeaTunnel focuses on data integration and data synchronization, and is mainly de ## Features of SeaTunnel - Rich and extensible Connector: SeaTunnel provides a Connector API that does not depend on a specific execution engine. Connectors (Source, Transform, Sink) developed based on this API can run on many different engines, such as SeaTunnel Engine, Flink, Spark that are currently supported. -- Connector plugin: The plugin design allows users to easily develop their own Connector and integrate it into the SeaTunnel project. Currently, SeaTunnel has supported more than 70 Connectors, and the number is surging. There is the list of connectors we [supported and plan to support](https://github.com/apache/incubator-seatunnel/issues/3018). +- Connector plugin: The plugin design allows users to easily develop their own Connector and integrate it into the SeaTunnel project. Currently, SeaTunnel has supported more than 70 Connectors, and the number is surging. There is the list of connectors we [supported and plan to support](https://github.com/apache/seatunnel/issues/3018). - Batch-stream integration: Connectors developed based on SeaTunnel Connector API are perfectly compatible with offline synchronization, real-time synchronization, full- synchronization, incremental synchronization and other scenarios. It greatly reduces the difficulty of managing data integration tasks. - Support distributed snapshot algorithm to ensure data consistency. - Multi-engine support: SeaTunnel uses SeaTunnel Engine for data synchronization by default. At the same time, SeaTunnel also supports the use of Flink or Spark as the execution engine of the Connector to adapt to the existing technical components of the enterprise. In addition, SeaTunnel supports multiple versions of Spark and Flink. - JDBC multiplexing, database log multi-table parsing: SeaTunnel supports multi-table or whole database synchronization, which solves the problem of over-JDBC connections; supports multi-table or whole database log reading and parsing, which solves the need for CDC multi-table synchronization scenarios problems with repeated reading and parsing of logs. - High throughput and low latency: SeaTunnel supports parallel reading and writing, providing stable and reliable data synchronization capabilities with high throughput and low latency. - Perfect real-time monitoring: SeaTunnel supports detailed monitoring information of each step in the data synchronization process, allowing users to easily understand the number of data, data size, QPS and other information read and written by the synchronization task. -- Two job development methods are supported: coding and canvas design. The SeaTunnel web project https://github.com/apache/incubator-seatunnel-web provides visual management of jobs, scheduling, running and monitoring capabilities. +- Two job development methods are supported: coding and canvas design. The SeaTunnel web project https://github.com/apache/seatunnel-web provides visual management of jobs, scheduling, running and monitoring capabilities. ## SeaTunnel work flowchart @@ -142,10 +142,10 @@ unacceptable behavior. ## Developer -Thanks to [all developers](https://github.com/apache/incubator-seatunnel/graphs/contributors)! +Thanks to [all developers](https://github.com/apache/seatunnel/graphs/contributors)! -https://github.com/apache/incub
