This is an automated email from the ASF dual-hosted git repository.
fanjia pushed a commit to branch 2.3.6-release
in repository https://gitbox.apache.org/repos/asf/seatunnel.git
commit 0017b8ef5ec385fe11ec0361aaf003ac43c6326c
Author: Jia Fan <fanjiaemi...@qq.com>
AuthorDate: Fri Jul 26 10:51:36 2024 +0800
[Release][2.3.6][release-note] Add release-note
---
.gitignore | 2 -
release-note.md | 429 +++++++++++++++++++++++++++++---------------------------
2 files changed, 222 insertions(+), 209 deletions(-)
diff --git a/.gitignore b/.gitignore
index c8732a4acf..309fa38cd5 100644
--- a/.gitignore
+++ b/.gitignore
@@ -48,8 +48,6 @@ test.conf
spark-warehouse
*.flattened-pom.xml
-seatunnel-examples
-
# vscode
.vscode
diff --git a/release-note.md b/release-note.md
index 32067c22df..389e55786d 100644
--- a/release-note.md
+++ b/release-note.md
@@ -1,233 +1,248 @@
-# next-release
+# 2.3.6 Release Note
## Bug fix
### Core
-- [Core] [API] Fixed generic class loss for lists (#4421)
-- [Core] [API] Fix parse nested row data type key changed upper (#4459)
-- [Starter][Flink]Support transform-v2 for flink #3396
-- [Flink] Support flink 1.14.x #3963
-- [Core][Translation][Spark] Fix SeaTunnelRowConvertor fail to convert when
schema contains row type (#5170)
+- [Fix][Flink]Hotfix flink checkpoint default value (#7040)
+- [Hotfix][Core] Fix the NullPointException for the json config of the job
without pluginname (#6815)
+- [Fix][Dist] Remove aws jar dependency in release package (#7257)
-### Transformer
-- [Spark] Support transform-v2 for spark (#3409)
-- [ALL]Add FieldMapper Transform #3781
-- [All]Add JsonPath Transform #5633
### Connectors
-- [Elasticsearch] Support https protocol & compatible with opensearch
-- [Hbase] Add hbase sink connector #4049
-- [Clickhouse] Fix clickhouse old version compatibility #5326
-- [Easysearch] Support INFINI Easysearch #5933
-- [Web3j] add Web3j source connector #6598
-### Formats
-- [Canal]Support read canal format message #3950
-- [Debezium]Support debezium canal format message #3981
-
-### Connector-V2
-
-- [Json-format] [Canal-Json] Fix json deserialize NPE (#4195)
-- [Connector-V2] [Jdbc] Field aliases are not supported in the query of jdbc
source. (#4210)
-- [Connector-V2] [Jdbc] Fix connection failure caused by connection timeout.
(#4322)
-- [Connector-V2] [Jdbc] Set default value to false of JdbcOption:
generate_sink_sql (#4471)
-- [Connector-V2] [JDBC] Fix TiDBCatalog without open (#4718)
-- [Connector-V2] [Jdbc] Fix XA DataSource crash(Oracle/Dameng/SqlServer)
(#4866)
-- [Connector-V2] [Pulsar] Fix the bug that can't consume messages all the
time. (#4125)
-- [Connector-V2] [Eleasticsearch] Document description error (#4390)
-- [Connector-V2] [Eleasticsearch] Source deserializer error and inappropriate
(#4233)
-- [Connector-V2] [Kafka] Fix KafkaProducer resources have never been released.
(#4302)
-- [Connector-V2] [Kafka] Fix the permission problem caused by client.id.
(#4246)
-- [Connector-V2] [Kafka] Fix KafkaConsumerThread exit caused by commit offset
error. (#4379)
-- [Connector-V2] [Mongodb] Mongodb support cdc sink. (#4833)
-- [Connector-V2] [kafka] Fix the problem that the partition information can
not be obtained when kafka is restored (#4764)
-- [Connector-V2] [SFTP] Fix incorrect exception handling logic (#4720)
-- [Connector-V2] [File] Fix read temp file (#4876)
-- [Connector-V2] [CDC Base] Solving the ConcurrentModificationException caused
by snapshotState being modified concurrently. (#4877)
-- [Connector-V2] [Doris] update last checkpoint id when doing snapshot (#4881)
-- [Connector-v2] [kafka] Fix the short interval of pull data settings and
revise the format (#4875)
-- [Connector-v2] [RabbitMQ] Fix reduplicate ack msg bug and code style (#4842)
-- [Connector-V2] [Jdbc] Fix the error of extracting primary key column in sink
(#4815)
-- [Connector-V2] [Jdbc] Fix reconnect throw close statement exception (#4801)
-- [Connector-V2] [Jdbc] Fix sqlserver system table case sensitivity (#4806)
-- [Connector-v2] [File] Fix configuration file format and error comments
(#4762)
-- [Connector-v2] [Jdbc] Fix oracle sql table identifier (#4754)
-- [Connector-v2] [Clickhouse] fix get clickhouse local table name with closing
bracket from distributed table engineFull (#4710)
-- [Connector-v2] [CDC] Fix jdbc connection leak for mysql (#5037)
-- [Connector-v2] [File] Fix WriteStrategy parallel writing thread unsafe issue
#5546
-- [Connector-v2] [File] Inject FileSystem to OrcWriteStrategy
-- [Connector-v2] [File] Support assign encoding for file source/sink (#5973)
-- [Connector-v2] [Mongodb] Support to convert to double from numeric type that
mongodb saved it as numeric internally (#6997)
-- [Connector-v2] [Redis] Using scan replace keys operation command,support
batchWrite in single mode(#7030,#7085)
-- [Connector-V2] [Clickhouse] Add a new optional configuration
`clickhouse.config` to the source connector of ClickHouse (#7143)
+- [Fix][Connector-V2] The isNullable attribute is true when the primary key
field in the Paimon table converts the Column object. #7231 (#7242)
+- [Fix][Connector kafka]Fix Kafka consumer stop fetching after TM node
restarted (#7233)
+- [Fix] Fix Hana type converter decimal scale is 0 convert to int error (#7167)
+- [BugFix][Connector-V2][Maxcompute]fix:Maxcompute sink can't map field(#7164)
(#7168)
+- [Fix][Connector-V2] Fix kafka batch mode can not read all message (#7135)
+- [Fix][Connector-V2][Elasticsearch]Fix sink configuration for DROP_DATA
(#7124)
+- [Fix][Connector-V2][CDC] SeaTunnelRowDebeziumDeserializationConverters NPE
(#7119)
+- [Hotfix][Connector-V2] fix rabbit checkpoint exception in Flink mode (#7108)
+- [Fix][Connector-V2] Fix starrocks Content-Length header already present
error (#7034)
+- [Hotfix][MySQL-CDC] Fix read gbk varchar chinese garbled characters (#7046)
+- [Hotfix][Hive Connector] Fix Hive hdfs-site.xml and hive-site.xml not be
load error (#7069)
+- [Fix] hive load hive_site_path and hdfs_site_path too late (#7017)
+- [Fix] fix pgsql create table comment special string bug (#7022)
+- [Fix] Fix `plugin_config` (#7104)
+- [connector-jdbc][bugfix] fix sqlServer create table comment special string
bug (#7024)
+- [connector-jdbc][bugfix] fix oracle create table comment special string bug
(#7012)
+- [Hotfix][CDC] Fix split schema change stream (#7003)
+- [bugfix] fix mysql create table comment special string bug (#6998)
+- [Paimon]support projection for paimon source (#6343)
+- [bugfix][connector-mongodb] fix mongodb null value write (#6967)
+- [Hotfix][Connector-V2][kafka]Kafka consumer group automatically commits
offset logic error fix (#6961)
+- [Bug] [connector-hive] Eanble login with kerberos for hive (#6893)
+- [Bug][Connector-Iceberg]fix create iceberg v2 table with pks (#6895)
+- [Fix] correct the typo of kudu kerberos config (#6905)
+- [Hotfix][Connector-V2] Close the tableWrite when task is close (#6897)
+- [Fix][Connector-V2] Field information lost during Paimon DataType and
SeaTunnel Column conversion (#6767)
+- [Hotfix][Connector-V2] Fix the batch write with paimon (#6865)
+- [Hotfix][Jdbc] Fix oracle savemode create table (#6651)
+- [bugFix][Connector-V2][Doris] The multi-FE configuration is supported (#6341)
+- [Hotfix][Postgres-CDC/OpenGauss-CDC] Fix read data missing when restore
(#6785)
+- [Fix] Fix HttpSource bug (#6824)
+- [Hotfix][Jdbc/CDC] Fix postgresql uuid type in jdbc read (#6684)
+- [Hotfix][Dist] Add oracle cdc (#6818)
+- [Fix] fix Debezium conf "key_convert_schemas.enable" set false lead to
nullPointException (#6809)
+- [Fix][MySQL]: Fix MySqlTypeConverter could not be instantiated (#6781)
+- [Fix][Connector-V2] Remove Some Incorrect Comments and Properties in
ElasticsearchCommitInfo
+- [Hotfix][Jdbc] Fix table/query columns order merge for jdbc catalog (#6771)
+- [Fix][KuduCatalogFactory]: Fix KuduCatalogFactory.optionRule() will throw an
Exception (#6787)
+- [Bug Fix] Sink Doris error status(#6753) (#6755)
+- [Bug][Improve][Connector-v2][ElasticsearchSource] Fix behavior when source
empty，Support SourceConfig.SOURCE field empty. (#6425)
+- [Fix] Fix Oracle type converter handle negative scale in number type (#6758)
+- [HiveSink]Fix the risk of resource leakage. (#6721)
+- [bigfix][S3 File]:Change the [SCHEMA] attribute of the [S3CONF class] to be
non-static to avoid being reassigned after deserialization (#6717)
+- [Fix][Connector-v2] Fix the sql statement error of create table for doris
and starrocks (#6679)
+- [Fix][connector-rocketmq] commit a correct offset to broker & reduce
ThreadInterruptedException log (#6668)
+- [Fix][Connector-V2] Fix doris TRANSFER_ENCODING header error (#7267)
-### Zeta(ST-Engine)
+### Transformer
+- [Fix][Transform] Fix sql transform lose source type and options (#6855)
-- [Zeta] Fix LogicalDagGeneratorTest testcase (#4401)
-- [Zeta] Fix MultipleTableJobConfigParser parse only one transform (#4412)
-- [Zeta] Fix missing common plugin jars (#4448)
-- [Zeta] Fix handleCheckpointError be called while checkpoint already complete
(#4442)
-- [Zeta] Fix job error message is not right bug (#4463)
-- [Zeta] Fix finding TaskGroup deployment node bug (#4449)
-- [Zeta] Fix the bug of conf (#4488)
-- [Zeta] Fix Connector load logic from zeta (#4510)
-- [Zeta] Fix conflict dependency of hadoop-hdfs (#4509)
-- [Zeta] Fix TaskExecutionService synchronized lock will not release (#4886)
-- [Zeta] Fix TaskExecutionService will return not active ExecutionContext
(#4869)
-- [Zeta] Fix deploy operation timeout but task already finished bug (#4867)
-- [Zeta] Fix restoreComplete Future can't be completed when cancel task (#4863)
-- [Zeta] Fix IMap operation timeout bug (#4859)
-- [Zeta] fix pipeline state not right bug (#4823)
-- [Zeta] Fix the incorrect setting of transform parallelism (#4814)
-- [Zeta] Fix master active bug (#4855)
-- [Zeta] Fix completePendingCheckpoint concurrent action (#4854)
-- [Zeta] Fix engine runtime error (#4850)
-- [Zeta] Fix TaskGroupContext always hold classloader so classloader can't
recycle (#4849)
-- [Zeta] Fix task `notifyTaskStatusToMaster` failed when job not running or
failed before run (#4847)
-- [Zeta] Fix cpu load problem (#4828)
-- [zeta] Fix the deadlock issue with JDBC driver loading (#4878)
-- [zeta] dynamically replace the value of the variable at runtime (#4950)
-- [Zeta] Add from_unixtime function (#5462)
-- [zeta] Fix CDC task restore throw NPE (#5507)
+### Zeta(ST-Engine)
+- [Hotfix][Zeta] Fix taskgroup failed log lost (#7241)
+- [Fix][Zeta] Fix release slot resource twice (#7236)
+- [Fix][Zeta] Fix hybrid deployment can not get worker when init (#7235)
+- [HotFix] [Remote Debug] Description When remote debug is enabled, the
Seatunel Server 5801 port is not listening properly (#7206)
+- [Fix][RestApi] Fix hazelcast/rest/maps/submit-job return a wrong jobId
(#7154)
+- [Hotfix][Zeta] Fix that batch tasks cannot be stopped after retrying (#7083)
+- [Fix][Zeta] Fix env jars not working on zeta (#7035)
+- [Fix] revert IMAP cache data field type to compatible with old version
(#7001)
+- [Hotfix][Zeta] Fix `generate_client_protocol.sh` (#6991)
+- [Hotfix][Zeta] Fix job crash when schema changing on multiple parallel
readers (#6977)
+- [Fix] Fix Metrics lost data bug (#6976)
+- [Hotfix][Zeta] Fix okhttp connection leak in event reporter (#6945)
+- [Fix] Fix job will never cancel success when JobMaster init not complete
(#6885)
+- [Hotfix][Zeta] Fix savepoint execute result (#6850)
+- [Fix][Zeta] Increase the log level when waitForJobComplete fails (#6827)
+- [Fix] Fix MultiTableWriterRunnable can not catch Throwable error (#6734)
+- [HotFix][zeta]: Fix loss job (#6759) (#6807)
+- [fix][zeta] fix can't release resource issue (#6763)
+- [Fix][Script] Fix lose jvm option when jvm_options file not end with `\n`
(#6693)
### E2E
-
-- [E2E] [Kafka] Fix kafka e2e testcase (#4520)
-- [Container Version] Fix risk of unreproducible test cases #4591
-- [E2e] [Mysql-cdc] Removing the excess MySqlIncrementalSourceIT e2e reduces
the CI time (#4738)
-- [E2E] [Common] Update test container version of seatunnel engine (#5323)
-- [E2E] [Jdbc] Fix not remove docker image after test finish on jdbc suite
(#5586)
+- [Fix][E2E] Fix classloader number (#7209)
+- [CI] Fix k8s engine it not runs when only test case changed (#7122)
+- [Fix] Fix iceberg e2e image tag (#7189)
+- [CI][Test] Fix engine-k8s-it failed (#7101)
+- [CI] connector-kafka-e2e , connector-rocketmq-e2e module runs repeatedly
#7090 (#7091)
+- [E2E][HBase]Refactor hbase e2e (#6859)
+- [Fix] Fix ConnectorSpecificationCheckTest failed (#6828)
+- [CI] Fix FixSlotResourceTest testNotEnoughResource test error (#6820)
## Improve
-- [Improve][Connector-V2][Jdbc-Source] Support for Decimal types as splict
keys (#4634)
-
### Core
+- [Improve][Core] Move MultiTableSink to seatunnel-api module (#7243)
+- [Improve] Bump org.xerial.snappy:snappy-java (#7144)
+- [Improve] delete log for protect user privacy (#6987)
+- [Improve][Log] Auto refresh log configuration (#6915)
+- [Improve] [shell] Set the env SEATUNNEL_HOME automatically (#6924)
+- [Improve] Optimize log display during startup command (#6816)
-- [Core] [Spark] Push transform operation from Spark Driver to Executors
(#4503)
-- [Core] [Starter] Optimize code structure & remove redundant code (#4525)
-- [Core] [Translation] [Flink] Optimize code structure & remove redundant code
(#4527)
-- [Core] [Starter] Add check of sink and source config to avoid null pointer
exception. (#4734)
-- [Core] [Flink] Remove useless stage type related codes. (#5650)
-
-### Formats
-
-- [Json] Remove assert key word. (#5919)
-- [Formats] Replace CommonErrorCodeDeprecated.JSON_OPERATION_FAILED. (#5948)
-- [Formats] Refactor exception catch for `ignoreParseErrors`. (#6065)
-
-### Connector-V2
-
-- [Connector-V2] [CDC] Improve startup.mode/stop.mode options (#4360)
-- [Connector-V2] [CDC] Optimize jdbc fetch-size options (#4352)
-- [Connector-V2] [CDC] Fix chunk start/end parameter type error (#4777)
-- [Connector-V2] [SQLServer] Fix sqlserver catalog (#4441)
-- [Connector-V2] [StarRocks] Improve StarRocks Serialize Error Message (#4458)
-- [Connector-V2] [Jdbc] add the log for sql and update some style (#4475)
-- [Connector-V2] [Jdbc] Fix the table name is not automatically obtained when
multiple tables (#4514)
-- [Connector-V2] [S3 & Kafka] Delete unavailable S3 & Kafka Catalogs (#4477)
-- [Connector-V2] [Pulsar] Support Canal Format
-- [Connector-V2] [CDC base] Implement Sample-based Sharding Strategy with
Configurable Sampling Rate (#4856)
-- [Connector-V2] [SelectDB] Add a jobId to the selectDB label to distinguish
between tasks (#4864)
-- [Connector-V2] [Doris] Add a jobId to the doris label to distinguish between
tasks (#4839) (#4853)
-- [Connector-v2] [Mongodb]Refactor mongodb connector (#4620)
-- [Connector-v2] [Jdbc] Populate primary key when jdbc sink is created using
CatalogTable (#4755)
-- [Connector-v2] [Neo4j] Supports neo4j sink batch write mode (#4835)
-- [Transform-V2] Optimize SQL Transform package and Fix Spark type conversion
bug of transform (#4490)
-- [Connector-V2] [Common] Remove assert key word (#5915)
-- [Connector-V2] Replace CommonErrorCodeDeprecated.JSON_OPERATION_FAILED.
(#5978)
-
-### CI
+### Connectors
+- [Improve][Doris Connector] Unified serialization method,Use
RowToJsonConverter and TextSerializationSchema (#7229)
+- [Improve][Jdbc] Support write unicode text into sqlserver (#7159)
+- [Improve] Improve error message when can not parse datetime value (#7181)
+- [Improve][Hive] Close resources when exception occurs (#7205)
+- [Improve][Jdbc] Remove user info in catalog-table options (#7178)
+- [Improve][Connector-V2] Add support for MySQL 8.4 (#7151)
+- [Improve][hbase] The specified column is written to the specified column
family (#5234)
+- [Improve] Change catalog table log to debug level (#7136)
+- [Improve][Connector-V2] Support schema evolution for mysql-cdc and
mysql-jdbc (#6929)
+- [Improve][Redis] Redis reader use scan cammnd instead of keys, single mode
reader/writer support batch (#7087)
+- [Improve][Connector-V2][MongoDB] Support to convert to double from any
numeric type (#6997)
+- [Improve][[Jdbc]sink sql support custom field.(#6515) (#6525)
+- [Improve][Connector-V2][Iceberg] Add hadoop s3 catalog e2e testcase (#5745)
+- [Improve][Connector-V2] Clean key name in catalog table (#6942)
+- [Improve][File Connector]Improve xml read code & fix can not use true for a
boolean option (#6930)
+- [Improve][Files] Support write fixed/timestamp as int96 of parquet (#6971)
+- [Improve][Paimon] Add check for the base type between source and sink before
write. (#6953)
+- [Improve][Connector-V2] Improve the paimon source (#6887)
+- [Improve] Make ClickhouseFileSinker support tables containing materialized
columns (#6956)
+- [Improve][Jdbc] Quotes the identifier for table path (#6951)
+- [Improve][CDC] Bump the version of debezium to 1.9.8.Final (#6740)
+- [Improve][Connector-V2] Support hive catalog for paimon sink (#6833)
+- [Improve][CDC] Close idle subtasks gorup(reader/writer) in increment phase
(#6526)
+- [Improve][JDBC Source] Fix Split can not be cancel (#6825)
+- [Improve] Add conditional of start.mode with timestamp in mongo cdc option
rule (#6770)
+- [Improve] Improve doris create table template default value (#6720)
+- [Improve] [Clickhouse] Remove check when set
allow_experimental_lightweight_delete false(#6727) (#6728)
+- [Improve] Improve read table schema in cdc connector (#6702)
+- [Improve][mysql-cdc] Fallback to desc table when show create table failed
(#6701)
+- [Improve][Connector-v2] The hive connector support multiple filesystem
(#6648)
+- [Improve][Hive] udpate hive3 version (#6699)
+- [Improve][mysql-cdc] Support mysql 5.5 versions (#6710)
+- [Improve] Update aws-java-sdk-budle version to fix job can not run bug
+- [Improve] Improve doris stream load client side error message (#6688)
+- [Improve][Connector] Add some sqlserver IDENTITY type for catalog (#6822)
+- [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and
oracle-cdc (#7248)
-- [CI] Fix error repository name in ci config files (#4795)
-- [CI][E2E][Zeta] Increase Zeta checkpoint timeout to avoid
connector-file-sftp-e2e failed frequently (#5339)
+### Transformer
+- [Improve][Transform-V2] Remove SQL query validation on table name (#7020)
### Zeta(ST-Engine)
+- [Improve][Restapi] Add ip and port to monitoring information (#7203)
+- [Improve][Zeta] Add check for submit duplicate job id (#7021)
+- [Improve][Zeta] Add retry when request slot on resource manager (#7049)
+- [Improve][Zeta] Fix JobMaster reset app classloader twice (#7063)
+- [Improve][Engine] Support custom job id for rest-api named submit-job (#7053)
+- [Improve][Zeta] Clean checkpoint file when job FINISHED/CANCELED (#6938)
+- [Improve][Zeta] Support close idle task for multiple sinks (#6864)
+- [Improve][Zeta] Move SaveMode behavior to master (#6843)
+- [Improve] Add custom job id arg in client (#6943)
+- [Improve][Zeta] when job finished, the checkpoint won't write to file (#6674)
+
+### CI
+- [Improve][CI] Add milvus to label (#7186)
+- [Improve][CI] Add auto label action (#7174)
+- [Improve][E2E][Doris] Add no schema test case for connector-doris-e2e (#7076)
+- [Improve] enable iceberg schema change test (#6711)
-- [Zeta] Support run the server through daemon mode (#4161)
-- [Zeta] Change ClassLoader To Improve the SDK compatibility of the client
(#4447)
-- [Zeta] Client Support Async Submit Job (#4456)
-- [Zeta] Add more detailed log output. (#4446)
-- [Zeta] Improve seatunnel-cluster.sh (#4435)
-- [Zeta] Reduce CPU Cost When Task Not Ready (#4479)
-- [Zeta] Add parser log (#4485)
-- [Zeta] Remove redundant code (#4489)
-- [Zeta] Remove redundancy code in validateSQL (#4506)
-- [Zeta] Improve JobMetrics fetch performance (#4467)
-- [Zeta] Reduce the operation count of imap_running_job_metrics (#4861)
-- [Zeta] Speed up listAllJob function (#4852)
-- [Zeta] async execute checkpoint trigger and other block method (#4846)
-- [Zeta] Reduce the number of IMAPs used by checkpointIdCounter (#4832)
-- [Zeta] Cancel pipeline add retry to avoid cancel failed. (#4792)
-- [Zeta] Improve Zeta operation max count and ignore NPE (#4787)
-- [Zeta] Remove serialize(deserialize) cost when use shuffle action (#4722)
-- [zeta] Checkpoint exception status messages exclude state data (#5547)
-- [Zeta] Remove assert key words (#5947)
+### OTHER
+- [Chore] remove useless codes (#7110)
+- [Typo] typo the hint of savemode execution location (#7100)
+- [Chore] remove useless interface (#6746)
## Feature
### Core
+- [Feature][Core] Support using upstream table placeholders in sink options
and auto replacement (#7131)
+- [Feature][Core] Add a test case for dynamic custom parameters (#7128)
+- [Feature][SQL Config] Add SQL config adapter (#6757)
+- [Feature][starter] support user define parameter on spark/flink engine
(#6387)
-- [Core] [API] Support convert strings as List<T> option (#4362)
-- [Core] [API] Add copy method to Catalog codes (#4414)
-- [Core] [API] Add options check before create source and sink and transform
in FactoryUtil (#4424)
-- [Core] [Shade] Add guava shade module (#4358)
-- [Core] [Spark] Support SeaTunnel Time Type (#5188)
-- [Core] [Flink] Support Decimal Type with configurable precision and scale
(#5419)
-- [Core] [API] Support hocon style declare row type in generic type (#6187)
-
-### Connector-V2
-
-- [Connector-V2] [CDC] [SQLServer] Support multi-table read (#4377)
-- [Connector-V2] [Kafka] Kafka source supports data deserialization failure
skipping (#4364)
-- [Connector-V2] [Jdbc] [TiDB] Add TiDB catalog (#4438)
-- [Connector-V2] [File] Add file excel sink and source (#4164)
-- [Connector-V2] [FILE-OBS] Add Huawei Cloud OBS connector (#4577)
-- [Connector-v2] [Snowflake] Add Snowflake Source&Sink connector (#4470)
-- [Connector-V2] [Pular] support read format for pulsar (#4111)
-- [Connector-V2] [Paimon] Introduce paimon connector (#4178)
-- [Connector V2] [Cassandra] Expose configurable options in Cassandra (#3681)
-- [Connector V2] [Jdbc] Supports GEOMETRY data type for PostgreSQL (#4673)
-- [Connector V2] [Jdbc] Supports Kingbase database (#4803)
-- [Transform-V2] Add UDF SPI and an example implement for SQL Transform plugin
(#4392)
-- [Transform-V2] Support copy field list (#4404)
-- [Transform-V2] Add support CatalogTable for FieldMapperTransform (#4423)
-- [Transform-V2] Add CatalogTable support for ReplaceTransform (#4411)
-- [Transform-V2] Add Catalog support for FilterRowKindTransform (#4420)
-- [Transform-V2] Add support CatalogTable for FilterFieldTransform (#4422)
-- [Transform-V2] Add catalog support for SQL Transform plugin (#4819)
-- [Connector-V2] [Assert] Support check the precision and scale of Decimal
type (#6110)
-- [Connector-V2] [Assert] Support field type assert and field value equality
assert for full data types (#6275)
-- [Connector-V2] [Iceberg] Support iceberg sink #6198
-- [Connector-V2] [FILE-OBS] Add Huawei Cloud OBS connector #4578
+### Connectors
+- [Feature][Connector-V2][Milvus] Support Milvus source & sink (#7158)
+- [Feature][Connector-V2] [Hudi]Add hudi sink connector (#4405)
+- [Feature][Connector-V2] Support jdbc hana catalog and type convertor (#6950)
+- [Feature][Connector-V2][Clickhouse] Add clickhouse.config to the source
connector (#7143)
+- [feature][Connector-file-local] add save mode function for localfile (#7080)
+- [feature][connector-v2-hbase-sink] Support Connector v2 HBase sink TTL data
writing (#7116)
+- [Feature][connector][kafka] Support read Maxwell format message from kafka
#4415 (#4428)
+- [Feature][Elasticsearch] Support multi-table sink write #7041 (#7052)
+- [Feature][Druid]Support multi table for druid sink (#7023)
+- [Feature][Connector] Add druid sink connector (#6346)
+- [Feature][Connector-V2] Add Huawei Cloud OBS connector (#4578)
+- [Feature][Jdbc] Support redshift catalog (#6992)
+- [Feature][Connector-V2] Supports the transfer of any file (#6826)
+- [Feature][Kafka] Support multi-table source read (#5992)
+- [Feature][S3 File] Make S3 File Connector support multiple table write
(#6698)
+- [Feature][Doris] Add Doris type converter (#6354)
+- [Feature][Jdbc] Support the jdbc connector for InterSystems IRIS (#6797)
+- [Feature][Connector-V2] Iceberg-sink supports writing data to branches
(#6697)
+- [Feature][Connector-V2] Add web3j source connector (#6598)
+- [Feature][Connector-V2]Support StarRocks Fe Node HA
+- [Feature] Hive Source/Sink support multiple table (#5929)
+- [Connector]Add hbase source connector (#6348)
+- [Feature][Jdbc] Support hive compatibleMode add inceptor dialect (#7262)
-### Zeta(ST-Engine)
+### Transformer
+- [Feature][Transform] DynamicCompile add transform (#7170)
+- [Feature][Transform-V2 Filter] support exclude columns in the filter
transform (#6960)
+- [Feature][Transforms] Support is_date function of sql (#6966)
-- [Zeta] Support for mixing Factory and Plugin SPI (#4359)
-- [Zeta] Add get running job info by jobId rest api (#4140)
-- [Zeta] Add REST API To Get System Monitoring Information (#4315)
-- [Transform V2 & Zeta] Make SplitTransform Support CatalogTable And
CatalogTable Evolution (#4396)
-- [Zeta] Move driver into lib directory and change operation count (#4845)
-- [Zeta] Add Metaspace size default value to config file (#4848)
-- [Zeta] Reduce the frequency of fetching data from imap (#4851)
-- [Zeta] Add OSS support for Imap storage to cluster-mode type (#4683)
-- [Zeta] Improve local mode startup request ports (#4660)
-
-## Docs
-
-- [Docs] Optimizes part of the Doris and SelectDB connector documentation
(#4365)
-- [Docs] Fix docs code style (#4368)
-- [Docs] Update jdbc doc and kafka doc (#4380)
-- [Docs] Fix max_retries default value is 0. (#4383)
-- [Docs] Fix markdown syntax (#4426)
-- [Docs] Fix Kafka Doc Error Config Key "kafka." (#4427)
-- [Docs] Add Transform to Quick Start v2 (#4436)
-- [Docs] Fix Dockerfile and seatunnel-flink.yaml in Set Up with Kubernetes
(#4788)
-- [Docs] Fix Mysql sink format doc (#4800)
-- [Docs] Add the generate sink sql parameter for the jdbc sink document (#4797)
-- [Docs] Add the generate sink sql parameter And example (#4769)
-- [Docs] Redshift add defaultRowFetchSize (#4616)
-- [Docs] Refactor connector-v2 docs using unified format Mysql (#4590)
-- [Docs] Add Value types in Java to Schema features (#5087)
-- [Docs] Replace username by user in the options of FtpFile (#5421)
-- [Docs] Add how to configure logging related parameters of SeaTunnel-E2E Test
(#5589)
-- [Docs] Remove redundant double quotation mark from an example code (#5845)
-- [Docs] Add Hive JDBC reference value (#5882)
+### Zeta(ST-Engine)
+- [Feature][RestAPI] overview support tag filter (#7173)
+- [Feature][Zeta] Add Master and Worker split mode deployment (#6947)
+- [Feature][Zeta] Add tag to node used to filter worker when submit job (#7045)
+- [Feature][RestAPI] Add overview api (#6883)
+- [Feature][Engine] Change the name of the rest-api interface for returning
job info (#6813)
+- [feature][CheckPoint-stroage]:Added Disable cache configuration. (#6718)
+- [Feature][Zeta] Added the metrics information of table statistics in
multi-table mode (#7212)
+
+## Docs
+- [Improve][Doc] Add IMap OSS config jars into document (#7029)
+- [Chore][NOTICE] Correct year in NOTICE file (#7232)
+- [Docs] Update engine related docs info (#7228)
+- [Doc] hdfs file doc correct (#7216)
+- [Docs] Update contribution and readme related docs info (#7188)
+- [Docs] Update transform about and faq related docs info (#7187)
+- [Docs]translate clickhousefile,phoenix,rabbitmq,starrocks sink doc into
chinese (#7015)
+- [Docs] Update concept related docs info (#7184)
+- [Docs] Update quick start v2 related docs info (#7161)
+- [Docs][connector-sink] add Docs connector v2 sink (#7097)
+- [Docs] update rest-api doc (#7111)
+- [Doc] correct the document (#7099)
+- [Doc] Add engine start parameter explanation (#7062)
+- [Doc] Fix sink jdbc doc (#6459)
+- [Doc] fix HdfsFile demo config (#6921)
+- [Doc][Improve] connector-v2 clickhouse/hbase/pulsar sink support chinese
(#6811)
+- [Doc][Improve] doris sink support chinese (#6803)
+- [Doc][improve] update Connector-v2-release-state (#6801)
+- [ci][doc] Update node version (#6796)
+- [Doc][Improve] Support chinese for sinks (#6663)
+- [Doc][Improve] Remove unnecessary commas to make sentences smoother (#6783)
+- [Doc][Improvement] Add Support Chinese for Config-Encryption-Decryption.md
(#6715)
+- [Doc][Improve] Intro the multi-line text feature in document (#6713)
+- [Improve][Document] Fix Postgre to PostgreSQL in Postgre-CDC.md file (#7112)
+- [Improve][Doc] Improve DingTalk doc (#7075)
+- [Improve][Doc] Fix snowflake jdbc url with emoji (#7061)
+- [Hotfix][DOC] Fix invalid links (#7018)
+- [Feature][doc][Connector-V2][Common] Add Common connector documentation
(#5453)
+- [Document] fix starrocks doc demo config (#6918)
+- [Hotfix][Docs] Unified debezium document addresses point to debezium github
to prevent dead links (#6892)
+- [Fix][DOC] Fix doc tip and caution (#6839)
+- [Improve][Doc] Add sql-config doc into sidebars.js (#6836)
+- [Improve] Update doris sink template default value in doc (#6810)
+- [fix][doc] fix dead link (#6764)
+- [Improve][Zeta] add document for Minio as checkpoint storage for zeta tasks
(#6732)
