This is an automated email from the ASF dual-hosted git repository.
dockerzhang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/inlong.git
The following commit(s) were added to refs/heads/master by this push:
new f1854029c [INLONG-7964][Release] Update changes log for the 1.7.0
version (#7974)
f1854029c is described below
commit f1854029c62c3ea467195e9492e8707a266dcf12
Author: Charles Zhang <dockerzh...@apache.org>
AuthorDate: Tue May 9 10:57:39 2023 +0800
[INLONG-7964][Release] Update changes log for the 1.7.0 version (#7974)
---
CHANGES.md | 694 ++++++++++++++-----------------------------------------------
1 file changed, 161 insertions(+), 533 deletions(-)
diff --git a/CHANGES.md b/CHANGES.md
index 302d6a381..6861df5b5 100644
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -21,551 +21,179 @@
# of release header or remove the below marker. This file is generated.
# DO NOT REMOVE THIS MARKER; FOR INTERPOLATING CHANGES!-->
-# Release InLong 1.6.0 - Released (as of 2023-03-16)
+# Release InLong 1.7.0 - Released (as of 2023-05-16)
### Agent
-| ISSUE | Summary
|
-|:------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------|
-| [INLONG-7548](https://github.com/apache/inlong/issues/7548) |
[Improve][Agent][Manager] Use try-with-resource to close resources
|
-| [INLONG-7533](https://github.com/apache/inlong/issues/7533) |
[Improve][Agent] Log cannot be collected for position reset
|
-| [INLONG-7516](https://github.com/apache/inlong/issues/7516) |
[Improve][Manager][Sort][Agent] Decoupling Flink version dependencies for
multiple versions of Apache Flink |
-| [INLONG-7419](https://github.com/apache/inlong/issues/7419) | [Bug][Agent]
The connector of MQTT is unable to connect
|
-| [INLONG-7404](https://github.com/apache/inlong/issues/7404) | [Bug][Agent]
Missing Redis job for Redis connector
|
-| [INLONG-7387](https://github.com/apache/inlong/issues/7387) | [Bug][Agent]
The connector of SQLServer is closed
|
-| [INLONG-7365](https://github.com/apache/inlong/issues/7365) | [Bug][Agent]
The username for the MongoDB connector is missing
|
-| [INLONG-7353](https://github.com/apache/inlong/issues/7353) | [Bug][Agent]
The connector of PostgreSQL is closed
|
-| [INLONG-7322](https://github.com/apache/inlong/issues/7322) | [Bug][Agent]
The archived logs cannot be collected
|
-| [INLONG-7174](https://github.com/apache/inlong/issues/7174) |
[Feature][Agent] Support converting DataConfig to TriggerProfile for PostgreSQL
|
-| [INLONG-7156](https://github.com/apache/inlong/issues/7156) |
[Improve][Agent] Support directly sending raw file data
|
+| ISSUE | Summary
|
+|:-----------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------|
+| [INLONG-7847](https://github.com/apache/inlong/issues/7847) | [Bug][Agent]
Failed to create MySQL reader
|
+| [INLONG-7783](https://github.com/apache/inlong/issues/7783) |
[Feature][Agent] Support sink data tor Kafka
|
+| [INLONG-7752](https://github.com/apache/inlong/issues/7752) | [Bug][Agent]
PulsarSink threadPool throw reject exception
|
### DataProxy
-| ISSUE | Summary
|
-|:------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------|
-| [INLONG-7513](https://github.com/apache/inlong/issues/7513) |
[Improve][DataProxy] Delete duplicate definitions
|
-| [INLONG-7231](https://github.com/apache/inlong/issues/7231) |
[Feature][DataProxy] Add selector policy of cache cluster list
|
-| [INLONG-7191](https://github.com/apache/inlong/issues/7191) |
[Improve][DataProxy] Remove unused code
|
-| [INLONG-7166](https://github.com/apache/inlong/issues/7166) |
[Bug][DataProxy] Fix audit data report
|
+| ISSUE | Summary
|
+|:-----------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------|
+| [INLONG-7931](https://github.com/apache/inlong/issues/7931) |
[Improve][DataProxy] Optimize common.properties related control mechanism
|
+| [INLONG-7898](https://github.com/apache/inlong/issues/7898) |
[Improve][DataProxy] Clean up useless configuration files in the ConfigManager
class |
+| [INLONG-7769](https://github.com/apache/inlong/issues/7769) |
[Bug][DataProxy] NPE when request Inlong Manager failed
|
+| [INLONG-7512](https://github.com/apache/inlong/issues/7512) |
[Improve][DataProxy] Update the metrics log level to avoid the log file
increasing quickly |
+| [INLONG-7766](https://github.com/apache/inlong/issues/7766) |
[Bug][DataProxySDK] Adjusted frame length exceeds occurred when reporting data
through the HTTP protocol |
+| [INLONG-7194](https://github.com/apache/inlong/issues/7194) |
[Improve][DataProxy] Migrate index log statistics for the new mq layer
|
### TubeMQ
-| ISSUE | Summary
|
-|:------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------|
-| [INLONG-7466](https://github.com/apache/inlong/issues/7466) |
[Improve][TubeMQ] Adjust code style issues
|
-| [INLONG-7430](https://github.com/apache/inlong/issues/7430) | [Bug][TubeMQ]
Zookeeper caught an NPE when deploying TubeMQ by K8s
|
-| [INLONG-7184](https://github.com/apache/inlong/issues/7184) |
[Improve][TubeMQ] Replace CertifiedResult with ProcessResult
|
-| [INLONG-7182](https://github.com/apache/inlong/issues/7182) |
[Improve][TubeMQ] Replace ParamCheckResult with ProcessResult
|
+| ISSUE | Summary
|
+|:-----------------------------------------------------------:|:---------------------------------------------------------------------|
+| [INLONG-7926](https://github.com/apache/inlong/issues/7926) |
[Feature][TubeMQ] Add ""Register2Master"" method for GO SDK " |
### Manager
-| ISSUE | Summary
|
-|:------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------|
-| [INLONG-7593](https://github.com/apache/inlong/issues/7593) |
[Bug][Manager] Unable to delete InlongGroup
|
-| [INLONG-7591](https://github.com/apache/inlong/issues/7591) |
[Improve][Manager] Support updating related streamSources after updating
DataNode |
-| [INLONG-7586](https://github.com/apache/inlong/issues/7586) |
[Bug][Manager] The audit information in the database cannot be obtained after
being updated |
-| [INLONG-7577](https://github.com/apache/inlong/issues/7577) |
[Bug][Manager] The number of StreamSource is too large, resulting in high CPU
usage |
-| [INLONG-7575](https://github.com/apache/inlong/issues/7575) |
[Improve][Manager] Add audit_base table change script of 1.6.0 for Manager
|
-| [INLONG-7565](https://github.com/apache/inlong/issues/7565) |
[Improve][Manager] Add audit id for Apache Kudu
|
-| [INLONG-7555](https://github.com/apache/inlong/issues/7555) |
[Bug][Manager] The ttl time is invalid in ClickHouse
|
-| [INLONG-7548](https://github.com/apache/inlong/issues/7548) |
[Improve][Agent][Manager] Use try-with-resource to close resources
|
-| [INLONG-7535](https://github.com/apache/inlong/issues/7535) |
[Bug][Manager] Optimize the serializationType setting to prevent
NullPointerException |
-| [INLONG-7529](https://github.com/apache/inlong/issues/7529) |
[Improve][Manager] Change the pattern limitation of InlongGroupId and
InlongStreamId |
-| [INLONG-7525](https://github.com/apache/inlong/issues/7525) |
[Improve][Manager] Support to save additional info for the ClickHouse field
|
-| [INLONG-7516](https://github.com/apache/inlong/issues/7516) |
[Improve][Manager][Sort][Agent] Decoupling Flink version dependencies for
multiple versions of Apache Flink |
-| [INLONG-7501](https://github.com/apache/inlong/issues/7501) |
[Bug][Manager] InlongStream status is not updated after InlongGroup
configuration is successful |
-| [INLONG-7496](https://github.com/apache/inlong/issues/7496) |
[Improve][Manager] Add parseFields method for manager-client
|
-| [INLONG-7490](https://github.com/apache/inlong/issues/7490) |
[Improve][Manager] Support paging query InLong objects info based on conditions
in manager-client |
-| [INLONG-7479](https://github.com/apache/inlong/issues/7479) |
[Bug][Manager] The stream can still be configured under the failed group
|
-| [INLONG-7473](https://github.com/apache/inlong/issues/7473) |
[Bug][Manager] StreamSource in the TO_BE_ISSUED_DELETE state cannot be issued
properly |
-| [INLONG-7468](https://github.com/apache/inlong/issues/7468) |
[Bug][Manager] Re-executing the workflow fails to load the new configuration
information |
-| [INLONG-7460](https://github.com/apache/inlong/issues/7460) |
[Improve][Manager] Add user authentication when operate Datanode
|
-| [INLONG-7444](https://github.com/apache/inlong/issues/7444) |
[Improve][Manager] Support query InLong objects by status list
|
-| [INLONG-7429](https://github.com/apache/inlong/issues/7429) |
[Bug][Manager] The information returned when deleting a non-existent
StreamSource is incorrect |
-| [INLONG-7426](https://github.com/apache/inlong/issues/7426) |
[Improve][Manager] Improve the accuracy of variable naming for MySQLSinkDTO
|
-| [INLONG-7421](https://github.com/apache/inlong/issues/7421) |
[Improve][Manager] Add encoding check to the MySQL JDBC URL in MySQLDataNode
|
-| [INLONG-7415](https://github.com/apache/inlong/issues/7415) |
[Feature][Dashboard][Manager] Creating schema of StreamSource by JSON
|
-| [INLONG-7406](https://github.com/apache/inlong/issues/7406) |
[Improve][Manager] Add the query criteria for streamSource
|
-| [INLONG-7401](https://github.com/apache/inlong/issues/7401) |
[Bug][Manager] Cannot create Pulsar partitions based on numPartitions
|
-| [INLONG-7395](https://github.com/apache/inlong/issues/7395) |
[Improve][Manager] Reduce log in SortSouceService and SortClusterService
|
-| [INLONG-7389](https://github.com/apache/inlong/issues/7389) |
[Improve][Manager][Sort] Add audit id info for source
|
-| [INLONG-7375](https://github.com/apache/inlong/issues/7375) |
[Improve][Manager] Change the pattern limitation of InlongCluster name
|
-| [INLONG-7373](https://github.com/apache/inlong/issues/7373) |
[Improve][Manager] Change the length limitation of InlongStreamId
|
-| [INLONG-7358](https://github.com/apache/inlong/issues/7358) |
[Improve][Manager] Ungraceful Import of Util Tool Classes
|
-| [INLONG-7355](https://github.com/apache/inlong/issues/7355) |
[Bug][Manager] HiveDataNode cannot save the dataPath
|
-| [INLONG-7337](https://github.com/apache/inlong/issues/7337) |
[Bug][Manager] Test Pulsar connection error
|
-| [INLONG-7334](https://github.com/apache/inlong/issues/7334) |
[Feature][Manager] Support stream join dimension table
|
-| [INLONG-7332](https://github.com/apache/inlong/issues/7332) |
[Improve][Manager] Improve the field length in SQL files
|
-| [INLONG-7331](https://github.com/apache/inlong/issues/7331) |
[Improve][Sort][Manager] Support complex type field
|
-| [INLONG-7328](https://github.com/apache/inlong/issues/7328) |
[Bug][Manager] Error in querying audit info
|
-| [INLONG-7325](https://github.com/apache/inlong/issues/7325) |
[Bug][Manager] The topic name format error of Kafka
|
-| [INLONG-7317](https://github.com/apache/inlong/issues/7317) |
[Bug][Manager] Unit tests of Manager threw database not found
|
-| [INLONG-7310](https://github.com/apache/inlong/issues/7310) |
[Bug][Manager] Unit tests of Manager threw too many AuthenticationException
|
-| [INLONG-7300](https://github.com/apache/inlong/issues/7300) |
[Improve][Manager] Replace getRoles() with getAccountType()
|
-| [INLONG-7299](https://github.com/apache/inlong/issues/7299) |
[Feature][Sort][Manager] Support InLongMsg in KafkaConnector
|
-| [INLONG-7294](https://github.com/apache/inlong/issues/7294) |
[Bug][Manager] Failed to suspend, restart and delete Sort task
|
-| [INLONG-7284](https://github.com/apache/inlong/issues/7284) |
[Improve][Manager] Use Preconditions.expectNotBlank to check whether a string
is null |
-| [INLONG-7280](https://github.com/apache/inlong/issues/7280) |
[Improve][Manager] rename checkXXX to expectXXX in Preconditions
|
-| [INLONG-7278](https://github.com/apache/inlong/issues/7278) |
[Improve][Manager] Optimize OpenInLongClusterController implementation
|
-| [INLONG-7275](https://github.com/apache/inlong/issues/7275) |
[Bug][Manager] The specified plugin path does not take effect
|
-| [INLONG-7271](https://github.com/apache/inlong/issues/7271) |
[Feature][Manager] Support comma separation for primary key and partition key
of Hudi table |
-| [INLONG-7265](https://github.com/apache/inlong/issues/7265) |
[Feature][Manager] Support register and manage the resource of Kudu sink
|
-| [INLONG-7261](https://github.com/apache/inlong/issues/7261) |
[Improve][Manager] Optimize OpenStreamTransformController implementation
|
-| [INLONG-7256](https://github.com/apache/inlong/issues/7256) |
[Bug][Manager] The test connection address is wrong, but it shows success
|
-| [INLONG-7254](https://github.com/apache/inlong/issues/7254) |
[Bug][Manager] Fix config error when InlongGroupId is in the process of
switching |
-| [INLONG-7242](https://github.com/apache/inlong/issues/7242) |
[Feature][Manager] Support register and manage the resource of Redis
|
-| [INLONG-7232](https://github.com/apache/inlong/issues/7232) |
[Improve][Manager] Supports automatic management of audit ids
|
-| [INLONG-7229](https://github.com/apache/inlong/issues/7229) |
[Improve][Manager] Add checks for unmodifiable field values
|
-| [INLONG-7226](https://github.com/apache/inlong/issues/7226) |
[Improve][Manager] Optimize OpenStreamSourceController implementation
|
-| [INLONG-7222](https://github.com/apache/inlong/issues/7222) |
[Improve][Manager] Decode the MySQL JDBC URL thoroughly
|
-| [INLONG-7220](https://github.com/apache/inlong/issues/7220) |
[Improve][Manager] Optimize OpenStreamSinkController implementation
|
-| [INLONG-7213](https://github.com/apache/inlong/issues/7213) |
[Improve][Manager] Add encoding check to the MySQL JDBC URL
|
-| [INLONG-7206](https://github.com/apache/inlong/issues/7206) |
[Bug][Manager] The selectBriefList method in the InlongGroupEntity.xml file is
incorrect |
-| [INLONG-7204](https://github.com/apache/inlong/issues/7204) |
[Improve][Manager] Optimize OpenInLongStreamController implementation
|
-| [INLONG-7199](https://github.com/apache/inlong/issues/7199) |
[Improve][Manager] Support save extension params for inlong cluster node
|
-| [INLONG-7178](https://github.com/apache/inlong/issues/7178) |
[Improve][Manager] Optimize OpenInLongGroupController implementation
|
-| [INLONG-7169](https://github.com/apache/inlong/issues/7169) |
[Improve][Manager] Optimize OpenDataNodeController implementation
|
-| [INLONG-7151](https://github.com/apache/inlong/issues/7151) |
[Bug][Manager] Init sort faild when create node
|
-| [INLONG-7149](https://github.com/apache/inlong/issues/7149) |
[Bug][Manager] The tableName parameter in ClickHouseLoadNode is incorrect
|
-| [INLONG-7089](https://github.com/apache/inlong/issues/7089) |
[Improve][Manager] Separate the concept of node tag from the node table and
extract the concept of task group |
-| [INLONG-7030](https://github.com/apache/inlong/issues/7030) |
[Feature][Manager] Build tool for local debugging environment
|
-| [INLONG-7616](https://github.com/apache/inlong/issues/7616) |
[Bug][Manager]Failed to obtain audit information
|
-| [INLONG-7273](https://github.com/apache/inlong/issues/7273) |
[Feature][Manager] Support creating table in Kudu cluster
|
+| ISSUE | Summary
|
+|:-----------------------------------------------------------:|:-----------------------------------------------------------------------------------------------|
+| [INLONG-7948](https://github.com/apache/inlong/issues/7948) |
[Improve][Manager] Add user authentication when operate inlong consume
|
+| [INLONG-7946](https://github.com/apache/inlong/issues/7946) |
[Improve][Manager] Add user authentication when bind clusterTag
|
+| [INLONG-7941](https://github.com/apache/inlong/issues/7941) |
[Improve][Manager][Dashborad] Query group to distinguish lightweight
|
+| [INLONG-7940](https://github.com/apache/inlong/issues/7940) |
[Bug][Manager][Sort] Use Pulsar subscriptions in Pulsar connector
|
+| [INLONG-7938](https://github.com/apache/inlong/issues/7938) | [Bug][Manager]
The consume list interface does not filter by request
|
+| [INLONG-7936](https://github.com/apache/inlong/issues/7936) |
[Improve][Manager] Support issued pulsar subscriptions to sort
|
+| [INLONG-7934](https://github.com/apache/inlong/issues/7934) |
[Improve][Manager] Optimize the serializationType to support debezium json
|
+| [INLONG-7912](https://github.com/apache/inlong/issues/7912) |
[Improve][Manager] Only response DataProxy nodes in normal status
|
+| [INLONG-7895](https://github.com/apache/inlong/issues/7895) |
[Feature][Manager] Support field description when parsing field by SQL
|
+| [INLONG-7893](https://github.com/apache/inlong/issues/7893) |
[Feature][Manager] Support field description when parsing field by JSON
|
+| [INLONG-7890](https://github.com/apache/inlong/issues/7890) |
[Improve][Manager] Add checks for unmodifiable data_node_name and cluster_name
|
+| [INLONG-7888](https://github.com/apache/inlong/issues/7888) | [Bug][Manager]
Failed to create lightweight task
|
+| [INLONG-7883](https://github.com/apache/inlong/issues/7883) |
[Improve][Manager] Invalidate user session when deleting user
|
+| [INLONG-7867](https://github.com/apache/inlong/issues/7867) |
[Feature][Manager] Support data validation when importing Excel file
|
+| [INLONG-7844](https://github.com/apache/inlong/issues/7844) |
[Improve][Manager] Support to set cluster when create table for clickhouse
|
+| [INLONG-7843](https://github.com/apache/inlong/issues/7843) |
[Feature][Manager] Creating the schema of StreamSource by importing an Excel
file |
+| [INLONG-7841](https://github.com/apache/inlong/issues/7841) |
[Feature][Manager] Support title style and font when exporting Excel file
|
+| [INLONG-7839](https://github.com/apache/inlong/issues/7839) |
[Improve][Manager] Bump version of apache-poi:poi to 5.2.3
|
+| [INLONG-7837](https://github.com/apache/inlong/issues/7837) | [Bug][Manager]
The Admin user cannot modify streamSource when it is not the responsible person
|
+| [INLONG-7835](https://github.com/apache/inlong/issues/7835) |
[Improve][Manager] The permission is removed when a user is deleted
|
+| [INLONG-7823](https://github.com/apache/inlong/issues/7823) |
[Improve][Manager] Supports creating clickhouse tables using the
ReplicatedMergeTree engine |
+| [INLONG-7820](https://github.com/apache/inlong/issues/7820) |
[Feature][Manager] Support style and font when exporting Excel file
|
+| [INLONG-7816](https://github.com/apache/inlong/issues/7816) |
[Feature][Manager] Support validation rules when exporting Excel file
|
+| [INLONG-7810](https://github.com/apache/inlong/issues/7810) | [Bug][Manager]
No token field in the return result of getAllConfig
|
+| [INLONG-7804](https://github.com/apache/inlong/issues/7804) |
[Improve][Manager] Limit the length of user password
|
+| [INLONG-7800](https://github.com/apache/inlong/issues/7800) | [Bug][Manager]
Update redis data node failed
|
+| [INLONG-7798](https://github.com/apache/inlong/issues/7798) |
[Improve][Manager] Add user authentication when operate workflow
|
+| [INLONG-7792](https://github.com/apache/inlong/issues/7792) |
[Feature][Manager] Support export Excel template file of StreamSource
|
+| [INLONG-7778](https://github.com/apache/inlong/issues/7778) |
[Feature][Manager] Optimize the create command for ease of use
|
+| [INLONG-7774](https://github.com/apache/inlong/issues/7774) |
[Improve][Manager] Add permission verification for streamSource
|
+| [INLONG-7760](https://github.com/apache/inlong/issues/7760) | [Bug][Manager]
Parse fields failed for streamSink and InlongStream
|
+| [INLONG-7730](https://github.com/apache/inlong/issues/7730) |
[Feature][Manager] Support node management for Redis
|
+| [INLONG-7722](https://github.com/apache/inlong/issues/7722) | [Bug][Manager]
The task status is inconsistent with the returned result
|
+| [INLONG-7720](https://github.com/apache/inlong/issues/7720) |
[Umbrella][Manager] Creating schema of StreamSource by Excel
|
+| [INLONG-7719](https://github.com/apache/inlong/issues/7719) |
[Feature][Manager] Support test connection for Redis in NodeManagement
|
+| [INLONG-7713](https://github.com/apache/inlong/issues/7713) |
[Feature][Manager] Support test connection for Apache Kudu
|
+| [INLONG-7711](https://github.com/apache/inlong/issues/7711) |
[Feature][Sort][Manager] Support specifying parameters for the kudu client
|
+| [INLONG-7706](https://github.com/apache/inlong/issues/7706) | [Bug][Manager]
sink is always in the configuration after being saved
|
+| [INLONG-7701](https://github.com/apache/inlong/issues/7701) |
[Feature][Manager] Support test connection for hudi in NodeManagement
|
+| [INLONG-7690](https://github.com/apache/inlong/issues/7690) |
[Feature][Manager] Creating schema of StreamSource by CSV
|
+| [INLONG-7688](https://github.com/apache/inlong/issues/7688) |
[Feature][Manager] Creating schema of StreamSource by SQL
|
+| [INLONG-7686](https://github.com/apache/inlong/issues/7686) |
[Feature][Manager] Support node management for Apache Kudu
|
+| [INLONG-7678](https://github.com/apache/inlong/issues/7678) |
[Improve][Manager] Rename FROZEN to STOP for source status
|
+| [INLONG-7675](https://github.com/apache/inlong/issues/7675) |
[Improve][Manager] Check OrderType when calling listAll to prevent sql
injection |
+| [INLONG-7673](https://github.com/apache/inlong/issues/7673) |
[Improve][Manager] Remove whitespace when saving or updating URLs
|
+| [INLONG-7670](https://github.com/apache/inlong/issues/7670) |
[Improve][Manager] Filter out sinks with empty cluster
|
+| [INLONG-7666](https://github.com/apache/inlong/issues/7666) |
[Improve][Manager] Support to freezing and restarting streamSource
|
+| [INLONG-7658](https://github.com/apache/inlong/issues/7658) |
[Improve][Manager] Optimized table index
|
+| [INLONG-7655](https://github.com/apache/inlong/issues/7655) |
[Improve][Manager] Remove the dependency of hudi-flink1.13-bundle
|
+| [INLONG-7651](https://github.com/apache/inlong/issues/7651) | [Bug][Manager]
StreamSource in normal state cannot be modified
|
+| [INLONG-7648](https://github.com/apache/inlong/issues/7648) |
[Improve][Manager] Support list streams by a specific group principal
|
+| [INLONG-7632](https://github.com/apache/inlong/issues/7632) |
[Improve][Manager] Mask the audit information that Sort sent successfully
|
+| [INLONG-7625](https://github.com/apache/inlong/issues/7625) |
[Improve][Manager] Make data encoding type as a common property of StreamSink
|
+| [INLONG-7619](https://github.com/apache/inlong/issues/7619) |
[Improve][Manager] Support update and retry MySQL sources after updating
MySQLDataNode |
+| [INLONG-7004](https://github.com/apache/inlong/issues/7004) |
[Feature][Dashboard][Manager] Creating schema of StreamSource by Statement
|
+| [INLONG-6672](https://github.com/apache/inlong/issues/6672) |
[Feature][Manager] Add `inlongctl` status management for the group
|
### Sort
-| ISSUE | Summary
|
-|:------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------|
-| [INLONG-7609](https://github.com/apache/inlong/issues/7609) |
[Feature][Sort] Add audit for kafka source connector
|
-| [INLONG-7595](https://github.com/apache/inlong/issues/7595) |
[Improve][Sort] Mongo read phase metrics need to update when no incremental
data |
-| [INLONG-7589](https://github.com/apache/inlong/issues/7589) |
[Feature][Sort] Support multi node relation with same output but different
input nodes |
-| [INLONG-7584](https://github.com/apache/inlong/issues/7584) |
[Feature][Sort] Doris connector supports writing CSV and archiving dirty data
|
-| [INLONG-7567](https://github.com/apache/inlong/issues/7567) |
[Improve][Sort] Extract metrics as common parameters
|
-| [INLONG-7559](https://github.com/apache/inlong/issues/7559) | [Bug][Sort]
Fix Oracle CDC reads timestamp error
|
-| [INLONG-7557](https://github.com/apache/inlong/issues/7557) | [Bug][Sort]
Fix class incompatible error between elasticsearch6 with elasticsearch7
|
-| [INLONG-7550](https://github.com/apache/inlong/issues/7550) |
[Improve][Sort] Optimize the log printing level of dirty data to avoid
generating a large number of logs |
-| [INLONG-7546](https://github.com/apache/inlong/issues/7546) | [Bug][Sort]
Fix dirty data not archived for iceberg connector
|
-| [INLONG-7543](https://github.com/apache/inlong/issues/7543) | [Bug][Sort]
PostgreSQL connector output two data with the same UPDATE operation
|
-| [INLONG-7539](https://github.com/apache/inlong/issues/7539) | [Bug][Sort]
StarRocks connector uses wrong operation type
|
-| [INLONG-7537](https://github.com/apache/inlong/issues/7537) |
[Improve][Sort] MongoDB CDC 2.3 supports enabling incremental snapshot
|
-| [INLONG-7508](https://github.com/apache/inlong/issues/7508) |
[Improve][Sort] Carry right RowKind when cdc-base sends RowData to sink
|
-| [INLONG-7504](https://github.com/apache/inlong/issues/7504) | [Bug][Sort]
StarRocks will throw NullPointerException when dirty.ignore is false
|
-| [INLONG-7503](https://github.com/apache/inlong/issues/7503) |
[Feature][Sort] Support multipule audit ids and fix audit time won't fit
|
-| [INLONG-7488](https://github.com/apache/inlong/issues/7488) | [Bug][Sort]
Oracle CDC 2.3 can only read one record during snapshot reading
|
-| [INLONG-7487](https://github.com/apache/inlong/issues/7487) |
[Improve][Sort] Change changelog mode to capture update_before for ES
|
-| [INLONG-7485](https://github.com/apache/inlong/issues/7485) |
[Improve][Sort] Kafka extract node decide connector option by format
|
-| [INLONG-7483](https://github.com/apache/inlong/issues/7483) | [Bug][Sort]
Connector dependency shade range is not right
|
-| [INLONG-7477](https://github.com/apache/inlong/issues/7477) | [Bug][Sort]
Fix the metadata of table write error for canal-json
|
-| [INLONG-7470](https://github.com/apache/inlong/issues/7470) | [Bug][Sort]
Iceberg's data were duplicated when delete records in upsert mode
|
-| [INLONG-7464](https://github.com/apache/inlong/issues/7464) | [Bug][Sort]
Elasticsearch connector lost dependency
|
-| [INLONG-7459](https://github.com/apache/inlong/issues/7459) | [Bug][Sort]
Fix dirty data can't be archived to s3 for hbase
|
-| [INLONG-7457](https://github.com/apache/inlong/issues/7457) |
[Improve][Sort] Change changelog mode to capture update_before for Doris
|
-| [INLONG-7455](https://github.com/apache/inlong/issues/7455) | [Bug][Sort]
Fix dirty data archival format issues in Iceberg connector
|
-| [INLONG-7453](https://github.com/apache/inlong/issues/7453) | [Bug][Sort]
The blacklist of Iceberg connector will lose the metric and archiving of dirty
data |
-| [INLONG-7451](https://github.com/apache/inlong/issues/7451) | [Bug][Sort]
FileSystem connector dependency lost
|
-| [INLONG-7449](https://github.com/apache/inlong/issues/7449) | [Bug][Sort]
Kafka connector dependency lost
|
-| [INLONG-7446](https://github.com/apache/inlong/issues/7446) |
[Improve][Sort] Upgrade MongoDB CDC to version 2.3
|
-| [INLONG-7441](https://github.com/apache/inlong/issues/7441) | [Bug][Sort]
HBase connector dependency lost and dirty data process error
|
-| [INLONG-7437](https://github.com/apache/inlong/issues/7437) |
[Improve][Sort] Support metrics for Oracle CDC connector with incremental
snapshot enabled |
-| [INLONG-7417](https://github.com/apache/inlong/issues/7417) |
[Improve][Sort] Use SinkTableMetricData instead of SinkMetricData in
IcebergSingleStreamWriter |
-| [INLONG-7412](https://github.com/apache/inlong/issues/7412) | [Bug][Sort]
Fix dependency error: java.lang.NoClassDefFoundError
|
-| [INLONG-7411](https://github.com/apache/inlong/issues/7411) | [Bug][Sort]
Fix the invalid of kafka source meitric due to inlongMetric being null
|
-| [INLONG-7410](https://github.com/apache/inlong/issues/7410) |
[Improve][Sort] Support open incremental snapshot in oracle cdc connector
|
-| [INLONG-7400](https://github.com/apache/inlong/issues/7400) |
[Improve][Sort] Upgrade Oracle CDC to version 2.3.0
|
-| [INLONG-7397](https://github.com/apache/inlong/issues/7397) | [Bug][Sort]
MySql connector output two data with the same UPDATE operation
|
-| [INLONG-7392](https://github.com/apache/inlong/issues/7392) |
[Improve][Sort] Refactor Doris single table to solve performance issues
|
-| [INLONG-7391](https://github.com/apache/inlong/issues/7391) |
[Improve][Sort] Support CSV format and dirty data collecting for StarRocks
connector |
-| [INLONG-7389](https://github.com/apache/inlong/issues/7389) |
[Improve][Manager][Sort] Add audit id info for source
|
-| [INLONG-7377](https://github.com/apache/inlong/issues/7377) | [Bug][Sort]
Protobuf conflicts in sort-dist and sort-connectors
|
-| [INLONG-7363](https://github.com/apache/inlong/issues/7363) | [Bug][Sort]
Icebreg connector has null pointer exception
|
-| [INLONG-7351](https://github.com/apache/inlong/issues/7351) | [Bug][Sort]
Table level metric name is error for starrocks and doris
|
-| [INLONG-7346](https://github.com/apache/inlong/issues/7346) |
[Improve][Sort] Add metadata support for join of Redis dimension table
|
-| [INLONG-7339](https://github.com/apache/inlong/issues/7339) |
[Improve][Sort] Adjust the Sort structure for multiple versions of Apache Flink
|
-| [INLONG-7335](https://github.com/apache/inlong/issues/7335) | [Bug][Sort]
Hbase connector lost spi file when shade
|
-| [INLONG-7331](https://github.com/apache/inlong/issues/7331) |
[Improve][Sort][Manager] Support complex type field
|
-| [INLONG-7311](https://github.com/apache/inlong/issues/7311) | [Bug][Sort]
Doris StreamLoad unable to archive dirty data
|
-| [INLONG-7306](https://github.com/apache/inlong/issues/7306) |
[Improve][Sort] Use properties to save extended parameters in Redis LoadNode
|
-| [INLONG-7299](https://github.com/apache/inlong/issues/7299) |
[Feature][Sort][Manager] Support InLongMsg in KafkaConnector
|
-| [INLONG-7293](https://github.com/apache/inlong/issues/7293) | [Bug][Sort]
S3DirtySink flushes too quickly
|
-| [INLONG-7292](https://github.com/apache/inlong/issues/7292) | [Bug][Sort]
The invokeMultiple method cannot accurately detect and archive dirty data
|
-| [INLONG-7291](https://github.com/apache/inlong/issues/7291) | [Bug][Sort]
Fix bug of dirtysink not opening for jdbc multiple sink
|
-| [INLONG-7286](https://github.com/apache/inlong/issues/7286) | [Bug][Sort]
Fix issue of tableidentifier being null when addRow
|
-| [INLONG-7268](https://github.com/apache/inlong/issues/7268) |
[Feature][Sort] Support Apache Kudu LoadNode
|
-| [INLONG-7257](https://github.com/apache/inlong/issues/7257) | [Bug][Sort]
Doris connector throw NPE when DATE type data is null
|
-| [INLONG-7250](https://github.com/apache/inlong/issues/7250) |
[Improve][Sort] Output the read phase metrics for MySQL reader
|
-| [INLONG-7245](https://github.com/apache/inlong/issues/7245) |
[Feature][Sort] Support metric and audio in sort-connect-redis
|
-| [INLONG-7240](https://github.com/apache/inlong/issues/7240) |
[Feature][Sort] Support load node of Redis
|
-| [INLONG-7197](https://github.com/apache/inlong/issues/7197) |
[Improve][Sort] Iceberg connector supports keyby with the primary key
|
-| [INLONG-7186](https://github.com/apache/inlong/issues/7186) | [Bug][Sort]
Incorrect time zone for data writing to Iceberg
|
-| [INLONG-7140](https://github.com/apache/inlong/issues/7140) |
[Improve][Sort] MySql cdc connector split exit without catch exception
|
-| [INLONG-7060](https://github.com/apache/inlong/issues/7060) |
[Feature][Sort] Support write redis in sort-connector-redis
|
-| [INLONG-7058](https://github.com/apache/inlong/issues/7058) |
[Feature][Sort] Support Apache Kudu connector
|
-| [INLONG-7249](https://github.com/apache/inlong/issues/7249) |
[Feature][Sort] JDBC accurate dirty data archive and metric calculation
|
-| [INLONG-7614](https://github.com/apache/inlong/issues/7614) | [Bug][Sort]
Fix pulsar connector data loss
|
-### Audit
-| ISSUE | Summary
|
-|:------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------|
-| [INLONG-7607](https://github.com/apache/inlong/issues/7607) | [Bug][Docker]
Audit store service can not start in docker-compose
|
-| [INLONG-7519](https://github.com/apache/inlong/issues/7519) |
[Feature][Audit] Proxy support Kafka
|
-| [INLONG-7518](https://github.com/apache/inlong/issues/7518) |
[Feature][Audit] Store support Kafka
|
-| [INLONG-7234](https://github.com/apache/inlong/issues/7234) |
[Improve][Audit] Add log4j for audit-store
|
-| [INLONG-7159](https://github.com/apache/inlong/issues/7159) | [Bug] [Audit]
Fix the problem of audit sdk create thread when the audit service is not
deployed |
-| [INLONG-6919](https://github.com/apache/inlong/issues/6919) | [Bug][Audit]
No exceptions are printed in the log
|
-
-### Dashboard
-| ISSUE | Summary
|
-|:------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------|
-| [INLONG-7613](https://github.com/apache/inlong/issues/7613) |
[Improve][Dashboard] Data reporting moved to Approval Information
|
-| [INLONG-7611](https://github.com/apache/inlong/issues/7611) |
[Improve][Dashboard] File source select cluster add limit
|
-| [INLONG-7582](https://github.com/apache/inlong/issues/7582) |
[Improve][Dashboard] Support responseParse config
|
-| [INLONG-7563](https://github.com/apache/inlong/issues/7563) |
[Feature][Dashboard] Support specific partitions in the kudu sink
|
-| [INLONG-7560](https://github.com/apache/inlong/issues/7560) |
[Improve][Dashboard] When submitting group approval, determine whether to
create source and sink |
-| [INLONG-7542](https://github.com/apache/inlong/issues/7542) |
[Improve][Dashboard] File source supports selecting clusters
|
-| [INLONG-7531](https://github.com/apache/inlong/issues/7531) |
[Improve][Dashboard] Clickhouse source supports filling life cycle
|
-| [INLONG-7521](https://github.com/apache/inlong/issues/7521) |
[Improve][Dashboard] Arrange according to the size of Auditid
|
-| [INLONG-7506](https://github.com/apache/inlong/issues/7506) |
[Improve][Dashboard] Change query method of source and sink from get to post
|
-| [INLONG-7499](https://github.com/apache/inlong/issues/7499) |
[Feature][Dashboard] Support redis node management
|
-| [INLONG-7495](https://github.com/apache/inlong/issues/7495) |
[Feature][Dashboard] Support hudi node management
|
-| [INLONG-7493](https://github.com/apache/inlong/issues/7493) |
[Improve][Dashboard] Not use upper case for source, sink, and audit labels
|
-| [INLONG-7438](https://github.com/apache/inlong/issues/7438) |
[Improve][Dashboard] Support more Sort index display instead of directly
displaying ID |
-| [INLONG-7415](https://github.com/apache/inlong/issues/7415) |
[Feature][Dashboard][Manager] Creating schema of StreamSource by JSON
|
-| [INLONG-7384](https://github.com/apache/inlong/issues/7384) |
[Bug][Dashboard] Login page error
|
-| [INLONG-7382](https://github.com/apache/inlong/issues/7382) |
[Improve][Dashboard] Add a database name for MySQL sink
|
-| [INLONG-7368](https://github.com/apache/inlong/issues/7368) |
[Improve][Dashboard] InLongGroup adds status display and adjustment operations
|
-| [INLONG-7367](https://github.com/apache/inlong/issues/7367) |
[Improve][Dashboard] Enabled more global config
|
-| [INLONG-7360](https://github.com/apache/inlong/issues/7360) |
[Bug][Dashboard] env.local variable can not work
|
-| [INLONG-7327](https://github.com/apache/inlong/issues/7327) |
[Improve][Dashboard] Support using different env variable
|
-| [INLONG-7319](https://github.com/apache/inlong/issues/7319) |
[Improve][Dashboard] Support global configuration of Provider and Layout
|
-| [INLONG-7313](https://github.com/apache/inlong/issues/7313) |
[Improve][Dashboard] Automatically generate a unique ID and depth key for the
menu |
-| [INLONG-7305](https://github.com/apache/inlong/issues/7305) |
[Improve][Dashboard] Use properties to save extended parameters in Redis
LoadNode |
-| [INLONG-7297](https://github.com/apache/inlong/issues/7297) |
[Improve][Dashboard] Hive node parameter optimization
|
-| [INLONG-7264](https://github.com/apache/inlong/issues/7264) |
[Feature][Dashboard] Support sink Apache Kudu
|
-| [INLONG-7246](https://github.com/apache/inlong/issues/7246) |
[Improve][Dashboard] Remove helper info of DataType in Stream configuration
|
-| [INLONG-7238](https://github.com/apache/inlong/issues/7238) |
[Feature][Dashboard] Support cascading of redis cluster / data-type and format
configuration |
-| [INLONG-7215](https://github.com/apache/inlong/issues/7215) |
[Improve][Dashboard] PostgreSQL source parameter optimization
|
-| [INLONG-7211](https://github.com/apache/inlong/issues/7211) |
[Feature][Dashboard] Support Redis sink
|
-| [INLONG-7190](https://github.com/apache/inlong/issues/7190) |
[Improve][Dashboard] New data subscription optimization
|
-| [INLONG-7176](https://github.com/apache/inlong/issues/7176) |
[Feature][Dashboard] Add restart and stop operations for InlongGroup
|
-| [INLONG-7162](https://github.com/apache/inlong/issues/7162) |
[Improve][Dashboard] Kafka MQ type details optimization
|
-| [INLONG-7153](https://github.com/apache/inlong/issues/7153) |
[Improve][Dashboard] The data subscription status code shows the specific
meaning |
-
-### Other
-| ISSUE | Summary
|
-|:------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------|
-| [INLONG-7572](https://github.com/apache/inlong/issues/7572) |
[Feature][Docker] Add the Kafka support for audit docker deployment
|
-| [INLONG-7528](https://github.com/apache/inlong/issues/7528) |
[Feature][Script] Add the Kafka support for audit standalone deployment
|
-| [INLONG-7480](https://github.com/apache/inlong/issues/7480) |
[Improve][CVE] Dependency org.apache.tomcat.embed:tomcat-embed-core leading to
CVE problem |
-| [INLONG-7475](https://github.com/apache/inlong/issues/7475) |
[Improve][Docker] Add Kafka connector to the manager image for test
|
-| [INLONG-7423](https://github.com/apache/inlong/issues/7423) | [Feature]
Pulsar connector with adminUrl cannot output audit metrics
|
-| [INLONG-7349](https://github.com/apache/inlong/issues/7349) | [Bug][SDK]
Init failure when a single SortTask create multiple SortClients
|
-| [INLONG-7323](https://github.com/apache/inlong/issues/7323) |
[Improve][Docker] Add push manifest for tubemq-all and tubemq-manager
|
-| [INLONG-7266](https://github.com/apache/inlong/issues/7266) |
[Improve][Document] Add document for Apache Kudu
|
-| [INLONG-7244](https://github.com/apache/inlong/issues/7244) |
[Feature][Document] Add user docs for Redis LoadNote
|
-| [INLONG-7161](https://github.com/apache/inlong/issues/7161) | [Bug] Mysql
connector only output the latest record in snapshot stage for table without
primary key |
-| [INLONG-7154](https://github.com/apache/inlong/issues/7154) | [Bug][SDK]
Fix metric report failure when topic does not exist
|
-| [INLONG-6560](https://github.com/apache/inlong/issues/6560) |
[Feature][Docker] Add arm64 image for inlong/tubemq-all
|
-| [INLONG-5643](https://github.com/apache/inlong/issues/5643) | [Bug][CVE]
There is a vulnerability in Apache Flume 1.10.0
|
-
-# Release InLong 1.5.0 - Released (as of 2023-01-03)
-
-### Agent
-| ISSUE | Summary
|
-|:-----------------------------------------------------------:|:-----------------------------------------------------------------------|
-| [INLONG-6970](https://github.com/apache/inlong/issues/6970) |
[Improve][Agent] Improve Agent UnitTest |
-| [INLONG-6960](https://github.com/apache/inlong/issues/6960) | [Bug][Agent]
Generate repeat UUID for different messages in some cases |
-| [INLONG-6759](https://github.com/apache/inlong/issues/6759) |
[Improve][Agent] Improve code style |
-| [INLONG-6730](https://github.com/apache/inlong/issues/6730) |
[Improve][Agent] Change MOCK task type |
-| [INLONG-6704](https://github.com/apache/inlong/issues/6704) |
[Feature][Agent] Add pulsar sink |
-| [INLONG-6681](https://github.com/apache/inlong/issues/6681) |
[Feature][Agent] Support settings for agent's data report-to |
-
-### DataProxy
-| ISSUE | Summary
|
-|:-----------------------------------------------------------:|:-----------------------------------------------------------------------------------|
-| [INLONG-7086](https://github.com/apache/inlong/issues/7086) |
[Improve][DataProxy] Add default ext tag report value
|
-| [INLONG-7054](https://github.com/apache/inlong/issues/7054) |
[Improve][DataProxy] Add the processing of the rtms field
|
-| [INLONG-6985](https://github.com/apache/inlong/issues/6985) |
[Improve][DataProxy] Make maxMonitorCnt setting configurable
|
-| [INLONG-6964](https://github.com/apache/inlong/issues/6964) |
[Bug][DataProxy] Caught when deploy in docker-compose
|
-| [INLONG-7070](https://github.com/apache/inlong/issues/7070) |
[Bug][Manager][DataProxy] Fix pulling MQ configuration problem
|
-| [INLONG-6955](https://github.com/apache/inlong/issues/6955) |
[Improve][Script] Support starts the DataProxy with Kafka in the deployment
script |
-| [INLONG-6848](https://github.com/apache/inlong/issues/6848) |
[Improve][DataProxy] Support original InlongMsg protocol and headers
|
-| [INLONG-6802](https://github.com/apache/inlong/issues/6802) |
[Improve][DataProxy][Manager] Adapt Apache Kafka as cache cluster
|
-| [INLONG-6738](https://github.com/apache/inlong/issues/6738) |
[Feature][DataProxy] New MQ sink integration with TCP source
|
-| [INLONG-6717](https://github.com/apache/inlong/issues/6717) |
[Feature][DataProxy] Support BufferQueueChannel
|
-| [INLONG-6715](https://github.com/apache/inlong/issues/6715) |
[Bug][DataProxy] Fix json problem in data proxy
|
-| [INLONG-6702](https://github.com/apache/inlong/issues/6702) |
[Improve][DataProxy] Modify the default network card name to obtain the local
IP |
-| [INLONG-6604](https://github.com/apache/inlong/issues/6604) |
[Bug][DataProxy] Fix can not get the local IP in the docker container
|
-| [INLONG-6602](https://github.com/apache/inlong/issues/6602) |
[Bug][DataProxy] The IP config was invalid
|
-| [INLONG-6593](https://github.com/apache/inlong/issues/6593) |
[Bug][DataProxy] Compile and build failed
|
-| [INLONG-6592](https://github.com/apache/inlong/issues/6592) |
[Feature][DataProxy] Fix the problem of missing OrderEvent
|
-| [INLONG-6438](https://github.com/apache/inlong/issues/6438) | [Improve][SDK]
DataProxy-SDK parses and handles ack response from DataProxy |
-| [INLONG-6153](https://github.com/apache/inlong/issues/6153) |
[Feature][DataProxy] Optimize the sink architecture
|
-
-### TubeMQ
-| ISSUE | Summary
|
-|:-----------------------------------------------------------:|:---------------------------------------------------------------------------------------|
-| [INLONG-6997](https://github.com/apache/inlong/issues/6997) |
[Improve][TubeMQ] Add sendMessage and getMessage latency statistics
|
-| [INLONG-6638](https://github.com/apache/inlong/issues/6638) | [Bug][TubeMQ]
The C++ client does not support filtering consume with the - character |
-| [INLONG-6611](https://github.com/apache/inlong/issues/6611) |
[Feature][TubeMQ] Base implementation of TubeMQ C++ Producer
|
-| [INLONG-6579](https://github.com/apache/inlong/issues/6579) | [Bug][TubeMQ]
The updated version causes the consumer group permissions to be abnormal |
-| [INLONG-6535](https://github.com/apache/inlong/issues/6535) |
[Improve][TubeMQ] The storage space used by the offset of TubeMQ broker is too
large |
-| [INLONG-4969](https://github.com/apache/inlong/issues/4969) |
[Feature][TubeMQ] Python SDK for Producing Message
|
-| [INLONG-7106](https://github.com/apache/inlong/issues/7106) |
[Improve][TubeMQ] Add reset offset API by time
|
-
-### Manager
-| ISSUE | Summary
|
-|:-----------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------|
-| [INLONG-7070](https://github.com/apache/inlong/issues/7070) |
[Bug][Manager][DataProxy] Fix pulling MQ configuration problem
|
-| [INLONG-7067](https://github.com/apache/inlong/issues/7067) |
[Feature][Manager] Provide MQ cluster info in consumption details
|
-| [INLONG-7049](https://github.com/apache/inlong/issues/7049) |
[Feature][Manager] Support complex datatypes in Hudi Sink
|
-| [INLONG-7040](https://github.com/apache/inlong/issues/7040) |
[Improve][Manager] Make the display name more easy to read
|
-| [INLONG-7039](https://github.com/apache/inlong/issues/7039) | [Bug][Manager]
Unknown method isNoneBlank
|
-| [INLONG-7028](https://github.com/apache/inlong/issues/7028) | [Bug][Manager]
Failed to query the task status
|
-| [INLONG-7026](https://github.com/apache/inlong/issues/7026) | [Bug][Manager]
A kafka topic is created without checking whether the topic exists
|
-| [INLONG-7011](https://github.com/apache/inlong/issues/7011) | [Bug][Manager]
Check Pulsar non-partitioned table if exist
|
-| [INLONG-6992](https://github.com/apache/inlong/issues/6992) | [Bug][Manager]
The agent is always in the status of TO_BE_ISSUED_DELETE.
|
-| [INLONG-6988](https://github.com/apache/inlong/issues/6988) |
[Feature][Manager] Use the data node info for StarRocks
|
-| [INLONG-6961](https://github.com/apache/inlong/issues/6961) |
[Feature][Dashboad][Manager] Support for handling non-InlongMsg formats
|
-| [INLONG-6938](https://github.com/apache/inlong/issues/6938) |
[Feature][Manager] Support create StarRocks database or table
|
-| [INLONG-6933](https://github.com/apache/inlong/issues/6933) |
[Improve][Manager] Add OpenAPIs for InLong stream-source and stream-transform
operations |
-| [INLONG-6918](https://github.com/apache/inlong/issues/6918) |
[Improve][Manager] Command tools support Transform
|
-| [INLONG-6909](https://github.com/apache/inlong/issues/6909) |
[Improve][Manager] Rename Flink Job to avoid conflicts
|
-| [INLONG-6905](https://github.com/apache/inlong/issues/6905) |
[Improve][Manager] Add OpenAPIs for InLong cluster and data node operations
|
-| [INLONG-6876](https://github.com/apache/inlong/issues/6876) |
[Improve][Manager] Always enable "scan.incremental.snapshot" for MySQL extract
node |
-| [INLONG-6860](https://github.com/apache/inlong/issues/6860) |
[Improve][Manager] Add open APIs related to inlong basic operations
|
-| [INLONG-6835](https://github.com/apache/inlong/issues/6835) | [Bug][Manager]
Error about backup mq resource of DataProxy getAllConfig interface.
|
-| [INLONG-6830](https://github.com/apache/inlong/issues/6830) |
[Improve][Manager] Optimize the config managerment of SortSDK
|
-| [INLONG-6816](https://github.com/apache/inlong/issues/6816) |
[Improve][Sort][Manager] Remove the DLC Iceberg-related files
|
-| [INLONG-6815](https://github.com/apache/inlong/issues/6815) | [Bug][Manager]
Elasticsearch port parameter is missing
|
-| [INLONG-6806](https://github.com/apache/inlong/issues/6806) | [Bug][Manager]
Failed to start the sort task because the es hosts parameter is incorrect
|
-| [INLONG-6805](https://github.com/apache/inlong/issues/6805) | [Bug][Manager]
Workflow initialization threw NPE exception when esVersion attribute is null.
|
-| [INLONG-6804](https://github.com/apache/inlong/issues/6804) | [Bug][Manager]
Workflow initialization threw IllegalArgumentException: Unsupported FieldType
text or keyword |
-| [INLONG-6802](https://github.com/apache/inlong/issues/6802) |
[Improve][DataProxy][Manager] Adapt Apache Kafka as cache cluster
|
-| [INLONG-6785](https://github.com/apache/inlong/issues/6785) |
[Feature][Manager] Support register and manage the resource of Apache Hudi
|
-| [INLONG-6773](https://github.com/apache/inlong/issues/6773) | [Bug][Manager]
Sink cannot jump from the configuration to successful configuration
|
-| [INLONG-6771](https://github.com/apache/inlong/issues/6771) |
[Improve][Manager] Add login failure limit
|
-| [INLONG-6768](https://github.com/apache/inlong/issues/6768) | [Bug][Manager]
Unable to find the data node according to the keyword
|
-| [INLONG-6763](https://github.com/apache/inlong/issues/6763) | [Bug][Manager]
Remove unnecessary validation when saving HiveSinkRequest
|
-| [INLONG-6745](https://github.com/apache/inlong/issues/6745) |
[Feature][Manager]Support StarRocks load node management
|
-| [INLONG-6737](https://github.com/apache/inlong/issues/6737) | [Bug][Manager]
Fix update failure by UpdateByKey methods
|
-| [INLONG-6735](https://github.com/apache/inlong/issues/6735) |
[Feature][Sort][Manager] PostgreSQL connector supports transferring all tables
for all schemas in one database |
-| [INLONG-6734](https://github.com/apache/inlong/issues/6734) | [Bug][Manager]
The DDL statement format of the Pulsar source does not match the front-end
config |
-| [INLONG-6732](https://github.com/apache/inlong/issues/6732) | [Bug][Manager]
Fix wrong SortSDK topic properties
|
-| [INLONG-6676](https://github.com/apache/inlong/issues/6676) |
[Feature][Manager] Support list all InlongTopicInfo under a given cluster tag
|
-| [INLONG-6665](https://github.com/apache/inlong/issues/6665) | [Bug][Manager]
Unable to save additional information for Elasticsearch field
|
-| [INLONG-6663](https://github.com/apache/inlong/issues/6663) |
[Improve][Manager] Move MQType from inlong-manager to inlong-common
|
-| [INLONG-6659](https://github.com/apache/inlong/issues/6659) |
[Improve][Manager] Using the Elasticsearch data node when creating its resource
|
-| [INLONG-6640](https://github.com/apache/inlong/issues/6640) |
[Feature][Manager][Sort] Function field type supports transform nodes
|
-| [INLONG-6631](https://github.com/apache/inlong/issues/6631) |
[Improve][Manager] Annotate the InlongGroupProcessServiceTest function
|
-| [INLONG-6621](https://github.com/apache/inlong/issues/6621) | [Bug][Manager]
Source tasks are issued repeatedly
|
-| [INLONG-6610](https://github.com/apache/inlong/issues/6610) |
[Improve][Manager] Support the saving and query of data report-to settings
|
-| [INLONG-6608](https://github.com/apache/inlong/issues/6608) |
[Feature][Manager] Support adding extension params for sink field
|
-| [INLONG-6570](https://github.com/apache/inlong/issues/6570) | [Bug][Manager]
Cannot parse the field type with length when building the Sort config
|
-| [INLONG-6568](https://github.com/apache/inlong/issues/6568) | [Bug][Manager]
The status of the deleted source is updated incorrectly
|
-| [INLONG-6563](https://github.com/apache/inlong/issues/6563) | [Bug][Manager]
No error message is displayed when the group fails to be deleted
|
-| [INLONG-6561](https://github.com/apache/inlong/issues/6561) | [Bug][Manager]
Failed to delete InlongGroup
|
-| [INLONG-6544](https://github.com/apache/inlong/issues/6544) | [Bug][Manager]
The source status cannot be updated after stream configuration is completed
|
-| [INLONG-6533](https://github.com/apache/inlong/issues/6533) | [Bug][Manager]
The manager did not distribute the task according to the clusterName
|
-| [INLONG-6531](https://github.com/apache/inlong/issues/6531) |
[Improve][Manager] Add load value in the response of getIpList method
|
-| [INLONG-6526](https://github.com/apache/inlong/issues/6526) | [Bug][Manager]
The manager-client force delete the stream source failed
|
-| [INLONG-6525](https://github.com/apache/inlong/issues/6525) | [Bug][Manager]
Stream and source status cannot be updated
|
-| [INLONG-6517](https://github.com/apache/inlong/issues/6517) | [Bug][Manager]
Failed to delete stream sink when the inlong group was config_failed
|
-| [INLONG-6516](https://github.com/apache/inlong/issues/6516) | [Bug][Manager]
NPE is thrown when startup the Sort task in the InlongStream workflow
|
-| [INLONG-6515](https://github.com/apache/inlong/issues/6515) | [Bug][Manager]
NPE is thrown in the cache configuration of DataProxy
|
-| [INLONG-6505](https://github.com/apache/inlong/issues/6505) |
[Feature][Manager] Support Kafka MQ in Inlong Consume
|
-| [INLONG-6502](https://github.com/apache/inlong/issues/6502) |
[Improve][Manager] Optimize some log and code formats
|
-| [INLONG-6497](https://github.com/apache/inlong/issues/6497) |
[Feature][Manager] Support Elasticsearch cluster
|
-| [INLONG-6496](https://github.com/apache/inlong/issues/6496) |
[Feature][Manager] Support Elasticsearch datanode
|
-| [INLONG-6491](https://github.com/apache/inlong/issues/6491) |
[Feature][Manager] Support getting backup info in getAllConfig
|
-| [INLONG-6487](https://github.com/apache/inlong/issues/6487) |
[Improve][Manager] Add API to force delete the stream source
|
-| [INLONG-6477](https://github.com/apache/inlong/issues/6477) |
[Feature][Manager] Supplement the consume API in the manager client
|
-| [INLONG-6463](https://github.com/apache/inlong/issues/6463) |
[Improve][Manager] Support create subscription and topic of multiple pulsar
cluster |
-| [INLONG-6451](https://github.com/apache/inlong/issues/6451) |
[Improve][Manager] Rewrite getSourcesMap for Kafka source operator
|
-| [INLONG-6426](https://github.com/apache/inlong/issues/6426) |
[Feature][Manager] SortSourceService support multi stream under one group
|
-| [INLONG-6044](https://github.com/apache/inlong/issues/6044) |
[Improve][Manager] Distinguish between group and stream configuration processes
|
-| [INLONG-5024](https://github.com/apache/inlong/issues/5024) | [Bug][Manager]
The error message is not right when deleting a successful inlong group
|
-| [INLONG-7104](https://github.com/apache/inlong/issues/7104) |
[Improve][Manager] Add database change script of InlongManager
|
-| [INLONG-5776](https://github.com/apache/inlong/issues/5776) |
[Improve][Manager] Add tenant param for Pulsar info
|
-
-### Sort
-| ISSUE | Summary
|
-|:-----------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------|
-| [INLONG-7083](https://github.com/apache/inlong/issues/7083) |
[Feature][Sort] StarRocks connector supports dirty data archives and metric
|
-| [INLONG-7076](https://github.com/apache/inlong/issues/7076) |
[Feature][Sort] Add multi table sink for MySQL
|
-| [INLONG-7075](https://github.com/apache/inlong/issues/7075) |
[Improve][Sort] Add table level metric and dirty data backup for PostgreSQL
|
-| [INLONG-7066](https://github.com/apache/inlong/issues/7066) |
[Improve][Sort] Kafka connector lost topic level dirty data metric and state
restore for multi sink |
-| [INLONG-7037](https://github.com/apache/inlong/issues/7037) | [Bug][Sort]
Remove exception when topic does not exist
|
-| [INLONG-7019](https://github.com/apache/inlong/issues/7019) |
[Improve][Sort] Rethrow the system error when flush data to doris
|
-| [INLONG-7014](https://github.com/apache/inlong/issues/7014) |
[Improve][Sort] Mysql state restore is compatible with old task state
|
-| [INLONG-7006](https://github.com/apache/inlong/issues/7006) |
[Improve][Sort] Optimize reading metric at the table level
|
-| [INLONG-6978](https://github.com/apache/inlong/issues/6978) | [Bug][Sort]
Get primary keys for PostgreSQL
|
-| [INLONG-6968](https://github.com/apache/inlong/issues/6968) | [Bug][Sort]
Encountered SqlParseException
|
-| [INLONG-6962](https://github.com/apache/inlong/issues/6962) |
[Improve][Sort] Add read phase metric and table level metric for MySQL-CDC
|
-| [INLONG-6949](https://github.com/apache/inlong/issues/6949) | [Feature]
support all rowkinds for metric computing and restore metrics state for dirty
metric for jdbc connector |
-| [INLONG-6925](https://github.com/apache/inlong/issues/6925) |
[Improve][Sort] Add read phase metric and table level metric for MongoDB-CDC
|
-| [INLONG-6914](https://github.com/apache/inlong/issues/6914) | [Bug][Sort]
Doris connector have a parallelism setting error
|
-| [INLONG-6912](https://github.com/apache/inlong/issues/6912) |
[Improve][Sort] Add table level metric for Doris
|
-| [INLONG-6908](https://github.com/apache/inlong/issues/6908) |
[Feature][Sort] Support all rowkinds for metric computing for es connector
|
-| [INLONG-6907](https://github.com/apache/inlong/issues/6907) |
[Feature][Sort] Support to close StatsRecorder of pulsar client
|
-| [INLONG-6899](https://github.com/apache/inlong/issues/6899) |
[Feature][Sort] StarRocks-CDC supports table level metrics
|
-| [INLONG-6898](https://github.com/apache/inlong/issues/6898) |
[Feature][Sort] Unify metrics report model of SortStandalone
|
-| [INLONG-6896](https://github.com/apache/inlong/issues/6896) |
[Feature][Sort] PostgreSQL-CDC supports metrics by database and table
|
-| [INLONG-6886](https://github.com/apache/inlong/issues/6886) |
[Improve][Sort] Add dirty message for doris sink
|
-| [INLONG-6884](https://github.com/apache/inlong/issues/6884) |
[Improve][Sort] Add dirty message for kafka connector
|
-| [INLONG-6869](https://github.com/apache/inlong/issues/6869) |
[Feature][Sort] Supports dirty data side-output for elasticsearch sink
|
-| [INLONG-6864](https://github.com/apache/inlong/issues/6864) |
[Improve][Sort] Modify Hive metric computing to ensure metric data accuracy
|
-| [INLONG-6858](https://github.com/apache/inlong/issues/6858) |
[Feature][Sort] Support extract node of Apache Hudi
|
-| [INLONG-6839](https://github.com/apache/inlong/issues/6839) | [Bug][Sort]
Clean up remain event when the related stream offline
|
-| [INLONG-6823](https://github.com/apache/inlong/issues/6823) | [Bug][Sort]
Parse the epoch date to normal date for Doris sink
|
-| [INLONG-6822](https://github.com/apache/inlong/issues/6822) |
[Feature][Sort]Add multi table source for MongoDb
|
-| [INLONG-6819](https://github.com/apache/inlong/issues/6819) |
[Feature][Sort]Add multi table sink for PostgresSQL
|
-| [INLONG-6816](https://github.com/apache/inlong/issues/6816) |
[Improve][Sort][Manager] Remove the DLC Iceberg-related files
|
-| [INLONG-6813](https://github.com/apache/inlong/issues/6813) | [Bug][Sort]
MetricStateUtils threw NPE when write to es and no dirtyRecordsOut counter
|
-| [INLONG-6797](https://github.com/apache/inlong/issues/6797) |
[Feature][Sort] Supports dirty data side-output for filesystem sink
|
-| [INLONG-6795](https://github.com/apache/inlong/issues/6795) |
[Feature][Sort] Supports dirty data side-output for hive sink
|
-| [INLONG-6792](https://github.com/apache/inlong/issues/6792) |
[Feature][Sort] Supports dirty data side-output for hbase sink
|
-| [INLONG-6784](https://github.com/apache/inlong/issues/6784) |
[Feature][Sort] Support load node of Apache Hudi
|
-| [INLONG-6782](https://github.com/apache/inlong/issues/6782) |
[Feature][Sort] Support Apache Hudi connector
|
-| [INLONG-6780](https://github.com/apache/inlong/issues/6780) |
[Feature][Sort] Supports dirty data side-output for JDBC connector and related
sinks |
-| [INLONG-6770](https://github.com/apache/inlong/issues/6770) |
[Improve][Sort] Optimize EsSink params
|
-| [INLONG-6765](https://github.com/apache/inlong/issues/6765) |
[Feature][Sort] Supports dirty data side-output for Iceberg sink
|
-| [INLONG-6754](https://github.com/apache/inlong/issues/6754) |
[Feature][Sort] Bump verison of pulsar-connector to 1.13.6.2
|
-| [INLONG-6751](https://github.com/apache/inlong/issues/6751) |
[Improve][Sort] Add read phase metric and table level metric for Oracle
|
-| [INLONG-6749](https://github.com/apache/inlong/issues/6749) |
[Improve][Sort] Add dirty metric for Kafka
|
-| [INLONG-6747](https://github.com/apache/inlong/issues/6747) |
[Feature][Sort]StarRocks connector supports transferring all tables for all
schemas in one database |
-| [INLONG-6735](https://github.com/apache/inlong/issues/6735) |
[Feature][Sort][Manager] PostgreSQL connector supports transferring all tables
for all schemas in one database |
-| [INLONG-6724](https://github.com/apache/inlong/issues/6724) |
[Feature][Sort] Supports dirty data side-output for doris sink
|
-| [INLONG-6707](https://github.com/apache/inlong/issues/6707) |
[Improve][Sort] Delay the release of audit metrics
|
-| [INLONG-6706](https://github.com/apache/inlong/issues/6706) | [Bug][Sort]
The client id of Kafka sink was wrong
|
-| [INLONG-6675](https://github.com/apache/inlong/issues/6675) | [Bug][Sort]
Not report metrics because Flink SQL missing the metrics.audit.proxy.hosts info
|
-| [INLONG-6657](https://github.com/apache/inlong/issues/6657) |
[Improve][Sort] Add dirty data metric for Hive
|
-| [INLONG-6640](https://github.com/apache/inlong/issues/6640) |
[Feature][Manager][Sort] Function field type supports transform nodes
|
-| [INLONG-6639](https://github.com/apache/inlong/issues/6639) | [Bug][Sort]
DynamicPulsarDeserializationSchema threw NPE when sourceMetricData is not
initialized |
-| [INLONG-6636](https://github.com/apache/inlong/issues/6636) |
[Improve][Sort] Keep metric computing consistent for source MySQL and sink
HBase |
-| [INLONG-6626](https://github.com/apache/inlong/issues/6626) |
[Improve][Sort] Use SortClientV2 by default
|
-| [INLONG-6620](https://github.com/apache/inlong/issues/6620) |
[Feature][Sort] Support metadata for Kafka source
|
-| [INLONG-6619](https://github.com/apache/inlong/issues/6619) |
[Feature][Sort] Support dirty sink for connectors
|
-| [INLONG-6617](https://github.com/apache/inlong/issues/6617) |
[Feature][Sort] Add common process for dirty data sink and supports log sink
|
-| [INLONG-6615](https://github.com/apache/inlong/issues/6615) | [Bug][Sort]
Upsert Kafka will throw NPE when getting deleted record
|
-| [INLONG-6600](https://github.com/apache/inlong/issues/6600) |
[Bug][SortStandalone] Dead lock when one stream is removed from or migrated to
one sink |
-| [INLONG-6598](https://github.com/apache/inlong/issues/6598) |
[Improve][Sort] Import small file compact for Apache Iceberg
|
-| [INLONG-6594](https://github.com/apache/inlong/issues/6594) | [Bug][Sort]
Clickhouse connector throw exception when source is change log stream
|
-| [INLONG-6586](https://github.com/apache/inlong/issues/6586) |
[Bug][SortStandalone] Wrong node duration time of the Kafka sink
|
-| [INLONG-6584](https://github.com/apache/inlong/issues/6584) |
[Improve][Sort] Add read phase metric and table level metric for MySQL
|
-| [INLONG-6578](https://github.com/apache/inlong/issues/6578) | [Bug][Sort]
Failed to write Bitmap data to the Apache Doris
|
-| [INLONG-6575](https://github.com/apache/inlong/issues/6575) |
[Improve][Sort] Add dirty data metric for Filesystem
|
-| [INLONG-6574](https://github.com/apache/inlong/issues/6574) |
[Improve][Sort] Add dirty data metric for HBase
|
-| [INLONG-6552](https://github.com/apache/inlong/issues/6552) | [Bug][Sort]
MicroTimestamp data error in Oracle connector
|
-| [INLONG-6548](https://github.com/apache/inlong/issues/6548) |
[Improve][Sort] Optimize metadata field naming for format of canal-json
|
-| [INLONG-6538](https://github.com/apache/inlong/issues/6538) | [Bug][Sort]
Wrong bool type convert in multiple sink scenes
|
-| [INLONG-6537](https://github.com/apache/inlong/issues/6537) | [Bug][Sort]
The decimal type loss of precision during DDL synchronization
|
-| [INLONG-6529](https://github.com/apache/inlong/issues/6529) | [Bug][Sort]
Fix microtime time zone error in MySql connector
|
-| [INLONG-6507](https://github.com/apache/inlong/issues/6507) | [Bug][Sort]
Should convert date type to timestamp type in Oracle connector
|
-| [INLONG-6495](https://github.com/apache/inlong/issues/6495) |
[Improve][Sort] Support metrics and restore metrics for single-table of Doris
|
-| [INLONG-6484](https://github.com/apache/inlong/issues/6484) | [Bug][Sort]
Fix schema update circular dependency error in multiple sink iceberg scenes
|
-| [INLONG-6471](https://github.com/apache/inlong/issues/6471) | [Bug][Sort]
MySQL connector metric restore lost init data for sourceFunction
|
-| [INLONG-6428](https://github.com/apache/inlong/issues/6428) | [Feature]
[Sort] Support elasticsearch-5.x
|
-| [INLONG-5628](https://github.com/apache/inlong/issues/5628) |
[Feature][SortStandalone] Add buffer limit for dispatch queue of the sink
|
-| [INLONG-7090](https://github.com/apache/inlong/issues/7090) |
[Improve][Sort] Upgrade the version of Iceberg to 1.1.0
|
-| [INLONG-7061](https://github.com/apache/inlong/issues/7061) |
[Feature][Sort] Support table level metrics for Apache Doris connector and add
dirty metrics |
-| [INLONG-6788](https://github.com/apache/inlong/issues/6788) |
[Feature][Sort] Support the metric of Apache Hudi
|
-| [INLONG-6545](https://github.com/apache/inlong/issues/6545) |
[Improve][Sort] Accurately parse the schema type and completely match the
missing precision information |
+| ISSUE | Summary
|
+|:-----------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------|
+| [INLONG-7958](https://github.com/apache/inlong/issues/7958) | [Bug][Sort]
MongoDB's schema becomes unordered after extracting the row data
|
+| [INLONG-7957](https://github.com/apache/inlong/issues/7957) | [Bug][Sort]
The canaljson's type of Oracle CDC and MongoDB CDC is inconsistent with MySQL
CDC |
+| [INLONG-7952](https://github.com/apache/inlong/issues/7952) |
[Improve][Sort] Mask sensitive message of Flink SQL in the logs
|
+| [INLONG-7945](https://github.com/apache/inlong/issues/7945) | [Bug][Sort]
MongoDB CDC unable to output the 'replace' records
|
+| [INLONG-7940](https://github.com/apache/inlong/issues/7940) |
[Bug][Manager][Sort] Use Pulsar subscriptions in Pulsar connector
|
+| [INLONG-7906](https://github.com/apache/inlong/issues/7906) |
[Improve][Sort] Improve logic of calculation object byte size
|
+| [INLONG-7858](https://github.com/apache/inlong/issues/7858) | [Bug][Sort]
Oracle CDC uploaded two different db name metrics for the same table
|
+| [INLONG-7857](https://github.com/apache/inlong/issues/7857) | [Bug][Sort]
Duplicated chunk happens when open scan-newly-added-table in mysql-cdc
|
+| [INLONG-7855](https://github.com/apache/inlong/issues/7855) | [Bug][Sort]
Hang up reader in snapshot phase when reducing paralleism
|
+| [INLONG-7850](https://github.com/apache/inlong/issues/7850) |
[Feature][Sort] Add support for extracting ddl statement and operation from
origin data |
+| [INLONG-7831](https://github.com/apache/inlong/issues/7831) |
[Improve][Sort] Using spilling disk map to reduce memory loss for buffer per
parititon data |
+| [INLONG-7829](https://github.com/apache/inlong/issues/7829) |
[Improve][Sort] Add mini-batch pre aggregate by partition when ingesting data
into iceberg |
+| [INLONG-7825](https://github.com/apache/inlong/issues/7825) | [Bug][Sort]
MySQL CDC cannot capture truncate ddl statement
|
+| [INLONG-7813](https://github.com/apache/inlong/issues/7813) | [Bug][Sort]
ES6 multiple sink initialize error
|
+| [INLONG-7809](https://github.com/apache/inlong/issues/7809) |
[Improve][Sort] ES multiple sink support dirty data runtime strategies
|
+| [INLONG-7790](https://github.com/apache/inlong/issues/7790) | [Bug][Sort]
Setting ""scanNewlyAddedTableEnabled=true"" and
""scan.startup.mode=latest-offset"" in MySQL CDC failed to capture newly added
tables" |
+| [INLONG-7787](https://github.com/apache/inlong/issues/7787) | [Bug][Sort]
Fix cannot output drop statement
|
+| [INLONG-7767](https://github.com/apache/inlong/issues/7767) |
[Bug][Sort]Doris connector does not real delete record because of columns
header losing |
+| [INLONG-7762](https://github.com/apache/inlong/issues/7762) | [Bug][Sort]
Fix capturing unrelated tables when open DDL change detection
|
+| [INLONG-7731](https://github.com/apache/inlong/issues/7731) | [Bug][Sort]
Fix the problem of calling getAndSetPkFromErrMsg method parameter order
|
+| [INLONG-7724](https://github.com/apache/inlong/issues/7724) |
[Improve][Sort] Add rate limit for ingesting into iceberg
|
+| [INLONG-7715](https://github.com/apache/inlong/issues/7715) | [Bug][Sort]
Fix single table metric invalid
|
+| [INLONG-7711](https://github.com/apache/inlong/issues/7711) |
[Feature][Sort][Manager] Support specifying parameters for the kudu client
|
+| [INLONG-7708](https://github.com/apache/inlong/issues/7708) | [Bug][Sort]
Fix the error that occurs when adding a table during whole database
synchronization in Oracle. |
+| [INLONG-7700](https://github.com/apache/inlong/issues/7700) |
[Improve][Sort] Update some copy class file when update mongo-cdc version to
2.3 |
+| [INLONG-7695](https://github.com/apache/inlong/issues/7695) | [Bug][Sort]
NPE occurs when running Oracle all database migration jobs
|
+| [INLONG-7693](https://github.com/apache/inlong/issues/7693) |
[Improve][Sort] MySQL CDC Connector supports specifying field synchronization
|
+| [INLONG-7683](https://github.com/apache/inlong/issues/7683) | [Bug][Sort]
Unit test error for Oracle connector
|
+| [INLONG-7680](https://github.com/apache/inlong/issues/7680) |
[Improve][Sort] MySQL CDC supports unsigned zerofill data type
|
+| [INLONG-7660](https://github.com/apache/inlong/issues/7660) |
[Feature][Sort] Support DDL model for MySQL connector when running in all
migrate mode |
+| [INLONG-7653](https://github.com/apache/inlong/issues/7653) |
[Feature][Sort] Support archiving dirty data and metrics for Iceberg connector
|
+| [INLONG-7635](https://github.com/apache/inlong/issues/7635) |
[Feature][Sort] MongoDB CDC supports metrics with enable incremental snapshots
|
+| [INLONG-7581](https://github.com/apache/inlong/issues/7581) |
[Feature][Sort] Support multiple-sink migration for Elasticsearch
|
+| [INLONG-7554](https://github.com/apache/inlong/issues/7554) |
[Feature][Sort] MySQL CDC supports parsing gh-ost records
|
+| [INLONG-7553](https://github.com/apache/inlong/issues/7553) |
[Feature][Sort] Mysql CDC support output DDL model in all migrate
|
+| [INLONG-7249](https://github.com/apache/inlong/issues/7249) |
[Feature][Sort] JDBC accurate dirty data archive and metric calculation
|
+| [INLONG-6668](https://github.com/apache/inlong/issues/6668) |
[Improve][Sort] Unify the constants in `inlong-common` and `sort-connectors`
|
+| [INLONG-7970](https://github.com/apache/inlong/issues/7970) | [Bug][Sort]
java.lang.ClassCastException: java.lang.String cannot be cast to
org.apache.flink.table.data.StringData |
+| [INLONG-7747](https://github.com/apache/inlong/issues/7747) |
[Umbrella][Sort] Improve memory stability of data ingesting into iceberg
|
+| [INLONG-6545](https://github.com/apache/inlong/issues/6545) |
[Improve][Sort] Accurately parse the schema type and completely match the
missing precision information |
### Audit
-| ISSUE | Summary
|
-|:-----------------------------------------------------------:|:------------------------------------------------------------------------------|
-| [INLONG-6852](https://github.com/apache/inlong/issues/6852) |
[Improve][Audit] agent and dataproxy report audit data when the program exits |
+| ISSUE | Summary
|
+|:-----------------------------------------------------------:|:------------------------------------------------------------------------------------------|
+| [INLONG-7646](https://github.com/apache/inlong/issues/7646) | [Bug][Audit]
NPE when mq configuration is not registered |
+| [INLONG-7641](https://github.com/apache/inlong/issues/7641) |
[Feature][Script] Modify script for Audit standalone deployment
|
+| [INLONG-7636](https://github.com/apache/inlong/issues/7636) |
[Feature][Docker] Modify the Kafka config for Audit docker deployment
|
+| [INLONG-7413](https://github.com/apache/inlong/issues/7413) |
[Feature][Audit] Proxy and Store get MQ address from the Manager service
|
### Dashboard
-| ISSUE | Summary
|
-|:-----------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------------------------|
-| [INLONG-7092](https://github.com/apache/inlong/issues/7092) |
[Feature][Dashboard] Source and Sink as sub-concepts of Stream
|
-| [INLONG-7064](https://github.com/apache/inlong/issues/7064) |
[Improve][Dashboard] Update the FilePathHelp value
|
-| [INLONG-7063](https://github.com/apache/inlong/issues/7063) |
[Improve][Dashboard] Optimize the topic name of the new consumption page
|
-| [INLONG-7047](https://github.com/apache/inlong/issues/7047) |
[Improve][Dashboard] Specific meanings of data subscription list fields
|
-| [INLONG-7045](https://github.com/apache/inlong/issues/7045) |
[Improve][Dashboard] Change the verification of InlongGroupId
|
-| [INLONG-7043](https://github.com/apache/inlong/issues/7043) |
[Improve][Dashboard] Add field prompt for ES sink
|
-| [INLONG-7032](https://github.com/apache/inlong/issues/7032) |
[Improve][Dashboard] Group creation page split basic information and MQ
information |
-| [INLONG-7024](https://github.com/apache/inlong/issues/7024) |
[Improve][Dashboard] Type readable lowercase and title optimization in data
integration |
-| [INLONG-7016](https://github.com/apache/inlong/issues/7016) |
[Improve][Dashboard] Approve page supports multiple columns
|
-| [INLONG-7005](https://github.com/apache/inlong/issues/7005) |
[Feature][Dashboard] Support StarRocks node management
|
-| [INLONG-7000](https://github.com/apache/inlong/issues/7000) |
[Improve][Dashboard] Add AVRO format for InlongStream
|
-| [INLONG-6998](https://github.com/apache/inlong/issues/6998) |
[Feature][Dashboard][Manager] Support ignore deserialization error data
|
-| [INLONG-7009](https://github.com/apache/inlong/issues/7009) |
[Improve][Dashboard] The data node type supports lowercase
|
-| [INLONG-6996](https://github.com/apache/inlong/issues/6996) |
[Improve][Dashboard] Add JSON format for InlongStream
|
-| [INLONG-6994](https://github.com/apache/inlong/issues/6994) |
[Improve][Dashboard] Add MQ type filter box for inlong group and consume list
|
-| [INLONG-6987](https://github.com/apache/inlong/issues/6987) |
[Improve][Dashboard] Writing standard when splicing Chinese and English words
|
-| [INLONG-6983](https://github.com/apache/inlong/issues/6983) |
[Improve][Dashboard] Group page supports multiple columns
|
-| [INLONG-6982](https://github.com/apache/inlong/issues/6982) |
[Improve][Dashboard] Data source and data storage bullet box title optimization
|
-| [INLONG-6980](https://github.com/apache/inlong/issues/6980) |
[Improve][Dashboard] Optimize the detail page of InlongGroup and InlongStream
|
-| [INLONG-6975](https://github.com/apache/inlong/issues/6975) |
[Bug][Dashboard] The cluster name of the File source does not support
modification |
-| [INLONG-6972](https://github.com/apache/inlong/issues/6972) |
[Improve][Dashboard] Change all "consumption" to "subscription" for data
consumption |
-| [INLONG-6961](https://github.com/apache/inlong/issues/6961) |
[Feature][Dashboard][Manager] Support for handling non-InlongMsg formats
|
-| [INLONG-6940](https://github.com/apache/inlong/issues/6940) |
[Improve][Dashboard]Type name correction
|
-| [INLONG-6948](https://github.com/apache/inlong/issues/6948) |
[Improve][Dashboard] Reset and modify the password input box
|
-| [INLONG-6935](https://github.com/apache/inlong/issues/6935) |
[Improve][Dashboard] Add Key-Value format for InlongStream
|
-| [INLONG-6930](https://github.com/apache/inlong/issues/6930) |
[Improve][Dashboard] Create a new cluster token placeholder configuration i18n
|
-| [INLONG-6926](https://github.com/apache/inlong/issues/6926) |
[Improve][Dashboard] Change the cluster type and tag to lower case
|
-| [INLONG-6923](https://github.com/apache/inlong/issues/6923) |
[Improve][Dashboard] Application and Approval Interchange for Approval
Management |
-| [INLONG-6916](https://github.com/apache/inlong/issues/6916) |
[Improve][Dashboard] MQ type adds partition limit
|
-| [INLONG-6904](https://github.com/apache/inlong/issues/6904) |
[Improve][Dashboard] File source type supports selecting agent cluster
|
-| [INLONG-6900](https://github.com/apache/inlong/issues/6900) |
[Improve][Dashboard] Support pulling up the field list of Source in Sink
|
-| [INLONG-6874](https://github.com/apache/inlong/issues/6874) |
[Improve][Dashboard] Stream removes the Raw-CSV data format
|
-| [INLONG-6865](https://github.com/apache/inlong/issues/6865) |
[Improve][Dashboard] Support npm ci command for stable package-lock
|
-| [INLONG-6843](https://github.com/apache/inlong/issues/6843) |
[Improve][Dashboard] ES datanode parameter improvement
|
-| [INLONG-6837](https://github.com/apache/inlong/issues/6837) |
[Improve][Dashboard] ES sink support version), documentType and primaryKey
options |
-| [INLONG-6826](https://github.com/apache/inlong/issues/6826) |
[Feature][Dashboard] Support loading different plugins using different loaders
|
-| [INLONG-6824](https://github.com/apache/inlong/issues/6824) |
[Feature][Dashboard] Support StarRocks sink
|
-| [INLONG-6800](https://github.com/apache/inlong/issues/6800) |
[Improve][Dashboard] MySQL sink supports selecting MySQL nodes
|
-| [INLONG-6786](https://github.com/apache/inlong/issues/6786) |
[Feature][Dashboard] Supoort Apache Hudi sink management
|
-| [INLONG-6775](https://github.com/apache/inlong/issues/6775) |
[Bug][Dashboard] There is a risk of source code exposure in the production
environment |
-| [INLONG-6772](https://github.com/apache/inlong/issues/6772) |
[Feature][Dashboard] Support ClickHouse node management
|
-| [INLONG-6761](https://github.com/apache/inlong/issues/6761) |
[Feature][Dashboard] Support Iceberg node management
|
-| [INLONG-6758](https://github.com/apache/inlong/issues/6758) |
[Improve][Dashboard] Unify the log function components of Group and Stream
|
-| [INLONG-6744](https://github.com/apache/inlong/issues/6744) |
[Improve][Dashboard] Hive sink supports selecting hive nodes
|
-| [INLONG-6699](https://github.com/apache/inlong/issues/6699) |
[Feature][Dashboard] Support MQTT source
|
-| [INLONG-6694](https://github.com/apache/inlong/issues/6694) |
[Improve][Dashboard] Create with filter value first, if there is a filter
plugin |
-| [INLONG-6680](https://github.com/apache/inlong/issues/6680) |
[Bug][Dashboard] Set the plugin to default when there is no target plugin
|
-| [INLONG-6678](https://github.com/apache/inlong/issues/6678) |
[Improve][Dashboard] Add sinkType parameter in sinkFieldList
|
-| [INLONG-6661](https://github.com/apache/inlong/issues/6661) |
[Improve][Dashboard] Support Elasticsearch DataNode
|
-| [INLONG-6651](https://github.com/apache/inlong/issues/6651) |
[Improve][Dashboard] Add settings for data report type
|
-| [INLONG-6581](https://github.com/apache/inlong/issues/6581) |
[Bug][Dashboard] The file format prompt of the FILE source is wrong
|
-| [INLONG-6572](https://github.com/apache/inlong/issues/6572) |
[Improve][Dashboard] Stream is not deleted by default when the sink is deleted
|
-| [INLONG-6565](https://github.com/apache/inlong/issues/6565) |
[Bug][Dashboard] The operation of refreshing the sink configuration needs to be
executed when the group configuration is successful |
-| [INLONG-6542](https://github.com/apache/inlong/issues/6542) |
[Improve][Dashboard] Optimize stream execution workflow and execution log
|
-| [INLONG-6511](https://github.com/apache/inlong/issues/6511) |
[Bug][Dashboard] The Select/AutoComplete component in EditableTable will
mistakenly change the value and cause re-rendering |
-| [INLONG-6504](https://github.com/apache/inlong/issues/6504) |
[Feature][Dashboard] Support stream to view execution log and execute workflow
|
-| [INLONG-6498](https://github.com/apache/inlong/issues/6498) |
[Improve][Dashboard] Field resolution for unified inlong group approval
|
-| [INLONG-6493](https://github.com/apache/inlong/issues/6493) |
[Bug][Dashboard] After the Stream is configured successfully), some parameters
cannot be modified |
-| [INLONG-6482](https://github.com/apache/inlong/issues/6482) |
[Improve][Dashboard] Sink management distinguishes between save-only and
save-and-submit processes |
-| [INLONG-6481](https://github.com/apache/inlong/issues/6481) |
[Feature][Dashboard] Supports management of SQLServer source
|
-| [INLONG-6456](https://github.com/apache/inlong/issues/6456) |
[Feature][Dashboard] Supports management of Oracle sources
|
-| [INLONG-6418](https://github.com/apache/inlong/issues/6418) |
[Feature][Dashboard] Support management of MongoDB source
|
+| ISSUE | Summary
|
+|:-----------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------------|
+| [INLONG-7955](https://github.com/apache/inlong/issues/7955) |
[Improve][Dashboard] Change the consumption query method from get to post
|
+| [INLONG-7929](https://github.com/apache/inlong/issues/7929) |
[Bug][Dashboard] The select box cannot be triggered when the form is not
entered |
+| [INLONG-7918](https://github.com/apache/inlong/issues/7918) |
[Improve][Dashboard] File source cluster name is displayed as displayName
|
+| [INLONG-7915](https://github.com/apache/inlong/issues/7915) |
[Improve][Dashboard] Clickhouse sink engine field optimization
|
+| [INLONG-7871](https://github.com/apache/inlong/issues/7871) |
[Improve][Dashboard] MySQL source supports filling in the database name
whitelist |
+| [INLONG-7852](https://github.com/apache/inlong/issues/7852) |
[Improve][Dashboard] Clickhouse supports setting cluster when creating a table
|
+| [INLONG-7833](https://github.com/apache/inlong/issues/7833) |
[Improve][Dashboard] Process optimization for creating source and sink
|
+| [INLONG-7826](https://github.com/apache/inlong/issues/7826) |
[Improve][Dashboard] Supports filling in the life cycle when the Clickhouse
sink engine is ReplicatedMergeTree |
+| [INLONG-7802](https://github.com/apache/inlong/issues/7802) |
[Improve][Dashboard] Requirements for optimizing data sources
|
+| [INLONG-7796](https://github.com/apache/inlong/issues/7796) |
[Improve][Dashboard] Add icon to menu
|
+| [INLONG-7789](https://github.com/apache/inlong/issues/7789) |
[Feature][Dashboard] Support create stream fields by statement
|
+| [INLONG-7785](https://github.com/apache/inlong/issues/7785) |
[Improve][Dashboard] Clickhouse sink engine defaults to MergeTree
|
+| [INLONG-7772](https://github.com/apache/inlong/issues/7772) |
[Improve][Dashboard] Redis sentinel master name normalization in NodeManagement
|
+| [INLONG-7758](https://github.com/apache/inlong/issues/7758) |
[Bug][Dashboard] Login page display error
|
+| [INLONG-7756](https://github.com/apache/inlong/issues/7756) |
[Bug][Dashboard] Group logs can not display
|
+| [INLONG-7749](https://github.com/apache/inlong/issues/7749) |
[Improve][Dashboard] Support rate limit for pulsar mq mark-delete operation
|
+| [INLONG-7738](https://github.com/apache/inlong/issues/7738) |
[Improve][Dashboard] The name and type of cluster and node cannot be modified
|
+| [INLONG-7734](https://github.com/apache/inlong/issues/7734) |
[Feature][Dashboard] Update Dashbaord layout & folder design
|
+| [INLONG-7728](https://github.com/apache/inlong/issues/7728) |
[Feature][Dashboard] Extract the cluster properties of Redis NodeManagement
|
+| [INLONG-7702](https://github.com/apache/inlong/issues/7702) |
[Improve][Dashboard] Add Chinese name for partitionKeys properties of Hudi
LoadNode |
+| [INLONG-7672](https://github.com/apache/inlong/issues/7672) |
[Feature][Dashboard] Support kudu node management
|
+| [INLONG-7668](https://github.com/apache/inlong/issues/7668) |
[Feature][Dashboard] InLong source supports restart and freeze operations
|
+| [INLONG-7643](https://github.com/apache/inlong/issues/7643) |
[Feature][Dashboard] Support specifying buckets when creating kudu resource
|
+| [INLONG-7630](https://github.com/apache/inlong/issues/7630) |
[Bug][Dashboard] The page flickers when the route is switched
|
+| [INLONG-7004](https://github.com/apache/inlong/issues/7004) |
[Feature][Dashboard][Manager] Creating schema of StreamSource by Statement
|
+| [INLONG-7971](https://github.com/apache/inlong/issues/7971) |
[Feature][Dashboard] Support batch import fields by Excel
|
### Other
-| ISSUE | Summary
|
-|:-----------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------------------------|
-| [INLONG-7098](https://github.com/apache/inlong/issues/7098) |
[Improve][Common] Add UUID in MonitorIndex
|
-| [INLONG-7093](https://github.com/apache/inlong/issues/7093) | [Improve][SDK]
Add report time metric
|
-| [INLONG-7035](https://github.com/apache/inlong/issues/7035) | [Bug][SDK] The
message id in DataProxy is not globally unique
|
-| [INLONG-6955](https://github.com/apache/inlong/issues/6955) |
[Improve][Script] Support starts the DataProxy with Kafka in the deployment
script |
-| [INLONG-6946](https://github.com/apache/inlong/issues/6946) | [Feature][SDK]
Support to consume subset of message queue cluster or topic
|
-| [INLONG-6945](https://github.com/apache/inlong/issues/6945) | [Feature][SDK]
Unify metrics report model of SortSDK
|
-| [INLONG-6944](https://github.com/apache/inlong/issues/6944) | [Feature][SDK]
Remove useless code of SortSDK
|
-| [INLONG-6893](https://github.com/apache/inlong/issues/6893) | [Bug][CI]
Build and Push docker image skipped
|
-| [INLONG-6888](https://github.com/apache/inlong/issues/6888) | [Bug][CI] All
Docker workflow failed
|
-| [INLONG-6882](https://github.com/apache/inlong/issues/6882) |
[Improve][Docker] Update the docker-compose version requirement in the readme
|
-| [INLONG-6879](https://github.com/apache/inlong/issues/6879) | [Improve][CI]
Use ubuntu-22.04 to replace ubuntu-latest for workflows
|
-| [INLONG-6867](https://github.com/apache/inlong/issues/6867) | [Improve][CVE]
Protobuf Java vulnerable to Uncontrolled Resource Consumption
|
-| [INLONG-6862](https://github.com/apache/inlong/issues/6862) |
[Improve][License] Use spotless to apply the asf header
|
-| [INLONG-6841](https://github.com/apache/inlong/issues/6841) |
[Improve][Docker] Integrate InLong template to Grafana
|
-| [INLONG-6838](https://github.com/apache/inlong/issues/6838) | [Feature]
Support multi addresses for ES load node
|
-| [INLONG-6810](https://github.com/apache/inlong/issues/6810) | [Improve][Pom]
Versions for protobuf-maven-plugin and os-maven-plugin are not consistent
|
-| [INLONG-6787](https://github.com/apache/inlong/issues/6787) | [Feature][Doc]
Add the usage document for Apache Hudi
|
-| [INLONG-6777](https://github.com/apache/inlong/issues/6777) | [Improve][CVE]
Password exposure in H2 Database
|
-| [INLONG-6685](https://github.com/apache/inlong/issues/6685) | [Bug][Script]
The bin/init-config.sh compatible with MacOS
|
-| [INLONG-6673](https://github.com/apache/inlong/issues/6673) | [Improve][CVE]
Apache Shiro Authentication Bypass vulnerability
|
-| [INLONG-6624](https://github.com/apache/inlong/issues/6624) | [Improve][Doc]
Add Stargazers and Contributor chart for readme
|
-| [INLONG-6555](https://github.com/apache/inlong/issues/6555) | [Improve][CI]
The `set-output` command is deprecated and will be disabled soon
|
-| [INLONG-6550](https://github.com/apache/inlong/issues/6550) | [Bug][SDK]
Decode heartbeat response error
|
-| [INLONG-6522](https://github.com/apache/inlong/issues/6522) |
[Improve][Docker] Add notes for building ARM images
|
-| [INLONG-6475](https://github.com/apache/inlong/issues/6475) |
[Feature][Docker] Add a base flink environment for docker-compose
|
-| [INLONG-6459](https://github.com/apache/inlong/issues/6459) | [Improve][CI]
Match the branch-version as release branch
|
-| [INLONG-6429](https://github.com/apache/inlong/issues/6429) | [Umbrella]
Release InLong 1.4.0
|
-| [INLONG-6417](https://github.com/apache/inlong/issues/6417) | [Improve][SDK]
Support proxy-send mode
|
-| [INLONG-5669](https://github.com/apache/inlong/issues/5669) | [Improve][SDK]
Extract SortClientConfig parameters key to constants
|
-| [INLONG-5231](https://github.com/apache/inlong/issues/5231) |
[Improve][CodeStyle] Add spotless to CI
|
-| [INLONG-4957](https://github.com/apache/inlong/issues/4957) | [Umbrella] Add
Grafana Metrics Dashboard
|
+| ISSUE | Summary
|
+|:-----------------------------------------------------------:|:------------------------------------------------------------------------------------------------------|
+| [INLONG-7909](https://github.com/apache/inlong/issues/7909) | [Bug]Capture
changes made by connector user & document that SYS/SYSTEM changes are not
captured |
+| [INLONG-7892](https://github.com/apache/inlong/issues/7892) | [bug] multiple
times generating approval slips
|
+| [INLONG-7876](https://github.com/apache/inlong/issues/7876) | [Improve][CVE]
Upgrade org.springframework:spring-core to 5.3.27
|
+| [INLONG-7781](https://github.com/apache/inlong/issues/7781) | [Bug]
[InLong-SDK] Solve the problem of cpp-sdk send data by HTTP protocol
|
+| [INLONG-7745](https://github.com/apache/inlong/issues/7745) | [Improve][CVE]
Spring Framework vulnerable to denial of service via specially crafted SpEL
expression |
+| [INLONG-7742](https://github.com/apache/inlong/issues/7742) |
[Improve][Tool] Only support inlong-dev-toolkit on MacOS and Linux
|
+| [INLONG-7698](https://github.com/apache/inlong/issues/7698) | [Bug][Docker]
docker images build faild for tubemq-build
|
+| [INLONG-7697](https://github.com/apache/inlong/issues/7697) | [Feature]
Reduce the memory usage of JM when split table chunks
|
\ No newline at end of file
