This is an automated email from the ASF dual-hosted git repository. aloyszhang pushed a change to branch dev-offline-sync in repository https://gitbox.apache.org/repos/asf/inlong.git
discard dadc2d194e [INLONG-9862][Manager] Support submit flink job for offline sync (#9865) discard ddc72ed417 [INLONG-9822][Manager] Support flink job runtime execution mode configuration (#9823) discard e66cf075fe [INLONG-9813][Manager] Support offline data sync management (#9814) discard cfd9136286 [INLONG-9781][Manager] Add offline sync task type definition (#9787) add 3b70a93d96 [INLONG-10145][Manager] Change spring version 5.3.32 to 5.3.34. (#10149) add 762a026a47 [INLONG-10147][Audit] Less usage costs when the Audit uses the MySQL as storage (#10151) add 2c2e52b568 [INLONG-10150][Manager] Remove metrics. audit. proxy. hosts from flink-sort-plugins. properties (#10153) add 9bd422ffe9 [INLONG-10144][Sort] Redis connectors support audit ID (#10146) add e40550c30a [INLONG-10154][SDK] Support to transform CSV/KV data to CSV/KV data without field list configuration (#10155) add 00595bb156 [INLONG-10157][Audit] Use a custom thread pool instead of the system thread pool (#10158) add 011e96ba95 [INLONG-10152][Sort] Refactor MetricOption code structure. (#10156) add 0fd55f85b5 [INLONG-10162][DataProxy] Upgrade golang.org/x/net to version 0.23.0. (#10163) add d34dcc0bc6 [INLONG-10161][DataProxy] Upgrade google.golang.org/protobuf v1.32.0 to v1.34.1 (#10165) add c060b8a566 [INLONG-10171][Audit] Update the standalone deploy scripts for the audit service (#10172) add 9407b2f757 [INLONG-10167][TubeMQ] Upgrade google.golang.org/protobuf v1.23.0 to v1.34.1 (#10168) add 384ca56494 [INLONG-10169][Manager] Support configure sort cluster for kafka (#10170) add bc7a2d99f2 [INLONG-10176][Manager] Fix the problem of sort_config table creation statement error (#10177) add 4da8c8e392 [INLONG-10125][Script] Fix the agent can not start successfully (#10175) add c37301897a [INLONG-10160][Sort] Upgrade elasticsearch version 7.9.2 to 7.17.13 (#10166) add fb10c2b6e2 [INLONG-10124][Script] Update the scripts for standalone deployment (#10178) add ce1ca12799 [INLONG-10181][Manager] Remove useless exceptions for DataNodeOperator.getNodeConfig (#10182) add 888c6aab52 [INLONG-10184][SDK] The header in ProxyEvent need contain both 'rtms' and 'auditVersion'. (#10185) add 1bfac499b5 [INLONG-10173][Sort] SortStandalone support request unified configuration (#10174) add 632aa88e44 [INLONG-10187][Agent] Handle situations where time offset is empty (#10188) add 808cf799c8 [INLONG-10091][Agent] Delete the useless code related to 8008 listen port (#10192) add bbd29d961e [INLONG-10197][Manager] Support OpenAPI for querying audit data (#10199) add cdf81cd791 [INLONG-10200][Manager] Define module type mapping relationships (#10203) add 50fc3024b6 [INLONG-10205][Script] Add the metrics.audit.proxy.hosts for standalone deployment (#10206) add f91542b75a [INLONG-10179][DashBoard] Remove the All types In cluster management (#10209) add 1fa64267e3 [INLONG-10204][Manager] Kafka sink supports automatic allocation of sort standalone cluster (#10207) add 06d5e370ec [INLONG-10201][Audit] Renamed configuration variables for clarity (#10202) add 61d2b74ce1 [INLONG-10189][Agent] Handling SDK initialization exceptions (#10190) add 065392d3a2 [INLONG-10210][Agent] Add a script for environment initialization (#10211) add 3b6600baf2 [INLONG-10096][Manager] Support installing agents by SSH (#10098) add 974ef70d7f [INLONG-10215][DashBoard] Add default value for file data source in data access module (#10216) add e8dbf282bf [INLONG-10076][Manager] Doris data node supports test connections (#10217) add e68c69f986 [INLONG-10208][Sort] ClsSink support unified configuration (#10220) add c5dbfabf22 [INLONG-10194][Sort] Sqlserver connector support audit ID (#10212) add d77048497a [INLONG-10213][SDK] SortSDK support unified sort configuration (#10219) add 540fd51fb4 [INLONG-10193][Sort] Postgres connector support audit ID (#10198) add 11e52ba618 [INLONG-10221][SDK] DataProxy SDK of cpp supports automatic installation of log4cplus components (#10222) add a81d7cf286 [INLONG-10183][Sort] MongoDB connector support audit ID (#10186) add 54f831aad5 [INLONG-10226][Dashboard] Fix audit item search failure (#10227) add b9c9688fc5 [INLONG-10159][Sort] Kafka connector support audit ID (#10180) new 57d7f733c7 [INLONG-9781][Manager] Add offline sync task type definition (#9787) new 06a84650c7 [INLONG-9813][Manager] Support offline data sync management (#9814) new 9024c1b58d [INLONG-9822][Manager] Support flink job runtime execution mode configuration (#9823) new 6996891c69 [INLONG-9862][Manager] Support submit flink job for offline sync (#9865) new 2932887cb5 Support scheudle infomartion management This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (dadc2d194e) \ N -- N -- N refs/heads/dev-offline-sync (2932887cb5) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 5 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: bin/init-config.sh | 22 +- bin/inlong-daemon | 9 +- conf/inlong.conf | 11 +- docker/docker-compose/docker-compose.yml | 4 +- .../inlong/agent/constant/AgentConstants.java | 2 - .../org/apache/inlong/agent/plugin/Instance.java | 2 + .../apache/inlong/agent/pojo/TaskProfileDto.java | 5 +- .../apache/inlong/agent/core/HeartbeatManager.java | 5 - .../agent/core/instance/InstanceManager.java | 11 + .../apache/inlong/agent/core/task/TaskManager.java | 2 +- .../inlong/agent/core/instance/MockInstance.java | 6 + inlong-agent/agent-docker/Dockerfile | 1 - inlong-agent/agent-docker/README.md | 2 +- inlong-agent/agent-installer/assembly.xml | 10 + inlong-agent/agent-installer/environment/init.sh | 20 + .../agent/plugin/instance/CommonInstance.java | 38 +- inlong-agent/conf/agent.properties | 4 - .../apache/inlong/audit/file/ConfigManager.java | 2 +- inlong-audit/audit-docker/Dockerfile | 1 + inlong-audit/audit-docker/audit-docker.sh | 2 +- .../inlong/audit/config/ConfigConstants.java | 3 + .../inlong/audit/config/OpenApiConstants.java | 2 +- .../apache/inlong/audit/service/ConfigService.java | 35 + .../org/apache/inlong/audit/source/JdbcSource.java | 8 +- .../audit/service/AuditMsgConsumerServer.java | 2 +- .../src/test/resources/application-test.properties | 4 +- inlong-audit/bin/service-stop.sh | 2 +- inlong-audit/conf/application.properties | 9 +- inlong-audit/conf/audit-service.properties | 8 +- .../inlong/common/pojo/sort/SortClusterConfig.java | 4 + .../apache/inlong/common/pojo/sort/SortConfig.java | 8 +- .../SortConfigResponse.java | 2 +- .../inlong/common/pojo/sort/SortTaskConfig.java | 4 + .../common/pojo/sort/dataflow/DataFlowConfig.java | 7 + .../common/pojo/sort/mq/PulsarClusterConfig.java | 3 + .../pojo/sortstandalone/SortClusterConfig.java | 1 + .../pojo/sortstandalone/SortClusterResponse.java | 1 + .../common/pojo/sortstandalone/SortTaskConfig.java | 1 + .../plugins/clusters/common/ClusterDefaultInfo.ts | 2 +- .../src/plugins/sources/defaults/File.ts | 6 +- .../src/ui/pages/GroupDetail/Audit/config.tsx | 8 +- .../src/ui/pages/ModuleAudit/IdModule/config.tsx | 16 +- .../src/ui/pages/ModuleAudit/IpModule/config.tsx | 16 +- .../inlong/manager/common/consts/SinkType.java | 1 + .../inlong/manager/common/enums/ClusterType.java | 2 + .../inlong/manager/common/enums/ErrorCodeEnum.java | 3 + .../inlong/manager/common/enums/ModuleType.java | 26 +- .../manager/common/enums/OperationTarget.java | 4 +- .../manager/common/enums/ScheduleStatus.java | 29 + .../dao/entity/InlongClusterNodeEntity.java | 3 + .../inlong/manager/dao/entity/ScheduleEntity.java | 41 ++ .../manager/dao/mapper/ScheduleEntityMapper.java | 16 + .../mappers/InlongClusterNodeEntityMapper.xml | 39 +- .../resources/mappers/ScheduleEntityMapper.xml | 120 +++ inlong-manager/manager-docker/Dockerfile | 1 - inlong-manager/manager-docker/manager-docker.sh | 1 - .../manager/plugin/flink/dto/FlinkConfig.java | 2 - .../inlong/manager/plugin/util/FlinkUtils.java | 2 - .../main/resources/flink-sort-plugin.properties | 3 - .../manager/pojo/cluster/ClusterNodeRequest.java | 9 + .../manager/pojo/cluster/ClusterNodeResponse.java | 9 + .../cluster/sort/kafka/SortKafkaClusterInfo.java | 26 +- .../sort/kafka/SortKafkaClusterRequest.java | 24 +- .../inlong/manager/pojo/schedule/ScheduleInfo.java | 57 ++ .../manager/pojo/schedule/ScheduleInfoRequest.java | 56 ++ .../service/cluster/SortClusterOperator.java | 5 + .../node/AgentClusterNodeInstallOperator.java | 96 ++- .../manager/service/cmd/CommandExecutor.java | 40 + .../manager/service/cmd/CommandExecutorImpl.java | 120 +++ .../inlong/manager/service/cmd/CommandResult.java | 63 +- .../manager/service/cmd/shell/ShellExecutor.java | 21 +- .../service/cmd/shell/ShellExecutorImpl.java | 131 ++++ .../manager/service/cmd/shell/ShellTracker.java | 16 +- .../inlong/manager/service/core/SortService.java | 2 +- .../service/core/impl/AgentServiceImpl.java | 6 +- .../manager/service/core/impl/SortServiceImpl.java | 4 +- .../listener/queue/ClusterConfigListener.java | 1 + .../service/node/AbstractDataNodeOperator.java | 3 +- .../manager/service/node/DataNodeServiceImpl.java | 1 - .../service/node/doris/DorisDataNodeOperator.java | 22 + .../resource/sink/kafka/KafkaResourceOperator.java | 6 +- .../resource/sort/DefaultSortConfigOperator.java | 3 + .../manager/service/schedule/ScheduleService.java | 45 ++ .../service/schedule/ScheduleServiceImpl.java | 96 +++ .../main/resources/h2/apache_inlong_manager.sql | 6 +- .../manager-web/sql/apache_inlong_manager.sql | 44 +- inlong-manager/manager-web/sql/changes-1.12.0.sql | 7 +- .../manager-web/sql/changes-1.13.0.sql | 25 +- .../web/controller/InLongSchedulerController.java | 65 ++ .../web/controller/openapi/AuditController.java | 21 + .../web/controller/openapi/SortController.java | 2 +- .../src/main/resources/application-dev.properties | 13 +- .../src/main/resources/application-prod.properties | 11 +- .../src/main/resources/application-test.properties | 11 +- .../src/main/resources/exec_cmd.exp} | 41 +- .../dataproxy-sdk-cpp/CMakeLists.txt | 2 +- .../dataproxy-sdk-twins/dataproxy-sdk-cpp/build.sh | 10 +- .../dataproxy-sdk-cpp/third_party/CMakeLists.txt | 7 + .../dataproxy-sdk-golang/go.mod | 7 +- .../dataproxy-sdk-golang/go.sum | 34 +- .../inlong/sdk/commons/protocol/ProxyEvent.java | 12 + .../sdk/transform/decode/CsvSourceDecoder.java | 2 +- .../sdk/transform/encode/CsvSinkEncoder.java | 29 +- .../sdk/transform/encode/DefaultSinkData.java | 15 +- .../inlong/sdk/transform/encode/KvSinkEncoder.java | 18 +- .../inlong/sdk/transform/encode/SinkData.java | 6 +- .../inlong/sdk/transform/pojo/CsvSinkInfo.java | 7 +- .../inlong/sdk/transform/pojo/CsvSourceInfo.java | 7 +- .../inlong/sdk/transform/pojo/KvSinkInfo.java | 7 +- .../inlong/sdk/transform/pojo/KvSourceInfo.java | 7 +- .../sdk/transform/process/TransformProcessor.java | 4 +- .../transform/process/operator/OperatorTools.java | 6 + .../transform/process/TestTransformProcessor.java | 434 ++++++----- .../config/holder/SortClusterConfigHolder.java | 1 + .../config/holder/v2/SortConfigHolder.java | 167 +++++ .../ClassResourceSortClusterConfigLoader.java | 1 + .../loader/ManagerSortClusterConfigLoader.java | 1 + .../config/loader/SortClusterConfigLoader.java | 1 + .../loader/SortConfigQueryConsumeConfig.java | 90 +++ .../ClassResourceSortClusterConfigLoader.java | 35 +- .../{ => v2}/ManagerSortClusterConfigLoader.java | 52 +- .../config/loader/v2/SortConfigLoader.java | 13 +- .../standalone/utils/FlumeConfigGenerator.java | 1 + .../utils/{ => v2}/FlumeConfigGenerator.java | 82 +-- .../apache/inlong/sort/standalone/SortCluster.java | 1 + .../apache/inlong/sort/standalone/SortTask.java | 1 + .../inlong/sort/standalone/sink/SinkContext.java | 1 + .../sort/standalone/sink/cls/ClsIdConfig.java | 49 +- .../inlong/sort/standalone/sink/cls/ClsSink.java | 26 +- .../sort/standalone/sink/cls/ClsSinkContext.java | 167 +---- .../sort/standalone/sink/{ => v2}/SinkContext.java | 108 +-- .../source/sortsdk/v2/SortSdkSource.java | 205 ++++++ .../sort/standalone/{ => v2}/SortCluster.java | 53 +- .../inlong/sort/standalone/{ => v2}/SortTask.java | 125 ++-- .../sort/standalone/sink/cls/TestClsIdConfig.java | 4 +- .../sink/cls/TestDefaultEvent2LogItemHandler.java | 3 +- .../inlong/sort/parser/ESMultipleSinkTest.java | 126 ---- .../sort/parser/Elasticsearch7SqlParseTest.java | 31 - .../inlong/sort/base/metric/MetricOption.java | 87 +-- .../inlong/sort/base/metric/SinkMetricData.java | 2 +- .../inlong/sort/base/metric/SourceMetricData.java | 4 +- .../Elasticsearch7ApiCallBridge.java | 2 +- .../MultipleRowElasticsearchSinkFunction.java | 2 +- .../RowElasticsearchSinkFunction.java | 2 +- .../table/Elasticsearch7DynamicSink.java | 2 +- .../table/DynamicKafkaDeserializationSchema.java | 289 ++++++++ .../DynamicKafkaRecordSerializationSchema.java | 200 +++++ .../kafka/table/KafkaConnectorOptionsUtil.java | 298 ++++---- .../inlong/sort/kafka/table/KafkaDynamicSink.java | 496 +++++++++++++ .../sort/kafka/table/KafkaDynamicSource.java | 637 ++++++++++++++++ .../sort/kafka/table/KafkaDynamicTableFactory.java | 80 +- .../sort/kafka/{ => table}/KafkaOptions.java | 7 +- .../sort/kafka/table/ReducingUpsertSink.java | 101 +++ .../sort/kafka/table/ReducingUpsertWriter.java | 200 +++++ .../table/UpsertKafkaDynamicTableFactory.java | 47 +- .../MongoDBConnectorDeserializationSchema.java | 805 +++++++++++++++++++++ .../inlong/sort/mongodb/MongoDBTableFactory.java | 15 +- .../inlong/sort/mongodb/MongoDBTableSource.java | 337 +++++++++ .../sort/postgre/PostgreSQLTableFactory.java | 22 +- .../inlong/sort/postgre/PostgreSQLTableSource.java | 262 +++++++ .../sort/postgre/PostgresValueValidator.java | 51 ++ .../postgre/RowDataDebeziumDeserializeSchema.java | 678 +++++++++++++++++ .../sort/redis/source/RedisDynamicTableSource.java | 22 +- .../redis/source/RedisRowDataLookupFunction.java | 18 +- .../sort/redis/table/RedisDynamicTableFactory.java | 7 +- .../RowDataDebeziumDeserializeSchema.java | 674 +++++++++++++++++ .../sort/sqlserver/SqlServerTableSource.java | 254 +++++++ .../sort/sqlserver/SqlserverTableFactory.java | 20 +- .../tubemq-client-twins/tubemq-client-go/go.mod | 4 +- .../tubemq-client-twins/tubemq-client-go/go.sum | 25 +- licenses/inlong-audit/LICENSE | 16 +- licenses/inlong-audit/NOTICE | 2 +- .../inlong-audit/licenses/LICENSE-spring-aop.txt | 4 +- .../inlong-audit/licenses/LICENSE-spring-beans.txt | 4 +- .../licenses/LICENSE-spring-context.txt | 4 +- .../inlong-audit/licenses/LICENSE-spring-core.txt | 4 +- .../licenses/LICENSE-spring-expression.txt | 4 +- .../inlong-audit/licenses/LICENSE-spring-jcl.txt | 4 +- .../inlong-audit/licenses/LICENSE-spring-jdbc.txt | 4 +- .../inlong-audit/licenses/LICENSE-spring-tx.txt | 4 +- licenses/inlong-manager/LICENSE | 22 +- licenses/inlong-manager/NOTICE | 4 +- .../inlong-manager/licenses/LICENSE-spring-aop.txt | 4 +- .../licenses/LICENSE-spring-beans.txt | 4 +- .../licenses/LICENSE-spring-context-support.txt | 4 +- .../licenses/LICENSE-spring-context.txt | 4 +- .../licenses/LICENSE-spring-core.txt | 4 +- .../licenses/LICENSE-spring-expression.txt | 4 +- .../inlong-manager/licenses/LICENSE-spring-jcl.txt | 4 +- .../licenses/LICENSE-spring-jdbc.txt | 4 +- .../inlong-manager/licenses/LICENSE-spring-tx.txt | 4 +- .../inlong-manager/licenses/LICENSE-spring-web.txt | 4 +- .../licenses/LICENSE-spring-webmvc.txt | 4 +- licenses/inlong-sort-connectors/LICENSE | 62 +- licenses/inlong-tubemq-manager/LICENSE | 24 +- licenses/inlong-tubemq-manager/NOTICE | 6 +- .../licenses/LICENSE-spring-aop.txt | 4 +- .../licenses/LICENSE-spring-aspects.txt | 4 +- .../licenses/LICENSE-spring-beans.txt | 4 +- .../licenses/LICENSE-spring-context.txt | 4 +- .../licenses/LICENSE-spring-core.txt | 4 +- .../licenses/LICENSE-spring-expression.txt | 4 +- .../licenses/LICENSE-spring-jcl.txt | 4 +- .../licenses/LICENSE-spring-jdbc.txt | 4 +- .../licenses/LICENSE-spring-orm.txt | 4 +- .../licenses/LICENSE-spring-tx.txt | 4 +- .../licenses/LICENSE-spring-web.txt | 4 +- .../licenses/LICENSE-spring-webmvc.txt | 4 +- licenses/inlong-tubemq-server/LICENSE | 18 +- licenses/inlong-tubemq-server/NOTICE | 2 +- .../licenses/LICENSE-spring-aop.txt | 4 +- .../licenses/LICENSE-spring-beans.txt | 4 +- .../licenses/LICENSE-spring-context.txt | 4 +- .../licenses/LICENSE-spring-core.txt | 4 +- .../licenses/LICENSE-spring-expression.txt | 4 +- .../licenses/LICENSE-spring-jcl.txt | 4 +- .../licenses/LICENSE-spring-jdbc.txt | 4 +- .../licenses/LICENSE-spring-orm.txt | 4 +- .../licenses/LICENSE-spring-tx.txt | 4 +- pom.xml | 4 +- 220 files changed, 7956 insertions(+), 1684 deletions(-) create mode 100644 inlong-agent/agent-installer/environment/init.sh rename inlong-common/src/main/java/org/apache/inlong/common/pojo/{sortstandalone => sort}/SortConfigResponse.java (95%) create mode 100644 inlong-manager/manager-common/src/main/java/org/apache/inlong/manager/common/enums/ScheduleStatus.java create mode 100644 inlong-manager/manager-dao/src/main/java/org/apache/inlong/manager/dao/entity/ScheduleEntity.java create mode 100644 inlong-manager/manager-dao/src/main/java/org/apache/inlong/manager/dao/mapper/ScheduleEntityMapper.java create mode 100644 inlong-manager/manager-dao/src/main/resources/mappers/ScheduleEntityMapper.xml copy inlong-common/src/main/java/org/apache/inlong/common/pojo/sort/mq/PulsarClusterConfig.java => inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/cluster/sort/kafka/SortKafkaClusterInfo.java (60%) copy inlong-common/src/main/java/org/apache/inlong/common/pojo/sort/mq/PulsarClusterConfig.java => inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/cluster/sort/kafka/SortKafkaClusterRequest.java (60%) create mode 100644 inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/schedule/ScheduleInfo.java create mode 100644 inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/schedule/ScheduleInfoRequest.java create mode 100644 inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/cmd/CommandExecutor.java create mode 100644 inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/cmd/CommandExecutorImpl.java copy inlong-sdk/transform-sdk/src/main/java/org/apache/inlong/sdk/transform/encode/DefaultSinkData.java => inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/cmd/CommandResult.java (52%) copy inlong-sdk/transform-sdk/src/main/java/org/apache/inlong/sdk/transform/encode/SinkData.java => inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/cmd/shell/ShellExecutor.java (75%) create mode 100644 inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/cmd/shell/ShellExecutorImpl.java copy inlong-common/src/main/java/org/apache/inlong/common/pojo/sort/SortConfig.java => inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/cmd/shell/ShellTracker.java (72%) create mode 100644 inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/schedule/ScheduleService.java create mode 100644 inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/schedule/ScheduleServiceImpl.java copy inlong-common/src/main/java/org/apache/inlong/common/pojo/sort/dataflow/DataFlowConfig.java => inlong-manager/manager-web/sql/changes-1.13.0.sql (57%) create mode 100644 inlong-manager/manager-web/src/main/java/org/apache/inlong/manager/web/controller/InLongSchedulerController.java copy inlong-manager/{manager-plugins/base/src/main/resources/flink-sort-plugin.properties => manager-web/src/main/resources/exec_cmd.exp} (53%) create mode 100644 inlong-sort-standalone/sort-standalone-common/src/main/java/org/apache/inlong/sort/standalone/config/holder/v2/SortConfigHolder.java create mode 100644 inlong-sort-standalone/sort-standalone-common/src/main/java/org/apache/inlong/sort/standalone/config/loader/SortConfigQueryConsumeConfig.java copy inlong-sort-standalone/sort-standalone-common/src/main/java/org/apache/inlong/sort/standalone/config/loader/{ => v2}/ClassResourceSortClusterConfigLoader.java (69%) copy inlong-sort-standalone/sort-standalone-common/src/main/java/org/apache/inlong/sort/standalone/config/loader/{ => v2}/ManagerSortClusterConfigLoader.java (71%) copy inlong-manager/manager-common/src/main/java/org/apache/inlong/manager/common/enums/ModuleType.java => inlong-sort-standalone/sort-standalone-common/src/main/java/org/apache/inlong/sort/standalone/config/loader/v2/SortConfigLoader.java (77%) copy inlong-sort-standalone/sort-standalone-common/src/main/java/org/apache/inlong/sort/standalone/utils/{ => v2}/FlumeConfigGenerator.java (70%) copy inlong-sort-standalone/sort-standalone-source/src/main/java/org/apache/inlong/sort/standalone/sink/{ => v2}/SinkContext.java (75%) create mode 100644 inlong-sort-standalone/sort-standalone-source/src/main/java/org/apache/inlong/sort/standalone/source/sortsdk/v2/SortSdkSource.java copy inlong-sort-standalone/sort-standalone-source/src/main/java/org/apache/inlong/sort/standalone/{ => v2}/SortCluster.java (73%) copy inlong-sort-standalone/sort-standalone-source/src/main/java/org/apache/inlong/sort/standalone/{ => v2}/SortTask.java (57%) delete mode 100644 inlong-sort/sort-core/src/test/java/org/apache/inlong/sort/parser/ESMultipleSinkTest.java delete mode 100644 inlong-sort/sort-core/src/test/java/org/apache/inlong/sort/parser/Elasticsearch7SqlParseTest.java create mode 100644 inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/kafka/src/main/java/org/apache/inlong/sort/kafka/table/DynamicKafkaDeserializationSchema.java create mode 100644 inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/kafka/src/main/java/org/apache/inlong/sort/kafka/table/DynamicKafkaRecordSerializationSchema.java create mode 100644 inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/kafka/src/main/java/org/apache/inlong/sort/kafka/table/KafkaDynamicSink.java create mode 100644 inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/kafka/src/main/java/org/apache/inlong/sort/kafka/table/KafkaDynamicSource.java rename inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/kafka/src/main/java/org/apache/inlong/sort/kafka/{ => table}/KafkaOptions.java (92%) create mode 100644 inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/kafka/src/main/java/org/apache/inlong/sort/kafka/table/ReducingUpsertSink.java create mode 100644 inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/kafka/src/main/java/org/apache/inlong/sort/kafka/table/ReducingUpsertWriter.java create mode 100644 inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/mongodb-cdc/src/main/java/org/apache/inlong/sort/mongodb/MongoDBConnectorDeserializationSchema.java create mode 100644 inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/mongodb-cdc/src/main/java/org/apache/inlong/sort/mongodb/MongoDBTableSource.java create mode 100644 inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/postgres-cdc/src/main/java/org/apache/inlong/sort/postgre/PostgreSQLTableSource.java create mode 100644 inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/postgres-cdc/src/main/java/org/apache/inlong/sort/postgre/PostgresValueValidator.java create mode 100644 inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/postgres-cdc/src/main/java/org/apache/inlong/sort/postgre/RowDataDebeziumDeserializeSchema.java create mode 100644 inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/sqlserver-cdc/src/main/java/org/apache/inlong/sort/sqlserver/RowDataDebeziumDeserializeSchema.java create mode 100644 inlong-sort/sort-flink/sort-flink-v1.15/sort-connectors/sqlserver-cdc/src/main/java/org/apache/inlong/sort/sqlserver/SqlServerTableSource.java