[PR] [INLONG-9441][Manager] MySQL data source supports both full and incremental modes [inlong]
fuweng11 opened a new pull request, #9442: URL: https://github.com/apache/inlong/pull/9442 ### Prepare a Pull Request - Fixes #9441 ### Motivation MySQL data source supports both full and incremental modes. ### Modifications MySQL data source supports both full and incremental modes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[PR] [INLONG-9440][Manager] Support querying audit information based on ip [inlong]
fuweng11 opened a new pull request, #9443: URL: https://github.com/apache/inlong/pull/9443 ### Prepare a Pull Request - Fixes #9440 ### Motivation Support querying audit information based on ip. ### Modifications Support querying audit information based on ip. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-9437][Dashboard] Data access audit supports audit item query [inlong]
leezng commented on code in PR #9438:
URL: https://github.com/apache/inlong/pull/9438#discussion_r1418581803
##
inlong-dashboard/src/ui/components/Charts/index.tsx:
##
@@ -81,7 +81,7 @@ const Charts: React.FC = ({
}
};
// eslint-disable-next-line
- }, []);
+ }, [option]);
Review Comment:
This is used for initialization. Do not monitor option changes, as
performance problems may occur easily.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Re: [PR] [INLONG-9440][Manager] Support querying audit information based on ip [inlong]
vernedeng commented on code in PR #9443:
URL: https://github.com/apache/inlong/pull/9443#discussion_r1418796627
##
inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/core/impl/AuditServiceImpl.java:
##
@@ -330,8 +333,10 @@ public List listByCondition(AuditRequest request)
throws Exception {
}
} else if (AuditQuerySource.CLICKHOUSE == querySource) {
try (Connection connection = config.getCkConnection();
-PreparedStatement statement =
getAuditCkStatement(connection, groupId, streamId, auditId,
-request.getStartDate(), request.getEndDate());
+PreparedStatement statement =
StringUtils.isNotBlank(request.getIp()) ? getAuditCkStatementByIp(
Review Comment:
release resource plz
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Re: [PR] [INLONG-9440][Manager] Support querying audit information based on ip [inlong]
fuweng11 commented on code in PR #9443:
URL: https://github.com/apache/inlong/pull/9443#discussion_r1418856153
##
inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/core/impl/AuditServiceImpl.java:
##
@@ -330,8 +333,10 @@ public List listByCondition(AuditRequest request)
throws Exception {
}
} else if (AuditQuerySource.CLICKHOUSE == querySource) {
try (Connection connection = config.getCkConnection();
-PreparedStatement statement =
getAuditCkStatement(connection, groupId, streamId, auditId,
-request.getStartDate(), request.getEndDate());
+PreparedStatement statement =
StringUtils.isNotBlank(request.getIp()) ? getAuditCkStatementByIp(
Review Comment:
Automatically closed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Re: [PR] [INLONG-9431][Dashboard] Data synchronization supports entire database migration [inlong]
dockerzhang merged PR #9432: URL: https://github.com/apache/inlong/pull/9432 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(inlong) branch master updated: [INLONG-9431][Dashboard] Data synchronization supports entire database migration (#9432)
This is an automated email from the ASF dual-hosted git repository.
dockerzhang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/inlong.git
The following commit(s) were added to refs/heads/master by this push:
new ca1e5ce1c0 [INLONG-9431][Dashboard] Data synchronization supports
entire database migration (#9432)
ca1e5ce1c0 is described below
commit ca1e5ce1c0fb4e937baa7408ca89a6372dd66f5f
Author: Lizhen <88174078+bluew...@users.noreply.github.com>
AuthorDate: Thu Dec 7 20:04:06 2023 +0800
[INLONG-9431][Dashboard] Data synchronization supports entire database
migration (#9432)
---
inlong-dashboard/src/plugins/RenderRow.ts | 14
.../src/plugins/sinks/common/SinkDefaultInfo.ts| 57 --
.../src/plugins/sinks/defaults/ClickHouse.ts | 19 -
inlong-dashboard/src/plugins/sinks/defaults/Cls.ts | 7 +-
.../src/plugins/sinks/defaults/Doris.ts| 13 +++-
.../src/plugins/sinks/defaults/Elasticsearch.ts| 6 +-
.../src/plugins/sinks/defaults/Greenplum.ts| 9 ++-
.../src/plugins/sinks/defaults/HBase.ts| 11 ++-
.../src/plugins/sinks/defaults/Hive.ts | 13 +++-
.../src/plugins/sinks/defaults/Hudi.ts | 12 ++-
.../src/plugins/sinks/defaults/Iceberg.ts | 86 +-
.../src/plugins/sinks/defaults/Kafka.ts| 7 +-
.../src/plugins/sinks/defaults/Kudu.ts | 9 ++-
.../src/plugins/sinks/defaults/MySQL.ts| 8 +-
.../src/plugins/sinks/defaults/Oracle.ts | 9 ++-
.../src/plugins/sinks/defaults/PostgreSQL.ts | 10 ++-
.../src/plugins/sinks/defaults/Pulsar.ts | 7 +-
.../src/plugins/sinks/defaults/Redis.ts| 19 -
.../src/plugins/sinks/defaults/SQLServer.ts| 12 ++-
.../src/plugins/sinks/defaults/StarRocks.ts| 7 +-
.../src/plugins/sinks/defaults/TDSQLPostgreSQL.ts | 10 ++-
.../plugins/sources/common/SourceDefaultInfo.ts| 30 +++-
.../src/plugins/sources/defaults/MySQLBinlog.ts| 11 ++-
.../src/plugins/sync/common/SyncDefaultInfo.ts | 20 +
inlong-dashboard/src/ui/locales/cn.json| 7 +-
inlong-dashboard/src/ui/locales/en.json| 6 ++
.../src/ui/pages/SynchronizeDetail/Info/index.tsx | 4 +
.../SynchronizeDetail/SyncSink/DetailModal.tsx | 16 +++-
.../ui/pages/SynchronizeDetail/SyncSink/helper.ts | 47
.../ui/pages/SynchronizeDetail/SyncSink/index.tsx | 11 ++-
.../SynchronizeDetail/SyncSources/DetailModal.tsx | 12 ++-
.../pages/SynchronizeDetail/SyncSources/index.tsx | 11 ++-
.../SynchronizeDetail/SyncT/SyncDatabaseCard.tsx | 58 +++
.../src/ui/pages/SynchronizeDetail/SyncT/index.tsx | 39 +++---
.../src/ui/pages/SynchronizeDetail/common.d.ts | 1 +
35 files changed, 570 insertions(+), 48 deletions(-)
diff --git a/inlong-dashboard/src/plugins/RenderRow.ts
b/inlong-dashboard/src/plugins/RenderRow.ts
index 591f93f074..3bb38c6f0a 100644
--- a/inlong-dashboard/src/plugins/RenderRow.ts
+++ b/inlong-dashboard/src/plugins/RenderRow.ts
@@ -24,6 +24,8 @@ export abstract class RenderRow {
static FieldList: FieldItemType[] = [];
static SyncFieldSet = new Set();
static SyncCreateTableFieldSet = new Set();
+ static SyncMoveDbFieldSet = new Set();
+ static IngestionFieldSet = new Set();
static FieldDecorator(config: FieldItemType): PropertyDecorator {
return (target: any, propertyKey: string) => {
@@ -60,6 +62,18 @@ export abstract class RenderRow {
};
}
+ static SyncMoveDbField(): PropertyDecorator {
+return (target: any, propertyKey: string) => {
+ target.constructor.SyncMoveDbFieldSet.add(propertyKey);
+};
+ }
+
+ static IngestionField(): PropertyDecorator {
+return (target: any, propertyKey: string) => {
+ target.constructor.IngestionFieldSet.add(propertyKey);
+};
+ }
+
abstract renderRow(fields?: FieldItemType[]): FieldItemType[];
}
diff --git a/inlong-dashboard/src/plugins/sinks/common/SinkDefaultInfo.ts
b/inlong-dashboard/src/plugins/sinks/common/SinkDefaultInfo.ts
index fb9a1f297f..381da1a309 100644
--- a/inlong-dashboard/src/plugins/sinks/common/SinkDefaultInfo.ts
+++ b/inlong-dashboard/src/plugins/sinks/common/SinkDefaultInfo.ts
@@ -27,7 +27,17 @@ import { statusList, genStatusTag } from './status';
import { sinks, defaultValue } from '..';
const { I18nMap, I18n } = DataWithBackend;
-const { FieldList, FieldDecorator, SyncField, SyncFieldSet,
SyncCreateTableFieldSet } = RenderRow;
+const {
+ FieldList,
+ FieldDecorator,
+ SyncField,
+ SyncFieldSet,
+ SyncMoveDbField,
+ SyncMoveDbFieldSet,
+ SyncCreateTableFieldSet,
+ IngestionField,
+ IngestionFieldSet,
+} = RenderRow;
const { ColumnList, ColumnDecorator } = RenderList;
export class SinkDefaultInfo implements DataWithBackend, RenderRow, RenderList
{
@@ -35,7 +45,9 @@ export class SinkDefaultInfo implements DataWithBackend,
RenderRow, Rend
Re: [I] [Improve][TubeMQ] Docker container is missing tubectl script [inlong]
github-actions[bot] commented on issue #9033: URL: https://github.com/apache/inlong/issues/9033#issuecomment-1846431653 This issue is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-9440][Manager] Support querying audit information based on ip [inlong]
EMsnap merged PR #9443: URL: https://github.com/apache/inlong/pull/9443 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(inlong) branch master updated (ca1e5ce1c0 -> 6e701e46f3)
This is an automated email from the ASF dual-hosted git repository. zirui pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from ca1e5ce1c0 [INLONG-9431][Dashboard] Data synchronization supports entire database migration (#9432) add 6e701e46f3 [INLONG-9440][Manager] Support querying audit information based on ip (#9443) No new revisions were added by this update. Summary of changes: .../manager/dao/mapper/AuditEntityMapper.java | 16 +++ .../main/resources/mappers/AuditEntityMapper.xml | 14 +++ .../inlong/manager/pojo/audit/AuditRequest.java| 3 ++ .../service/core/impl/AuditServiceImpl.java| 49 +++--- 4 files changed, 76 insertions(+), 6 deletions(-)
[PR] [INLONG-9444][Manager] Fix the problem of ES sink unsuccessful flow status configuration successful [inlong]
fuweng11 opened a new pull request, #9445: URL: https://github.com/apache/inlong/pull/9445 ### Prepare a Pull Request - Fixes #9444 ### Motivation Fix the problem of ES sink unsuccessful flow status configuration successful. ### Modifications Fix the problem of ES sink unsuccessful flow status configuration successful. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-9444][Manager] Fix the problem of ES sink unsuccessful flow status configuration successful [inlong]
EMsnap merged PR #9445: URL: https://github.com/apache/inlong/pull/9445 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(inlong) branch master updated: [INLONG-9444][Manager] ES sink unsuccessful flow status configuration successful (#9445)
This is an automated email from the ASF dual-hosted git repository.
zirui pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/inlong.git
The following commit(s) were added to refs/heads/master by this push:
new 945987059d [INLONG-9444][Manager] ES sink unsuccessful flow status
configuration successful (#9445)
945987059d is described below
commit 945987059dd1b58402ccc971d756080a7c2fdd58
Author: fuweng11 <76141879+fuwen...@users.noreply.github.com>
AuthorDate: Fri Dec 8 12:47:39 2023 +0800
[INLONG-9444][Manager] ES sink unsuccessful flow status configuration
successful (#9445)
---
.../resource/sink/AbstractStandaloneSinkResourceOperator.java | 7 +++
1 file changed, 7 insertions(+)
diff --git
a/inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/resource/sink/AbstractStandaloneSinkResourceOperator.java
b/inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/resource/sink/AbstractStandaloneSinkResourceOperator.java
index dd1c26d9f7..7a53035a23 100644
---
a/inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/resource/sink/AbstractStandaloneSinkResourceOperator.java
+++
b/inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/resource/sink/AbstractStandaloneSinkResourceOperator.java
@@ -19,6 +19,7 @@ package org.apache.inlong.manager.service.resource.sink;
import org.apache.inlong.manager.common.consts.InlongConstants;
import org.apache.inlong.manager.common.consts.SinkType;
+import org.apache.inlong.manager.common.enums.SinkStatus;
import org.apache.inlong.manager.common.util.Preconditions;
import org.apache.inlong.manager.dao.entity.InlongClusterEntity;
import org.apache.inlong.manager.dao.entity.InlongGroupEntity;
@@ -27,6 +28,7 @@ import
org.apache.inlong.manager.dao.mapper.InlongClusterEntityMapper;
import org.apache.inlong.manager.dao.mapper.InlongGroupEntityMapper;
import org.apache.inlong.manager.dao.mapper.StreamSinkEntityMapper;
import org.apache.inlong.manager.pojo.sink.SinkInfo;
+import org.apache.inlong.manager.service.sink.StreamSinkService;
import com.google.common.annotations.VisibleForTesting;
import com.google.common.collect.Sets;
@@ -46,6 +48,8 @@ public abstract class AbstractStandaloneSinkResourceOperator
implements SinkReso
private StreamSinkEntityMapper sinkEntityMapper;
@Autowired
private InlongGroupEntityMapper groupEntityMapper;
+@Autowired
+private StreamSinkService sinkService;
private static final String SORT_PREFIX = "SORT_";
@@ -54,6 +58,8 @@ public abstract class AbstractStandaloneSinkResourceOperator
implements SinkReso
@VisibleForTesting
protected void assignCluster(SinkInfo sinkInfo) {
if (StringUtils.isNotBlank(sinkInfo.getInlongClusterName())) {
+String info = "success to create es resource";
+sinkService.updateStatus(sinkInfo.getId(),
SinkStatus.CONFIG_SUCCESSFUL.getCode(), info);
return;
}
@@ -65,6 +71,7 @@ public abstract class AbstractStandaloneSinkResourceOperator
implements SinkReso
StreamSinkEntity sink =
sinkEntityMapper.selectByPrimaryKey(sinkInfo.getId());
sink.setInlongClusterName(targetCluster);
+sink.setStatus(SinkStatus.CONFIG_SUCCESSFUL.getCode());
sinkEntityMapper.updateByIdSelective(sink);
}
Re: [PR] [INLONG-9437][Dashboard] Data access audit supports audit item query [inlong]
dockerzhang merged PR #9438: URL: https://github.com/apache/inlong/pull/9438 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(inlong) branch master updated: [INLONG-9437][Dashboard] Data access audit supports audit item query (#9438)
This is an automated email from the ASF dual-hosted git repository.
dockerzhang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/inlong.git
The following commit(s) were added to refs/heads/master by this push:
new 7630cd47c6 [INLONG-9437][Dashboard] Data access audit supports audit
item query (#9438)
7630cd47c6 is described below
commit 7630cd47c61c24a22cee8c78e8b4bf157345f171
Author: Lizhen <88174078+bluew...@users.noreply.github.com>
AuthorDate: Fri Dec 8 14:04:01 2023 +0800
[INLONG-9437][Dashboard] Data access audit supports audit item query (#9438)
---
inlong-dashboard/src/ui/locales/cn.json| 1 +
inlong-dashboard/src/ui/locales/en.json| 1 +
.../src/ui/pages/GroupDetail/Audit/config.tsx | 31 +++---
3 files changed, 30 insertions(+), 3 deletions(-)
diff --git a/inlong-dashboard/src/ui/locales/cn.json
b/inlong-dashboard/src/ui/locales/cn.json
index eb1a426f47..20ef99b2da 100644
--- a/inlong-dashboard/src/ui/locales/cn.json
+++ b/inlong-dashboard/src/ui/locales/cn.json
@@ -618,6 +618,7 @@
"pages.GroupDetail.Audit.Receive": "接收成功",
"pages.GroupDetail.Audit.Send": "发送成功",
"pages.GroupDetail.Audit.TimeStaticsDim": "粒度",
+ "pages.GroupDetail.Audit.Item": "审计项",
"pages.GroupDetail.Audit.Min": "分钟",
"pages.GroupDetail.Audit.Hour": "小时",
"pages.GroupDetail.Audit.Day": "天",
diff --git a/inlong-dashboard/src/ui/locales/en.json
b/inlong-dashboard/src/ui/locales/en.json
index f32c06445b..478231fbfb 100644
--- a/inlong-dashboard/src/ui/locales/en.json
+++ b/inlong-dashboard/src/ui/locales/en.json
@@ -622,6 +622,7 @@
"pages.GroupDetail.Audit.Hour": "Hour",
"pages.GroupDetail.Audit.Day": "Day",
"pages.GroupDetail.Audit.Sink": "Sink",
+ "pages.GroupDetail.Audit.Item": "Audit item",
"pages.GroupDetail.Delay.QueryDate": "Query date",
"pages.GroupDetail.Delay.AverageTitle": "Average transmission delay (ms)",
"pages.GroupDetail.Delay.RealTimeTitle": "Transmission delay (ms)",
diff --git a/inlong-dashboard/src/ui/pages/GroupDetail/Audit/config.tsx
b/inlong-dashboard/src/ui/pages/GroupDetail/Audit/config.tsx
index f580bbd97c..4f2b9919cf 100644
--- a/inlong-dashboard/src/ui/pages/GroupDetail/Audit/config.tsx
+++ b/inlong-dashboard/src/ui/pages/GroupDetail/Audit/config.tsx
@@ -71,7 +71,7 @@ export const toChartData = (source, sourceDataMap) => {
const xAxisData = Object.keys(sourceDataMap);
return {
legend: {
- data: source.map(item => getAuditLabel(item.auditId, item.nodeType)),
+ data: source.map(item => item.auditName),
},
tooltip: {
trigger: 'axis',
@@ -84,7 +84,7 @@ export const toChartData = (source, sourceDataMap) => {
type: 'value',
},
series: source.map(item => ({
- name: getAuditLabel(item.auditId, item.nodeType),
+ name: item.auditName,
type: 'line',
data: xAxisData.map(logTs => sourceDataMap[logTs]?.[item.auditId] || 0),
})),
@@ -199,6 +199,31 @@ export const getFormContent = (inlongGroupId,
initialValues, onSearch, onDataStr
options: timeStaticsDimList,
},
},
+ {
+type: 'select',
+label: i18n.t('pages.GroupDetail.Audit.Item'),
+name: 'auditIds',
+props: {
+ mode: 'multiple',
+ maxTagCount: 3,
+ allowClear: true,
+ dropdownMatchSelectWidth: false,
+ options: {
+requestAuto: true,
+requestService: {
+ url: '/audit/getAuditBases',
+ method: 'GET',
+},
+requestParams: {
+ formatResult: result =>
+result?.map(item => ({
+ label: item.name,
+ value: item.auditId,
+})) || [],
+},
+ },
+},
+ },
{
type: (
@@ -210,7 +235,7 @@ export const getFormContent = (inlongGroupId,
initialValues, onSearch, onDataStr
export const getTableColumns = source => {
const data = source.map(item => ({
-title: getAuditLabel(item.auditId, item.nodeType),
+title: item.auditName,
dataIndex: item.auditId,
render: text => text || 0,
}));
[PR] [INLONG-9439][Dashboard] Support module reconciliation function [inlong]
bluewang opened a new pull request, #9446: URL: https://github.com/apache/inlong/pull/9446 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be replaced by the actual [GitHub Issue](https://github.com/apache/inlong/issues) number)* - Fixes https://github.com/apache/inlong/issues/9439 ### Motivation *Explain here the context, and why you're making that change. What is the problem you're trying to solve?* ### Modifications *Describe the modifications you've done.* ### Verifying this change  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-9441][Manager] MySQL data source supports both full and incremental modes [inlong]
EMsnap merged PR #9442: URL: https://github.com/apache/inlong/pull/9442 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(inlong) branch master updated: [INLONG-9441][Manager] MySQL data source supports both full and incremental modes (#9442)
This is an automated email from the ASF dual-hosted git repository.
zirui pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/inlong.git
The following commit(s) were added to refs/heads/master by this push:
new d721f9d649 [INLONG-9441][Manager] MySQL data source supports both full
and incremental modes (#9442)
d721f9d649 is described below
commit d721f9d649aa2896c6be48bae969d8aa0aa0889d
Author: fuweng11 <76141879+fuwen...@users.noreply.github.com>
AuthorDate: Fri Dec 8 15:37:34 2023 +0800
[INLONG-9441][Manager] MySQL data source supports both full and incremental
modes (#9442)
---
.../inlong/manager/pojo/sort/node/provider/MySQLBinlogProvider.java| 3 +++
.../org/apache/inlong/manager/pojo/source/mysql/MySQLBinlogSource.java | 3 +++
.../apache/inlong/manager/pojo/source/mysql/MySQLBinlogSourceDTO.java | 3 +++
.../inlong/manager/pojo/source/mysql/MySQLBinlogSourceRequest.java | 3 +++
4 files changed, 12 insertions(+)
diff --git
a/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/sort/node/provider/MySQLBinlogProvider.java
b/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/sort/node/provider/MySQLBinlogProvider.java
index 894b83eb1c..4016d3ff71 100644
---
a/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/sort/node/provider/MySQLBinlogProvider.java
+++
b/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/sort/node/provider/MySQLBinlogProvider.java
@@ -70,6 +70,9 @@ public class MySQLBinlogProvider implements
ExtractNodeProvider {
// Unique properties when migrate all tables in database
properties.put("migrate-all", "true");
}
+if (binlogSource.isOnlyIncremental()) {
+properties.put("scan.startup.mode", "latest-offset");
+}
return new MySqlExtractNode(binlogSource.getSourceName(),
binlogSource.getSourceName(),
diff --git
a/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/source/mysql/MySQLBinlogSource.java
b/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/source/mysql/MySQLBinlogSource.java
index 420b4a86fc..1b6eb36cac 100644
---
a/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/source/mysql/MySQLBinlogSource.java
+++
b/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/source/mysql/MySQLBinlogSource.java
@@ -94,6 +94,9 @@ public class MySQLBinlogSource extends StreamSource {
@ApiModelProperty("Need transfer total database")
private boolean allMigration;
+@ApiModelProperty("Only incremental")
+private boolean onlyIncremental;
+
@ApiModelProperty("Primary key must be shared by all tables")
private String primaryKey;
diff --git
a/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/source/mysql/MySQLBinlogSourceDTO.java
b/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/source/mysql/MySQLBinlogSourceDTO.java
index 1e3ccd5fae..4b9a64f780 100644
---
a/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/source/mysql/MySQLBinlogSourceDTO.java
+++
b/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/source/mysql/MySQLBinlogSourceDTO.java
@@ -109,6 +109,9 @@ public class MySQLBinlogSourceDTO {
@ApiModelProperty("Whether to migrate all databases")
private boolean allMigration;
+@ApiModelProperty("Only incremental")
+private boolean onlyIncremental;
+
@ApiModelProperty("Primary key must be shared by all tables")
private String primaryKey;
diff --git
a/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/source/mysql/MySQLBinlogSourceRequest.java
b/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/source/mysql/MySQLBinlogSourceRequest.java
index 9f748be557..4b51a9c215 100644
---
a/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/source/mysql/MySQLBinlogSourceRequest.java
+++
b/inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/source/mysql/MySQLBinlogSourceRequest.java
@@ -103,6 +103,9 @@ public class MySQLBinlogSourceRequest extends SourceRequest
{
@ApiModelProperty("Need transfer total database")
private boolean allMigration = false;
+@ApiModelProperty("Only incremental")
+private boolean onlyIncremental;
+
@ApiModelProperty("Primary key must be shared by all tables")
private String primaryKey;
[PR] [INLONG-9447][Manager] Fix the problem of suspend group failed [inlong]
fuweng11 opened a new pull request, #9448: URL: https://github.com/apache/inlong/pull/9448 ### Prepare a Pull Request - Fixes #9447 ### Motivation Fix the problem of suspend group failed. ### Modifications Fix the problem of suspend group failed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
