[PR] [Improve][DashBoard] add Source Data Field Template [inlong]
wohainilaodou opened a new pull request, #10378: URL: https://github.com/apache/inlong/pull/10378 Fixes #10377 ### Motivation Add template functionality to metadata fields ### Modifications A source data template page has been created, which includes the addition, modification, and query functions. On the data flow editing page, templates can be selected to fill in the source data fields ### Verifying this change   -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-10363][Manager] Support template multi tenant management [inlong]
fuweng11 commented on code in PR #10372:
URL: https://github.com/apache/inlong/pull/10372#discussion_r1634062785
##
inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/stream/TemplateServiceImpl.java:
##
@@ -106,6 +120,12 @@ public TemplateInfo get(String templateName, String
operator) {
TemplateInfo templateInfo =
CommonBeanUtils.copyProperties(templateEntity, TemplateInfo::new);
List templateFields =
getTemplateFields(templateEntity.getId());
templateInfo.setFieldList(templateFields);
+List tenantList = tenantTemplateEntityMapper
Review Comment:
Fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[PR] [INLONG-10379][Audit] Add HDFS Audit items in the Audit SDK [inlong]
doleyzi opened a new pull request, #10380: URL: https://github.com/apache/inlong/pull/10380 - Fixes #10379 ### Motivation Add HDFS Audit items in the Audit SDK https://github.com/apache/inlong/assets/43397300/34f14625-92fa-4aab-9d2c-254e57db270e";> ### Modifications Add HDFS Audit items in the Audit SDK -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-10284][Manager][Sort] Upgrade flink default version to 1.15 [inlong]
wallezhang commented on code in PR #10310:
URL: https://github.com/apache/inlong/pull/10310#discussion_r1634085604
##
inlong-sort/sort-formats/format-row/format-json-v1.18/src/main/java/org/apache/inlong/sort/formats/json/canal/CanalJsonEnhancedSerializationSchema.java:
##
@@ -108,6 +108,11 @@ public Object getFieldOrNull(RowData row) {
mapNullKeyMode,
mapNullKeyLiteral,
encodeDecimalAsPlainNumber);
+try {
+this.jsonSerializer.open(null);
Review Comment:
Done.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Re: [PR] [INLONG-10379][Audit] Add HDFS Audit items in the Audit SDK [inlong]
doleyzi merged PR #10380: URL: https://github.com/apache/inlong/pull/10380 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(inlong) branch master updated: Add HDFS Audit items in the Audit SDK (#10380)
This is an automated email from the ASF dual-hosted git repository.
doleyzi pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/inlong.git
The following commit(s) were added to refs/heads/master by this push:
new 6b4e028278 Add HDFS Audit items in the Audit SDK (#10380)
6b4e028278 is described below
commit 6b4e028278cedba497da264349d9c6b3d6a64101
Author: doleyzi <43397300+dole...@users.noreply.github.com>
AuthorDate: Tue Jun 11 11:19:11 2024 +0800
Add HDFS Audit items in the Audit SDK (#10380)
---
.../src/main/java/org/apache/inlong/audit/AuditIdEnum.java | 6 +-
.../src/main/java/org/apache/inlong/audit/entity/AuditType.java | 3 ++-
.../main/java/org/apache/inlong/audit/util/AuditManagerUtils.java | 5 +
3 files changed, 12 insertions(+), 2 deletions(-)
diff --git
a/inlong-audit/audit-sdk/src/main/java/org/apache/inlong/audit/AuditIdEnum.java
b/inlong-audit/audit-sdk/src/main/java/org/apache/inlong/audit/AuditIdEnum.java
index d63bc3a17a..ca437fb035 100644
---
a/inlong-audit/audit-sdk/src/main/java/org/apache/inlong/audit/AuditIdEnum.java
+++
b/inlong-audit/audit-sdk/src/main/java/org/apache/inlong/audit/AuditIdEnum.java
@@ -31,6 +31,7 @@ import static
org.apache.inlong.audit.entity.AuditType.DATAPROXY;
import static org.apache.inlong.audit.entity.AuditType.DORIS;
import static org.apache.inlong.audit.entity.AuditType.ELASTICSEARCH;
import static org.apache.inlong.audit.entity.AuditType.HBASE;
+import static org.apache.inlong.audit.entity.AuditType.HDFS;
import static org.apache.inlong.audit.entity.AuditType.HIVE;
import static org.apache.inlong.audit.entity.AuditType.HUDI;
import static org.apache.inlong.audit.entity.AuditType.ICEBERG;
@@ -94,7 +95,10 @@ public enum AuditIdEnum {
SORT_TUBE_OUTPUT(34, OUTPUT, TUBE, "Sent Audit Metrics for Sort Tube"),
SORT_MYSQL_INPUT(35, INPUT, MYSQL, "Received Audit Metrics for Sort
MySQL"),
-SORT_MYSQL_OUTPUT(36, OUTPUT, MYSQL, "Sent Audit Metrics for Sort MySQL");
+SORT_MYSQL_OUTPUT(36, OUTPUT, MYSQL, "Sent Audit Metrics for Sort MySQL"),
+
+SORT_HDFS_INPUT(37, INPUT, HDFS, "Received Audit Metrics for Sort HDFS"),
+SORT_HDFS_OUTPUT(38, OUTPUT, HDFS, "Sent Audit Metrics for Sort HDFS");
private static final Logger LOGGER =
LoggerFactory.getLogger(AuditIdEnum.class);
private final int auditId;
diff --git
a/inlong-audit/audit-sdk/src/main/java/org/apache/inlong/audit/entity/AuditType.java
b/inlong-audit/audit-sdk/src/main/java/org/apache/inlong/audit/entity/AuditType.java
index 6fb554b407..0af03844d6 100644
---
a/inlong-audit/audit-sdk/src/main/java/org/apache/inlong/audit/entity/AuditType.java
+++
b/inlong-audit/audit-sdk/src/main/java/org/apache/inlong/audit/entity/AuditType.java
@@ -34,7 +34,8 @@ public enum AuditType {
POSTGRES("Postgres"),
BINLOG("Binlog"),
TUBE("Tube"),
-MYSQL("MySQL");
+MYSQL("MySQL"),
+HDFS("HDFS");
private final String auditType;
diff --git
a/inlong-audit/audit-sdk/src/main/java/org/apache/inlong/audit/util/AuditManagerUtils.java
b/inlong-audit/audit-sdk/src/main/java/org/apache/inlong/audit/util/AuditManagerUtils.java
index 8bc2c8e7a3..35009d22df 100644
---
a/inlong-audit/audit-sdk/src/main/java/org/apache/inlong/audit/util/AuditManagerUtils.java
+++
b/inlong-audit/audit-sdk/src/main/java/org/apache/inlong/audit/util/AuditManagerUtils.java
@@ -18,6 +18,7 @@
package org.apache.inlong.audit.util;
import org.apache.inlong.audit.AuditIdEnum;
+import org.apache.inlong.audit.MetricIdEnum;
import org.apache.inlong.audit.entity.AuditInformation;
import org.apache.inlong.audit.entity.FlowType;
@@ -135,6 +136,10 @@ public class AuditManagerUtils {
auditInformationList.addAll(combineAuditInformation(auditIdEnum.getAuditType().value(),
auditIdEnum.getFlowType()));
}
+for (MetricIdEnum metricIdEnum : MetricIdEnum.values()) {
+auditInformationList.add(new
AuditInformation(metricIdEnum.getValue(), metricIdEnum.getEnglishDescription(),
+metricIdEnum.getChineseDescription()));
+}
return auditInformationList;
}
