[PR] [INLONG-11135][Agent] Support filtering capability when supplementing data [inlong]
justinwwhuang opened a new pull request, #11137: URL: https://github.com/apache/inlong/pull/11137 Fixes #11135 ### Motivation Support filtering capability when supplementing data ### Modifications Add stream filtering configuration item ### Verifying this change *(Please pick either of the following options)* - [ ] This change is a trivial rework/code cleanup without any test coverage. - [ ] This change is already covered by existing tests, such as: *(please describe tests)* - [ ] This change added tests and can be verified as follows: *(example:)* - *Added integration tests for end-to-end deployment with large payloads (10MB)* - *Extended integration test for recovery after broker failure* ### Documentation No doc needed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[PR] [INLONG-11132][SDK] Transform SQL support parsing SIMILAR TO [inlong]
emptyOVO opened a new pull request, #11133: URL: https://github.com/apache/inlong/pull/11133 Fixes #11132 ### Motivation ### Modifications add SimilarToParser.class to provide `SIMILAR TO` parsing capability, provide unit tests ### Verifying this change *(Please pick either of the following options)* - [ ] This change is a trivial rework/code cleanup without any test coverage. - [x] This change is already covered by existing tests, such as: *(please describe tests)* - [ ] This change added tests and can be verified as follows: *(example:)* - *Added integration tests for end-to-end deployment with large payloads (10MB)* - *Extended integration test for recovery after broker failure* ### Documentation - Does this pull request introduce a new feature? (yes / no) - If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented) - If a feature is not applicable for documentation, explain why? - If a feature is not documented yet in this PR, please create a follow-up issue for adding the documentation -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-11129][Sort] Enhanced Metric Instrumentation for InLong Sort Flink Connector [inlong]
XiaoYou201 commented on PR #11130: URL: https://github.com/apache/inlong/pull/11130#issuecomment-2356479536 plz provide some test result shortcut in the comment~， thx~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-11112][SDK] Transform TRUNCATE() function add pgsql name [inlong]
dockerzhang merged PR #3: URL: https://github.com/apache/inlong/pull/3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(inlong) branch master updated: [INLONG-11112][SDK] Transform TRUNCATE() function add pgsql name (#11113)
This is an automated email from the ASF dual-hosted git repository.
dockerzhang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/inlong.git
The following commit(s) were added to refs/heads/master by this push:
new 9e443cbfaa [INLONG-2][SDK] Transform TRUNCATE() function add pgsql
name (#3)
9e443cbfaa is described below
commit 9e443cbfaa17c085d0824d9d8f912b7ab2a96c03
Author: emptyOVO <118812562+empty...@users.noreply.github.com>
AuthorDate: Wed Sep 18 09:57:05 2024 +0800
[INLONG-2][SDK] Transform TRUNCATE() function add pgsql name (#3)
---
.../process/function/TruncateFunction.java | 2 +-
.../function/arithmetic/TestTruncateFunction.java | 24 ++
2 files changed, 21 insertions(+), 5 deletions(-)
diff --git
a/inlong-sdk/transform-sdk/src/main/java/org/apache/inlong/sdk/transform/process/function/TruncateFunction.java
b/inlong-sdk/transform-sdk/src/main/java/org/apache/inlong/sdk/transform/process/function/TruncateFunction.java
index 8267efff55..347f672352 100644
---
a/inlong-sdk/transform-sdk/src/main/java/org/apache/inlong/sdk/transform/process/function/TruncateFunction.java
+++
b/inlong-sdk/transform-sdk/src/main/java/org/apache/inlong/sdk/transform/process/function/TruncateFunction.java
@@ -39,7 +39,7 @@ import java.util.List;
* for example: truncate(42.324, 2)--return 42.32
* truncate(42.324)--return 42.0
*/
-@TransformFunction(names = {"truncate"})
+@TransformFunction(names = {"truncate", "trunc"})
public class TruncateFunction implements ValueParser {
private ValueParser bigDecimalParser;
diff --git
a/inlong-sdk/transform-sdk/src/test/java/org/apache/inlong/sdk/transform/process/function/arithmetic/TestTruncateFunction.java
b/inlong-sdk/transform-sdk/src/test/java/org/apache/inlong/sdk/transform/process/function/arithmetic/TestTruncateFunction.java
index ddc3cabf7c..35138ed508 100644
---
a/inlong-sdk/transform-sdk/src/test/java/org/apache/inlong/sdk/transform/process/function/arithmetic/TestTruncateFunction.java
+++
b/inlong-sdk/transform-sdk/src/test/java/org/apache/inlong/sdk/transform/process/function/arithmetic/TestTruncateFunction.java
@@ -52,15 +52,31 @@ public class TestTruncateFunction extends
AbstractFunctionArithmeticTestBase {
Assert.assertEquals(1, output3.size());
Assert.assertEquals(output3.get(0), "result=12000");
-String transformSql2 = "select truncate(numeric1) from source";
+String transformSql2 = "select trunc(numeric1,numeric2) from source";
TransformConfig config2 = new TransformConfig(transformSql2);
TransformProcessor processor2 = TransformProcessor
.create(config2,
SourceDecoderFactory.createCsvDecoder(csvSource),
SinkEncoderFactory.createKvEncoder(kvSink));
-// case4: truncate(12345)
-List output4 = processor2.transform("12345.6789|-3|6|8");
+// case1: trunc(42.324, 2)
+List output4 = processor2.transform("42.324|2|6|8");
Assert.assertEquals(1, output4.size());
-Assert.assertEquals(output4.get(0), "result=12345");
+Assert.assertEquals(output4.get(0), "result=42.32");
+
+// case2: trunc(42.324, -1)
+List output5 = processor2.transform("42.324|-1|6|8");
+Assert.assertEquals(1, output5.size());
+Assert.assertEquals(output5.get(0), "result=40");
+
+String transformSql3 = "select truncate(numeric1) from source";
+TransformConfig config3 = new TransformConfig(transformSql3);
+TransformProcessor processor3 = TransformProcessor
+.create(config3,
SourceDecoderFactory.createCsvDecoder(csvSource),
+SinkEncoderFactory.createKvEncoder(kvSink));
+
+// case4: truncate(12345.6789)
+List output6 = processor3.transform("12345.6789|-3|6|8");
+Assert.assertEquals(1, output6.size());
+Assert.assertEquals(output6.get(0), "result=12345");
}
}
Re: [PR] [INLONG-9456][Manager][Sort][Dashboard] Support Apache Paimon [inlong]
github-actions[bot] commented on PR #10039: URL: https://github.com/apache/inlong/pull/10039#issuecomment-2357336285 This PR is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Feature][Sort] Iceberg sink support write watermark in the snapshot [inlong]
github-actions[bot] commented on issue #9239: URL: https://github.com/apache/inlong/issues/9239#issuecomment-2357336415 This issue is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Feature] Agent on InLong Transform [inlong]
github-actions[bot] commented on issue #10023: URL: https://github.com/apache/inlong/issues/10023#issuecomment-2357336332 This issue is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-7754][Dashboard] Support sort cluster in ClusterManagement [inlong]
github-actions[bot] commented on PR #7755: URL: https://github.com/apache/inlong/pull/7755#issuecomment-2357336676 This PR is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-7663][Manager] Support agent report new fields and automatically issue tasks [inlong]
github-actions[bot] commented on PR #7664: URL: https://github.com/apache/inlong/pull/7664#issuecomment-2357336725 This PR is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-7072][Manager][Sort] Resource adaptive adjustment for Hudi [inlong]
github-actions[bot] commented on PR #7077: URL: https://github.com/apache/inlong/pull/7077#issuecomment-2357336798 This PR is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-7056][Manager] Support add more properties for submitting flink job [inlong]
github-actions[bot] commented on PR #8822: URL: https://github.com/apache/inlong/pull/8822#issuecomment-2357336554 This PR is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-7784][Tool] Support parallel compilation and packaging [inlong]
github-actions[bot] commented on PR #9116: URL: https://github.com/apache/inlong/pull/9116#issuecomment-2357336447 This PR is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-9010][Sort] Add hive connector for flink1.15 [inlong]
github-actions[bot] commented on PR #9030: URL: https://github.com/apache/inlong/pull/9030#issuecomment-2357336477 This PR is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Feature][Sort] Add Hive connector on flink 1.15 [inlong]
github-actions[bot] commented on issue #9010: URL: https://github.com/apache/inlong/issues/9010#issuecomment-2357336517 This issue is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [INLONG-8242][CI] Separate the distribution module to improve the performance of check pipeline [inlong]
github-actions[bot] commented on PR #8243: URL: https://github.com/apache/inlong/pull/8243#issuecomment-2357336624 This PR is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Improve][Manager] Support agent report new fields and automatically issue tasks [inlong]
github-actions[bot] commented on issue #7663: URL: https://github.com/apache/inlong/issues/7663#issuecomment-2357336760 This issue is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Feature][Agent] Provides hierarchical guarantee capacity [inlong]
github-actions[bot] commented on issue #7021: URL: https://github.com/apache/inlong/issues/7021#issuecomment-2357336852 This issue is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Feature][Agent] Support filter function [inlong]
github-actions[bot] commented on issue #7022: URL: https://github.com/apache/inlong/issues/7022#issuecomment-2357336823 This issue is stale because it has been open for 60 days with no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[PR] [INLONG-11020][SDK] Add BSON formatted data source for Transform [inlong]
Zkplo opened a new pull request, #11136: URL: https://github.com/apache/inlong/pull/11136 Fixes #11020 ### Motivation Added the parsing capability of Bson data source for Transform. The following classes have been added: BsonSourceData, BsonSourceDecoder, BsonSourceInfo. And added a testing class: TestBson2CsvProcessor. ### Modifications ### Verifying this change *(Please pick either of the following options)* - [ ] This change is a trivial rework/code cleanup without any test coverage. - [x] This change is already covered by existing tests, such as: *(please describe tests)* - [ ] This change added tests and can be verified as follows: *(example:)* - *Added integration tests for end-to-end deployment with large payloads (10MB)* - *Extended integration test for recovery after broker failure* -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
