[GitHub] [inlong] fuweng11 opened a new issue, #7284: [Improve][Manager] Use Preconditions.expectNotBlank to check whether a string is null

fuweng11 opened a new issue, #7284: URL: https://github.com/apache/inlong/issues/7284 ### Description Use `Preconditions.expectNotBlank` to check whether a string is null. ### InLong Component InLong Manager ### Are you willing to submit PR? - [X] Yes, I am

[GitHub] [inlong] fuweng11 opened a new pull request, #7285: [INLONG-7284][Manager] Use Preconditions.expectNotBlank to check whether a string is null.

fuweng11 opened a new pull request, #7285: URL: https://github.com/apache/inlong/pull/7285 ### Prepare a Pull Request - Fixes #7284 ### Motivation Use Preconditions.expectNotBlank to check whether a string is null. ### Modifications Use Preconditions.expect

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #7241: [INLONG-7240][Sort] Support load node of Redis

yunqingmoswu commented on code in PR #7241: URL: https://github.com/apache/inlong/pull/7241#discussion_r1090371967 ## inlong-sort/sort-common/src/main/java/org/apache/inlong/sort/protocol/node/load/RedisLoadNode.java: ## @@ -0,0 +1,249 @@ +/* + * Licensed to the Apache Software

[GitHub] [inlong] dockerzhang closed issue #7284: [Improve][Manager] Use Preconditions.expectNotBlank to check whether a string is null

dockerzhang closed issue #7284: [Improve][Manager] Use Preconditions.expectNotBlank to check whether a string is null URL: https://github.com/apache/inlong/issues/7284 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [inlong] dockerzhang merged pull request #7285: [INLONG-7284][Manager] Use Preconditions.expectNotBlank to check whether a string is null

dockerzhang merged PR #7285: URL: https://github.com/apache/inlong/pull/7285 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[GitHub] [inlong] Yizhou-Yang opened a new issue, #7286: [Bug][Sort] fix issue of tableidentifier being null when addRow

Yizhou-Yang opened a new issue, #7286: URL: https://github.com/apache/inlong/issues/7286 ### What happened java.lang.ArrayIndexOutOfBoundsException: 1 at org.apache.inlong.sort.doris.table.DorisDynamicSchemaOutputFormat.load(DorisDynamicSchemaOutputFormat.java:742) ~[pool-1-

[GitHub] [inlong] Yizhou-Yang opened a new pull request, #7287: Bugfix 1

Yizhou-Yang opened a new pull request, #7287: URL: https://github.com/apache/inlong/pull/7287 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be repl

[GitHub] [inlong] Yizhou-Yang opened a new pull request, #7288: Bugfix 2

Yizhou-Yang opened a new pull request, #7288: URL: https://github.com/apache/inlong/pull/7288 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be repl

[GitHub] [inlong] Yizhou-Yang opened a new pull request, #7289: Bugfix 3

Yizhou-Yang opened a new pull request, #7289: URL: https://github.com/apache/inlong/pull/7289 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be repl

[GitHub] [inlong] Yizhou-Yang opened a new pull request, #7290: time stash

Yizhou-Yang opened a new pull request, #7290: URL: https://github.com/apache/inlong/pull/7290 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be repl

[GitHub] [inlong] Yizhou-Yang opened a new issue, #7291: [Bug][Sort] Fix bug of patternReplace not working properly for jdbc/doris/starrocks multiple sink

Yizhou-Yang opened a new issue, #7291: URL: https://github.com/apache/inlong/issues/7291 ### What happened the ${} is not replaced. ### What you expected to happen replace all literals dynamically ### How to reproduce bug for multiple sink dirty data

[GitHub] [inlong] Yizhou-Yang opened a new issue, #7292: [Bug][Sort] Fixed a bug for doris/starrocks/jdbc invokeMultiple method

Yizhou-Yang opened a new issue, #7292: URL: https://github.com/apache/inlong/issues/7292 ### What happened the method could not accurately detect and archive dirty data ### What you expected to happen it should archive data properly ### How to reproduce do a

[GitHub] [inlong] Yizhou-Yang opened a new issue, #7293: [Bug] [Sort]

Yizhou-Yang opened a new issue, #7293: URL: https://github.com/apache/inlong/issues/7293 ### What happened For jdbc multiple sink and other multiple sinks, when invoke is more frequent then the scheduler's batch interval, the dirty data will flush at a faster rate. ### What y

[GitHub] [inlong] bigdaronlee163 commented on issue #7252: [Feature][SDK]

bigdaronlee163 commented on issue #7252: URL: https://github.com/apache/inlong/issues/7252#issuecomment-1408461946 TubeMQ go sdk for producing message -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [inlong] fuweng11 opened a new issue, #7294: [Bug][Manager] Suspend, restart, delete sort task failed

fuweng11 opened a new issue, #7294: URL: https://github.com/apache/inlong/issues/7294 ### What happened Suspend, restart, delete sort task failed. ### What you expected to happen Suspend, restart, delete sort task success. ### How to reproduce Suspend, resta

[GitHub] [inlong] fuweng11 opened a new pull request, #7295: [INLONG-7294][Manager] Fix the problem of suspend, restart, delete sort task failed

fuweng11 opened a new pull request, #7295: URL: https://github.com/apache/inlong/pull/7295 ### Prepare a Pull Request - Fixes #7294 ### Motivation Fix the problem of suspend, restart, delete sort task failed. ### Modifications If `sort.properties` is empty,

[GitHub] [inlong] gosonzhang merged pull request #7295: [INLONG-7294][Manager] Fix the problem of suspend, restart, delete sort task failed

gosonzhang merged PR #7295: URL: https://github.com/apache/inlong/pull/7295 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.a

[GitHub] [inlong] gosonzhang closed issue #7294: [Bug][Manager] Failed to suspend, restart and delete Sort task

gosonzhang closed issue #7294: [Bug][Manager] Failed to suspend, restart and delete Sort task URL: https://github.com/apache/inlong/issues/7294 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[inlong] branch master updated: [INLONG-7294][Manager] Fix the problem of suspend, restart, delete sort task failed (#7295)

This is an automated email from the ASF dual-hosted git repository. gosonzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new a675d88a3 [INLONG-7294][Manager] Fix the pro

[GitHub] [inlong] EMsnap commented on a diff in pull request #7290: [INLONG-7292][Sort] S3DirtySink flushes too quickly

EMsnap commented on code in PR #7290: URL: https://github.com/apache/inlong/pull/7290#discussion_r1091361721 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/dirty/sink/s3/S3DirtySink.java: ## @@ -130,8 +131,16 @@ public synchronized void invoke(Dirt

[GitHub] [inlong] EMsnap commented on a diff in pull request #7290: [INLONG-7292][Sort] S3DirtySink flushes too quickly

EMsnap commented on code in PR #7290: URL: https://github.com/apache/inlong/pull/7290#discussion_r1091363311 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/dirty/sink/s3/S3DirtySink.java: ## @@ -130,8 +131,16 @@ public synchronized void invoke(Dirt

[GitHub] [inlong] EMsnap commented on a diff in pull request #7289: [INLONG-7292][Sort] Fixed a bug for doris/starrocks/jdbc invokeMultiple method

EMsnap commented on code in PR #7289: URL: https://github.com/apache/inlong/pull/7289#discussion_r1091364011 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/dirty/DirtySinkHelper.java: ## @@ -110,22 +118,56 @@ public void invokeMultiple(T dirtyData,

[GitHub] [inlong] EMsnap commented on a diff in pull request #7289: [INLONG-7292][Sort] Fixed a bug for doris/starrocks/jdbc invokeMultiple method

EMsnap commented on code in PR #7289: URL: https://github.com/apache/inlong/pull/7289#discussion_r1091365276 ## inlong-sort/sort-connectors/jdbc/src/main/java/org/apache/inlong/sort/jdbc/internal/JdbcMultiBatchingOutputFormat.java: ## @@ -566,7 +566,8 @@ protected void attemptFl

[GitHub] [inlong] EMsnap commented on pull request #7288: [INLONG-7291][Sort] Fix bug of dirtysink not opening for jdbc multiple sink

EMsnap commented on PR #7288: URL: https://github.com/apache/inlong/pull/7288#issuecomment-1409654356 https://github.com/apache/inlong/issues/7291 the description for the code mismatch -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [inlong] EMsnap merged pull request #7269: [INLONG-7268][Sort] Support load node of Apache Kudu

EMsnap merged PR #7269: URL: https://github.com/apache/inlong/pull/7269 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apach

[GitHub] [inlong] EMsnap closed issue #7268: [Feature][Sort] Support Apache Kudu LoadNode

EMsnap closed issue #7268: [Feature][Sort] Support Apache Kudu LoadNode URL: https://github.com/apache/inlong/issues/7268 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[inlong] branch master updated (a675d88a3 -> 5413ab78a)

This is an automated email from the ASF dual-hosted git repository. zirui pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from a675d88a3 [INLONG-7294][Manager] Fix the problem of suspend, restart, delete sort task failed (#7295) add 5413ab7

[GitHub] [inlong] EMsnap merged pull request #7228: [INLONG-7060][Sort] Support write redis in sort-connector-redis

EMsnap merged PR #7228: URL: https://github.com/apache/inlong/pull/7228 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.apach

[inlong] branch master updated (5413ab78a -> 479ff3ab9)

This is an automated email from the ASF dual-hosted git repository. zirui pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 5413ab78a [INLONG-7268][Sort] Support load node of Apache Kudu (#7269) add 479ff3ab9 [INLONG-7060][Sort] Support w

[GitHub] [inlong] EMsnap closed issue #7060: [Feature][Sort] Support write redis in sort-connector-redis

EMsnap closed issue #7060: [Feature][Sort] Support write redis in sort-connector-redis URL: https://github.com/apache/inlong/issues/7060 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [inlong] healchow commented on a diff in pull request #7289: [INLONG-7292][Sort] Fixed a bug for doris/starrocks/jdbc invokeMultiple method

healchow commented on code in PR #7289: URL: https://github.com/apache/inlong/pull/7289#discussion_r1091391336 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/dirty/DirtySinkHelper.java: ## @@ -136,6 +185,51 @@ public void invokeMultiple(T dirtyData

[GitHub] [inlong] healchow commented on issue #7292: [Bug][Sort] Fixed a bug for Doris/StarRocks/JDBC invokeMultiple method

healchow commented on issue #7292: URL: https://github.com/apache/inlong/issues/7292#issuecomment-1409690701 What bug? Please add more info for the Issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [inlong] healchow commented on pull request #7289: [INLONG-7292][Sort] Fixed a bug for doris/starrocks/jdbc invokeMultiple method

healchow commented on PR #7289: URL: https://github.com/apache/inlong/pull/7289#issuecomment-1409692370 Please add more info for the PR, such as the Motivation, Modifications and Verifying… -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [inlong] healchow commented on a diff in pull request #7289: [INLONG-7292][Sort] Fixed a bug for doris/starrocks/jdbc invokeMultiple method

healchow commented on code in PR #7289: URL: https://github.com/apache/inlong/pull/7289#discussion_r1091413467 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/Constants.java: ## @@ -135,6 +135,8 @@ public final class Constants { public static

[GitHub] [inlong] healchow commented on pull request #7290: [INLONG-7292][Sort] S3DirtySink flushes too quickly

healchow commented on PR #7290: URL: https://github.com/apache/inlong/pull/7290#issuecomment-1409705993 1. The `INLONG-7292` was incorrect in the PR title. 2. Please add more info for the PR. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [inlong] featzhang commented on a diff in pull request #7241: [INLONG-7240][Sort] Support load node of Redis

featzhang commented on code in PR #7241: URL: https://github.com/apache/inlong/pull/7241#discussion_r1091421191 ## inlong-sort/sort-common/src/main/java/org/apache/inlong/sort/protocol/node/load/RedisLoadNode.java: ## @@ -0,0 +1,249 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] [inlong] featzhang commented on a diff in pull request #7243: [INLONG-7242][Manager] Support register and manage the resource of Redis sink

featzhang commented on code in PR #7243: URL: https://github.com/apache/inlong/pull/7243#discussion_r1091421735 ## inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/sort/util/LoadNodeUtils.java: ## @@ -651,4 +715,59 @@ public static void checkPartitionFiel

[GitHub] [inlong] featzhang commented on a diff in pull request #7243: [INLONG-7242][Manager] Support register and manage the resource of Redis sink

featzhang commented on code in PR #7243: URL: https://github.com/apache/inlong/pull/7243#discussion_r1091423317 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/resource/sink/redis/RedisResourceOperator.java: ## @@ -0,0 +1,47 @@ +/* + * Licensed

[GitHub] [inlong] featzhang commented on a diff in pull request #7243: [INLONG-7242][Manager] Support register and manage the resource of Redis sink

featzhang commented on code in PR #7243: URL: https://github.com/apache/inlong/pull/7243#discussion_r1091435748 ## inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/sink/redis/RedisSinkOperator.java: ## @@ -0,0 +1,167 @@ +/* + * Licensed to the Apach

[GitHub] [inlong] featzhang commented on a diff in pull request #7270: [INLONG-7065][Manager] Support register and manage the resource of Kudu sink

featzhang commented on code in PR #7270: URL: https://github.com/apache/inlong/pull/7270#discussion_r1091437291 ## inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/sink/kudu/KuduPartitionField.java: ## @@ -0,0 +1,41 @@ +/* + * Licensed to the Apache Softw

[GitHub] [inlong] featzhang commented on a diff in pull request #7270: [INLONG-7065][Manager] Support register and manage the resource of Kudu sink

featzhang commented on code in PR #7270: URL: https://github.com/apache/inlong/pull/7270#discussion_r1091437529 ## inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/sink/kudu/KuduPartition.java: ## @@ -0,0 +1,54 @@ +/* + * Licensed to the Apache Software F

[GitHub] [inlong] dockerzhang merged pull request #7241: [INLONG-7240][Sort] Support load node of Redis

dockerzhang merged PR #7241: URL: https://github.com/apache/inlong/pull/7241 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[GitHub] [inlong] dockerzhang closed issue #7240: [Feature][Sort] Support load node of Redis

dockerzhang closed issue #7240: [Feature][Sort] Support load node of Redis URL: https://github.com/apache/inlong/issues/7240 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[inlong] branch master updated: [INLONG-7240][Sort] Support load node of Redis (#7241)

This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new ab88b914e [INLONG-7240][Sort] Support load

[inlong] branch master updated: [INLONG-7264][Dashboard] Support sink Apache Kudu (#7267)

This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 2b83000ff [INLONG-7264][Dashboard] Support

[GitHub] [inlong] dockerzhang closed issue #7264: [Feature][Dashboard] Support sink Apache Kudu

dockerzhang closed issue #7264: [Feature][Dashboard] Support sink Apache Kudu URL: https://github.com/apache/inlong/issues/7264 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [inlong] dockerzhang merged pull request #7267: [INLONG-7264][Dashboard] Support sink Apache Kudu

dockerzhang merged PR #7267: URL: https://github.com/apache/inlong/pull/7267 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #7148: [INLONG-7146][Sort] Adjust dirty data multiple sink archive strategy

yunqingmoswu commented on code in PR #7148: URL: https://github.com/apache/inlong/pull/7148#discussion_r1091499008 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/dirty/DirtySinkHelper.java: ## @@ -110,22 +114,59 @@ public void invokeMultiple(T dirt

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #7287: [INLONG-7286][Sort] Fix issue of tableidentifier being null when addRow

yunqingmoswu commented on code in PR #7287: URL: https://github.com/apache/inlong/pull/7287#discussion_r1091507002 ## inlong-sort/sort-connectors/doris/src/main/java/org/apache/inlong/sort/doris/table/DorisDynamicSchemaOutputFormat.java: ## @@ -441,7 +441,10 @@ private void addB

[GitHub] [inlong] yunqingmoswu commented on a diff in pull request #7289: [INLONG-7292][Sort] Accurately detect and archive dirty data for Doris/StarRocks/JDBC

yunqingmoswu commented on code in PR #7289: URL: https://github.com/apache/inlong/pull/7289#discussion_r1091509651 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/Constants.java: ## @@ -135,6 +135,8 @@ public final class Constants { public st

[GitHub] [inlong] dockerzhang commented on issue #4959: [Feature] Improve the log report for data stream

dockerzhang commented on issue #4959: URL: https://github.com/apache/inlong/issues/4959#issuecomment-1409845875  we can check the execution log from group->stream. -- This

[GitHub] [inlong] dockerzhang closed issue #4959: [Feature] Improve the log report for data stream

dockerzhang closed issue #4959: [Feature] Improve the log report for data stream URL: https://github.com/apache/inlong/issues/4959 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [inlong] dockerzhang closed issue #4990: Apache InLong Roadmap 2022 H2

dockerzhang closed issue #4990: Apache InLong Roadmap 2022 H2 URL: https://github.com/apache/inlong/issues/4990 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[inlong] branch branch-1.5 updated: [INLONG-7294][Manager] Fix the problem of suspend, restart, delete sort task failed (#7295)

This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch branch-1.5 in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/branch-1.5 by this push: new 4a0175797 [INLONG-7294][Manager] Fi

[GitHub] [inlong] Yizhou-Yang commented on a diff in pull request #7289: [INLONG-7292][Sort] Accurately detect and archive dirty data for Doris/StarRocks/JDBC

Yizhou-Yang commented on code in PR #7289: URL: https://github.com/apache/inlong/pull/7289#discussion_r1091525820 ## inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/Constants.java: ## @@ -135,6 +135,8 @@ public final class Constants { public sta

[GitHub] [inlong] Yizhou-Yang commented on a diff in pull request #7287: [INLONG-7286][Sort] Fix issue of tableidentifier being null when addRow

Yizhou-Yang commented on code in PR #7287: URL: https://github.com/apache/inlong/pull/7287#discussion_r1091534406 ## inlong-sort/sort-connectors/doris/src/main/java/org/apache/inlong/sort/doris/table/DorisDynamicSchemaOutputFormat.java: ## @@ -441,7 +441,10 @@ private void addBa

[GitHub] [inlong] Yizhou-Yang commented on pull request #7290: [INLONG-7292][Sort] S3DirtySink flushes too quickly

Yizhou-Yang commented on PR #7290: URL: https://github.com/apache/inlong/pull/7290#issuecomment-1409883987 > the batchinterval was used to make sure that it will flush every 6ms. But it does not stop the connector from calling .invoke before 6ms. This is to stop the S3

[GitHub] [inlong] dockerzhang opened a new pull request, #7296: [INLONG-6560][Docker] Add arm64 image for inlong/tubemq

dockerzhang opened a new pull request, #7296: URL: https://github.com/apache/inlong/pull/7296 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be repl