[GitHub] [inlong] EMsnap commented on a diff in pull request #8238: [INLONG-8236][Sort] Iceberg supports dynamic switching between append and upsert

EMsnap commented on code in PR #8238: URL: https://github.com/apache/inlong/pull/8238#discussion_r1229128439 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors/iceberg/src/main/java/org/apache/inlong/sort/iceberg/sink/RowDataTaskWriterFactory.java: ## @@ -97,6 +97,20 @@

[GitHub] [inlong] EMsnap commented on a diff in pull request #8238: [INLONG-8236][Sort] Iceberg supports dynamic switching between append and upsert

EMsnap commented on code in PR #8238: URL: https://github.com/apache/inlong/pull/8238#discussion_r1229132864 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors/iceberg/src/main/java/org/apache/inlong/sort/iceberg/sink/multiple/IcebergSingleStreamWriter.java: ## @@ -142,1

[GitHub] [inlong] lordcheng10 commented on a diff in pull request #8238: [INLONG-8236][Sort] Iceberg supports dynamic switching between append and upsert

lordcheng10 commented on code in PR #8238: URL: https://github.com/apache/inlong/pull/8238#discussion_r1229145000 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors/iceberg/src/main/java/org/apache/inlong/sort/iceberg/sink/RowDataTaskWriterFactory.java: ## @@ -97,6 +97,2

[GitHub] [inlong] lordcheng10 commented on a diff in pull request #8238: [INLONG-8236][Sort] Iceberg supports dynamic switching between append and upsert

lordcheng10 commented on code in PR #8238: URL: https://github.com/apache/inlong/pull/8238#discussion_r1229147191 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors/iceberg/src/main/java/org/apache/inlong/sort/iceberg/sink/multiple/IcebergSingleStreamWriter.java: ## @@ -

[GitHub] [inlong] lordcheng10 commented on a diff in pull request #8238: [INLONG-8236][Sort] Iceberg supports dynamic switching between append and upsert

lordcheng10 commented on code in PR #8238: URL: https://github.com/apache/inlong/pull/8238#discussion_r1229147487 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors/iceberg/src/main/java/org/apache/inlong/sort/iceberg/sink/multiple/IcebergSingleStreamWriter.java: ## @@ -

[GitHub] [inlong] EMsnap commented on a diff in pull request #8238: [INLONG-8236][Sort] Iceberg supports dynamic switching between append and upsert

EMsnap commented on code in PR #8238: URL: https://github.com/apache/inlong/pull/8238#discussion_r1229177089 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors/iceberg/src/main/java/org/apache/inlong/sort/iceberg/sink/multiple/IcebergSingleStreamWriter.java: ## @@ -142,1

[GitHub] [inlong] EMsnap commented on a diff in pull request #8238: [INLONG-8236][Sort] Iceberg supports dynamic switching between append and upsert

EMsnap commented on code in PR #8238: URL: https://github.com/apache/inlong/pull/8238#discussion_r1229177089 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors/iceberg/src/main/java/org/apache/inlong/sort/iceberg/sink/multiple/IcebergSingleStreamWriter.java: ## @@ -142,1

[GitHub] [inlong] EMsnap commented on a diff in pull request #8238: [INLONG-8236][Sort] Iceberg supports dynamic switching between append and upsert

EMsnap commented on code in PR #8238: URL: https://github.com/apache/inlong/pull/8238#discussion_r1229184101 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors/iceberg/src/main/java/org/apache/inlong/sort/iceberg/sink/multiple/IcebergSingleStreamWriter.java: ## @@ -142,1

[GitHub] [inlong] EMsnap commented on a diff in pull request #8238: [INLONG-8236][Sort] Iceberg supports dynamic switching between append and upsert

EMsnap commented on code in PR #8238: URL: https://github.com/apache/inlong/pull/8238#discussion_r1229184691 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors/iceberg/src/main/java/org/apache/inlong/sort/iceberg/sink/multiple/IcebergSingleStreamWriter.java: ## @@ -142,1

[GitHub] [inlong] lordcheng10 commented on a diff in pull request #8238: [INLONG-8236][Sort] Iceberg supports dynamic switching between append and upsert

lordcheng10 commented on code in PR #8238: URL: https://github.com/apache/inlong/pull/8238#discussion_r1229210286 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors/iceberg/src/main/java/org/apache/inlong/sort/iceberg/sink/multiple/IcebergSingleStreamWriter.java: ## @@ -

[GitHub] [inlong] e-mhui opened a new pull request, #8240: [INLONG-8175][Sort] MySQL CDC support read data from specific timestamp / earliest offset / specific offset

e-mhui opened a new pull request, #8240: URL: https://github.com/apache/inlong/pull/8240 …mp / earliest offset / specific offset ### Prepare a Pull Request [INLONG-8175][Sort] MySQL CDC support read data from specific timestamp / earliest offset / specific offset *(The f

[GitHub] [inlong] featzhang opened a new pull request, #8243: [INLONG-8242][Tool] Separate the distribution module to improve the performance of CR pipeline

featzhang opened a new pull request, #8243: URL: https://github.com/apache/inlong/pull/8243 The `inlong-distribution` module will cause parallel packaging failure and affect the performance of the CR pipeline, so this module is separated out. When executing a CR pipeline, no packaging is

[GitHub] [inlong] healchow commented on a diff in pull request #8243: [INLONG-8242][Tool] Separate the distribution module to improve the performance of CR pipeline

healchow commented on code in PR #8243: URL: https://github.com/apache/inlong/pull/8243#discussion_r1229463902 ## pom.xml: ## @@ -48,7 +48,6 @@ inlong-sort-standalone inlong-manager inlong-dashboard -inlong-distribution Review Comment: Plea

[GitHub] [inlong] healchow commented on a diff in pull request #8243: [INLONG-8242][Tool] Separate the distribution module to improve the performance of CR pipeline

healchow commented on code in PR #8243: URL: https://github.com/apache/inlong/pull/8243#discussion_r1229466527 ## pom.xml: ## @@ -48,7 +48,6 @@ inlong-sort-standalone inlong-manager inlong-dashboard -inlong-distribution Review Comment: See

[GitHub] [inlong-website] e-mhui opened a new issue, #774: [Improve][Sort] Add Doc for https://github.com/apache/inlong/pull/8240

e-mhui opened a new issue, #774: URL: https://github.com/apache/inlong-website/issues/774 ### Description Add Doc for https://github.com/apache/inlong/pull/8240 ### Are you willing to submit PR? - [X] Yes, I am willing to submit a PR! ### Code of Conduct - [

[GitHub] [inlong-website] e-mhui opened a new pull request, #775: [INLONG-774][Sort] Add Doc for MySQL CDC support read data from specific timestamp / earliest offset / specific offset

e-mhui opened a new pull request, #775: URL: https://github.com/apache/inlong-website/pull/775 ### Prepare a Pull Request [INLONG-774][Sort] Add Doc for MySQL CDC support read data from specific timestamp / earliest offset / specific offset - Fixes #774 ### Motivation

[GitHub] [inlong] yunqingmoswu merged pull request #8230: [INLONG-8217][Sort] Sort-core should support running on flink-1.15

yunqingmoswu merged PR #8230: URL: https://github.com/apache/inlong/pull/8230 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong

[inlong] branch master updated: [INLONG-8217][Sort] Sort-core should support running on flink-1.15 (#8230)

This is an automated email from the ASF dual-hosted git repository. yunqing pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new 5a789fe7fe [INLONG-8217][Sort] Sort-core should

[GitHub] [inlong] justinwwhuang opened a new pull request, #8245: [INLONG-8244][Agent]thread leaks after job finished

justinwwhuang opened a new pull request, #8245: URL: https://github.com/apache/inlong/pull/8245 ### Prepare a Pull Request *fix the bug that thread leaks after job finished* - Fixes #8244 ### Motivation *fix the bug that thread leaks after job finished* ### Modific

[GitHub] [inlong] GanfengTan opened a new pull request, #8246: [INLONG-8239][Sort] Support sort format to flink-1.15

GanfengTan opened a new pull request, #8246: URL: https://github.com/apache/inlong/pull/8246 Support sort format flink 1.3 and 1.5, the default package is flink 1.3. If packaging flink1.5 please use -P v1.15 - Fixes #8239 ### Motivation Support multiple versions of

[GitHub] [inlong] dockerzhang merged pull request #8235: [INLONG-8065][Sort] Add StarRocks connector on Flink 1.15

dockerzhang merged PR #8235: URL: https://github.com/apache/inlong/pull/8235 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated (5a789fe7fe -> 7ce5620ab0)

This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 5a789fe7fe [INLONG-8217][Sort] Sort-core should support running on flink-1.15 (#8230) add 7ce5620ab0 [INLON

[GitHub] [inlong] EMsnap commented on pull request #8238: [INLONG-8236][Sort] Iceberg supports dynamic switching between append and upsert

EMsnap commented on PR #8238: URL: https://github.com/apache/inlong/pull/8238#issuecomment-1592226856 Commit before checkpoint may influence EXACTLY_ONCE semantic ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [inlong] EMsnap commented on a diff in pull request #8238: [INLONG-8236][Sort][WIP] Iceberg supports dynamic switching between append and upsert

EMsnap commented on code in PR #8238: URL: https://github.com/apache/inlong/pull/8238#discussion_r1229186065 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors/iceberg/src/main/java/org/apache/inlong/sort/iceberg/sink/multiple/IcebergSingleStreamWriter.java: ## @@ -142,1

[GitHub] [inlong] haifxu opened a new pull request, #8250: [INLONG-8249][CVE] Upgrade org.springframework:spring-boot-autoconfigure to 2.6.15

haifxu opened a new pull request, #8250: URL: https://github.com/apache/inlong/pull/8250 ### Prepare a Pull Request - Fixes #8249 ### Motivation  ### Modifications

[GitHub] [inlong-website] dockerzhang merged pull request #773: [INLONG-772][Doc] Update the http report guide

dockerzhang merged PR #773: URL: https://github.com/apache/inlong-website/pull/773 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@i

[inlong-website] branch master updated: [INLONG-772][Doc] Update the http report guide (#773)

This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong-website.git The following commit(s) were added to refs/heads/master by this push: new 67c3d7f76b [INLONG-772][Doc] Update

[GitHub] [inlong] lordcheng10 commented on a diff in pull request #8238: [INLONG-8236][Sort][WIP] Iceberg supports dynamic switching between append and upsert

lordcheng10 commented on code in PR #8238: URL: https://github.com/apache/inlong/pull/8238#discussion_r1230354333 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors/iceberg/src/main/java/org/apache/inlong/sort/iceberg/sink/multiple/IcebergSingleStreamWriter.java: ## @@ -

[GitHub] [inlong] lordcheng10 commented on a diff in pull request #8238: [INLONG-8236][Sort][WIP] Iceberg supports dynamic switching between append and upsert

lordcheng10 commented on code in PR #8238: URL: https://github.com/apache/inlong/pull/8238#discussion_r1230359359 ## inlong-sort/sort-flink/sort-flink-v1.13/sort-connectors/iceberg/src/main/java/org/apache/inlong/sort/iceberg/sink/multiple/IcebergSingleStreamWriter.java: ## @@ -

[GitHub] [inlong] healchow commented on a diff in pull request #8245: [INLONG-8244][Agent] Fix the thread leaks after job finished

healchow commented on code in PR #8245: URL: https://github.com/apache/inlong/pull/8245#discussion_r1230363515 ## inlong-agent/agent-plugins/src/main/java/org/apache/inlong/agent/plugin/sources/reader/file/TriggerFileReader.java: ## @@ -31,6 +31,8 @@ public class TriggerFileRead

[GitHub] [inlong] gong commented on a diff in pull request #8246: [INLONG-8239][Sort] Support sort format to flink-1.15

gong commented on code in PR #8246: URL: https://github.com/apache/inlong/pull/8246#discussion_r1230363307 ## inlong-sort/sort-dist/pom.xml: ## @@ -145,4 +164,172 @@ + + + +v1.13 + +true +

[GitHub] [inlong] gong commented on a diff in pull request #8246: [INLONG-8239][Sort] Support sort format to flink-1.15

gong commented on code in PR #8246: URL: https://github.com/apache/inlong/pull/8246#discussion_r1230364004 ## inlong-sort/sort-formats/format-json-v1.5/pom.xml: ## @@ -0,0 +1,91 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; +

[GitHub] [inlong] justinwwhuang commented on a diff in pull request #8245: [INLONG-8244][Agent] Fix the thread leaks after job finished

justinwwhuang commented on code in PR #8245: URL: https://github.com/apache/inlong/pull/8245#discussion_r1230367780 ## inlong-agent/agent-plugins/src/main/java/org/apache/inlong/agent/plugin/sources/reader/file/TriggerFileReader.java: ## @@ -31,6 +31,8 @@ public class TriggerFil

[GitHub] [inlong] gong commented on a diff in pull request #8246: [INLONG-8239][Sort] Support sort format to flink-1.15

gong commented on code in PR #8246: URL: https://github.com/apache/inlong/pull/8246#discussion_r1230369022 ## inlong-sort/sort-dist/pom.xml: ## @@ -80,6 +82,11 @@ sort-format-json ${project.version} + +org.apache.inlong +

[GitHub] [inlong] dockerzhang merged pull request #8248: [INLONG-8247][Manager] Removes the restriction that only the admin user can create DataNodes

dockerzhang merged PR #8248: URL: https://github.com/apache/inlong/pull/8248 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated (7ce5620ab0 -> f97d4679b4)

This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git from 7ce5620ab0 [INLONG-8065][Sort] Add StarRocks connector on Flink 1.15 (#8235) add f97d4679b4 [INLONG-8247][M

[inlong] branch master updated: [INLONG-8249][CVE] Upgrade org.springframework:spring-boot-autoconfigure to 2.6.15 (#8250)

This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new c270963d50 [INLONG-8249][CVE] Upgrade org.

[GitHub] [inlong] dockerzhang merged pull request #8250: [INLONG-8249][CVE] Upgrade org.springframework:spring-boot-autoconfigure to 2.6.15

dockerzhang merged PR #8250: URL: https://github.com/apache/inlong/pull/8250 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[GitHub] [inlong] GanfengTan commented on a diff in pull request #8246: [INLONG-8239][Sort] Support sort format to flink-1.15

GanfengTan commented on code in PR #8246: URL: https://github.com/apache/inlong/pull/8246#discussion_r1230407854 ## inlong-sort/sort-dist/pom.xml: ## @@ -145,4 +164,172 @@ + + + +v1.13 + +true +

[GitHub] [inlong] GanfengTan commented on a diff in pull request #8246: [INLONG-8239][Sort] Support sort format to flink-1.15

GanfengTan commented on code in PR #8246: URL: https://github.com/apache/inlong/pull/8246#discussion_r1230407933 ## inlong-sort/sort-formats/format-json-v1.5/pom.xml: ## @@ -0,0 +1,91 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instan

[GitHub] [inlong] GanfengTan commented on a diff in pull request #8246: [INLONG-8239][Sort] Support sort format to flink-1.15

GanfengTan commented on code in PR #8246: URL: https://github.com/apache/inlong/pull/8246#discussion_r1230408447 ## inlong-sort/sort-dist/pom.xml: ## @@ -80,6 +82,11 @@ sort-format-json ${project.version} + +org.apache.inlo

[GitHub] [inlong] dockerzhang merged pull request #8245: [INLONG-8244][Agent] Fix the thread leaks after job finished

dockerzhang merged PR #8245: URL: https://github.com/apache/inlong/pull/8245 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@inlong.

[inlong] branch master updated: [INLONG-8244][Agent] Fix the thread leaks after job finished (#8245)

This is an automated email from the ASF dual-hosted git repository. dockerzhang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/inlong.git The following commit(s) were added to refs/heads/master by this push: new c599d71faf [INLONG-8244][Agent] Fix the thr

[GitHub] [inlong] gong commented on a diff in pull request #8246: [INLONG-8239][Sort] Support sort format to flink-1.15

gong commented on code in PR #8246: URL: https://github.com/apache/inlong/pull/8246#discussion_r1230433178 ## inlong-sort/sort-dist/pom.xml: ## @@ -248,86 +159,25 @@ -v1.5 +v1.15 1.15.4

[GitHub] [inlong] gong commented on a diff in pull request #8246: [INLONG-8239][Sort] Support sort format to flink-1.15

gong commented on code in PR #8246: URL: https://github.com/apache/inlong/pull/8246#discussion_r1230439856 ## inlong-sort/sort-dist/pom.xml: ## @@ -145,4 +133,53 @@ + + + +v1.13 + +true +

[GitHub] [inlong] justinwwhuang opened a new pull request, #8253: [INLONG-8251][agent] add global memory limit for file collect

justinwwhuang opened a new pull request, #8253: URL: https://github.com/apache/inlong/pull/8253 ### Prepare a Pull Request *add global memory limit for file collect* - Fixes #8251 ### Motivation *in some cases the jvm heap limits to 256m, but we need to collect more t

[GitHub] [inlong] justinwwhuang closed pull request #8253: [INLONG-8251][agent] add global memory limit for file collect

justinwwhuang closed pull request #8253: [INLONG-8251][agent] add global memory limit for file collect URL: https://github.com/apache/inlong/pull/8253 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [inlong] bluewang opened a new pull request, #8255: [INLONG-8254][Dashboard] Supports get brief information of inlong stream

bluewang opened a new pull request, #8255: URL: https://github.com/apache/inlong/pull/8255 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be replace

[GitHub] [inlong] justinwwhuang closed pull request #8256: Develop new

justinwwhuang closed pull request #8256: Develop new URL: https://github.com/apache/inlong/pull/8256 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [inlong] justinwwhuang opened a new pull request, #8256: Develop new

justinwwhuang opened a new pull request, #8256: URL: https://github.com/apache/inlong/pull/8256 ### Prepare a Pull Request *(Change the title refer to the following example)* - Title Example: [INLONG-XYZ][Component] Title of the pull request *(The following *XYZ* should be re