Re: [PR] [FLINK-33500][Runtime] Run storing the JobGraph an asynchronous operation [flink]

2023-12-05 Thread via GitHub
zhengzhili333 commented on PR #23866: URL: https://github.com/apache/flink/pull/23866#issuecomment-1840210958 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] [FLINK-24150][k8s] Support to configure cpu resource request and limit in pod template [flink]

2023-12-05 Thread via GitHub
Sucran commented on PR #23872: URL: https://github.com/apache/flink/pull/23872#issuecomment-1840275371 > -1 from my side based on previous community discussion: > > Please see the discussion in https://lists.apache.org/thread/6p5tk6obmk1qxf169so498z4vk8cg969 and the ticket: https://i

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-12-05 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793189#comment-17793189 ] Hangxiang Yu commented on FLINK-27681: -- Sorry for the late reply. {quote}However, 

Re: [PR] [FLINK-33663] Serialize CallExpressions into SQL [flink]

2023-12-05 Thread via GitHub
dawidwys merged PR #23811: URL: https://github.com/apache/flink/pull/23811 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [FLINK-24150][k8s] Support to configure cpu resource request and limit in pod template [flink]

2023-12-05 Thread via GitHub
gyfora commented on PR #23872: URL: https://github.com/apache/flink/pull/23872#issuecomment-1840282229 I understand that this may be confusing for you but unfortunately we cannot merge this PR in this form. Let's work on the operator side to solve this properly as seen in the linked lira

[jira] [Closed] (FLINK-33663) Serialize CallExpressions into SQL

2023-12-05 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Wysakowicz closed FLINK-33663. Resolution: Implemented Implemented in bc6c2cec37c45f021ae22a2a7b5ab9537b8506cd > Seriali

Re: [PR] [FLINK-32986][test] Fix createTemporaryFunction type inference error [flink]

2023-12-05 Thread via GitHub
jeyhunkarimov commented on PR #23586: URL: https://github.com/apache/flink/pull/23586#issuecomment-1840305544 Does it make any difference? yes and no IMHO. Yes, because imagine `test1()` executes the statement `createTemporarySystemFunction("add", new TestAddWithOpen)` (also `createTemp

Re: [PR] [FLINK-33730][doc] update the Flink upgrade savepoint compatibility table doc [flink]

2023-12-05 Thread via GitHub
JingGe commented on PR #23859: URL: https://github.com/apache/flink/pull/23859#issuecomment-1840309252 @PatrickRen Thanks for the review. I have address your suggestion and add 1.16.x column back. Would you please check it again? -- This is an automated message from the Apache Git Service

Re: [PR] [FLINK-32881][checkpoint] Support triggering savepoint in detach mode for CLI and dumping all pending savepoint ids by rest api [flink]

2023-12-05 Thread via GitHub
masteryhx commented on code in PR #23253: URL: https://github.com/apache/flink/pull/23253#discussion_r1415176143 ## flink-clients/src/main/java/org/apache/flink/client/cli/CliFrontendParser.java: ## @@ -157,6 +157,14 @@ public class CliFrontendParser {

[jira] [Updated] (FLINK-33730) Update the compatibility table to only include last three released versions

2023-12-05 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Ge updated FLINK-33730: Summary: Update the compatibility table to only include last three released versions (was: Update the com

Re: [PR] [FLINK-32881][checkpoint] Support triggering savepoint in detach mode for CLI and dumping all pending savepoint ids by rest api [flink]

2023-12-05 Thread via GitHub
masteryhx commented on code in PR #23253: URL: https://github.com/apache/flink/pull/23253#discussion_r1415217180 ## flink-clients/src/main/java/org/apache/flink/client/cli/CliFrontendParser.java: ## @@ -157,6 +157,14 @@ public class CliFrontendParser {

Re: [PR] [FLINK-28229][connectors] Introduce FLIP-27 alternative to StreamExecutionEnvironment#fromCollection() [flink]

2023-12-05 Thread via GitHub
zentol merged PR #23558: URL: https://github.com/apache/flink/pull/23558 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Closed] (FLINK-28229) Introduce Source API alternatives for StreamExecutionEnvironment#fromCollection() methods

2023-12-05 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-28229. Fix Version/s: 1.19.0 Resolution: Fixed master: e44efbff8070dca3489550fdeadc5e1ce31

Re: [PR] [FLINK-32881][checkpoint] Support triggering savepoint in detach mode for CLI and dumping all pending savepoint ids by rest api [flink]

2023-12-05 Thread via GitHub
Zakelly commented on code in PR #23253: URL: https://github.com/apache/flink/pull/23253#discussion_r1415245692 ## flink-clients/src/main/java/org/apache/flink/client/cli/CliFrontendParser.java: ## @@ -157,6 +157,14 @@ public class CliFrontendParser {

[jira] [Updated] (FLINK-33603) Fix guava shading for GCS connector

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33603: --- Labels: pull-request-available (was: ) > Fix guava shading for GCS connector >

Re: [PR] [FLINK-32881][checkpoint] Support triggering savepoint in detach mode for CLI and dumping all pending savepoint ids by rest api [flink]

2023-12-05 Thread via GitHub
Zakelly commented on PR #23253: URL: https://github.com/apache/flink/pull/23253#issuecomment-1840388226 Hi @xiangforever2014 @masteryhx sorry for jumping in... And I'm wondering if we could use the capital '-D' for short option? Or I suggest we do not leave any short option for this, only u

Re: [PR] [ FLINK-33603][FileSystems] shade guava in gs-fs filesystem [flink]

2023-12-05 Thread via GitHub
singhravidutt commented on PR #23489: URL: https://github.com/apache/flink/pull/23489#issuecomment-1840388220 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] [FLINK-32881][checkpoint] Support triggering savepoint in detach mode for CLI and dumping all pending savepoint ids by rest api [flink]

2023-12-05 Thread via GitHub
masteryhx commented on code in PR #23253: URL: https://github.com/apache/flink/pull/23253#discussion_r1415222035 ## docs/content.zh/docs/deployment/cli.md: ## @@ -125,6 +125,43 @@ Lastly, you can optionally provide what should be the [binary format]({{< ref "d The path to th

Re: [PR] [FLINK-32073][checkpoint] Implement file merging in snapshot [flink]

2023-12-05 Thread via GitHub
Zakelly commented on code in PR #23514: URL: https://github.com/apache/flink/pull/23514#discussion_r1415294769 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FileMergingCheckpointStateOutputStream.java: ## @@ -0,0 +1,255 @@ +/* + * Licensed to the Apach

Re: [PR] [FLINK-32073][checkpoint] Implement file merging in snapshot [flink]

2023-12-05 Thread via GitHub
Zakelly commented on PR #23514: URL: https://github.com/apache/flink/pull/23514#issuecomment-1840444858 > Thanks @fredia and @Zakelly for your comments. Sorry for the late reply. I have addressed your comments. Would you please take another look? Thanks for your effort. I have no comm

Re: [PR] [FLIP-321] Update the docs to add migration periods for deprecated APIs. [flink]

2023-12-05 Thread via GitHub
gaborgsomogyi commented on PR #23865: URL: https://github.com/apache/flink/pull/23865#issuecomment-1840452321 Thanks for the explanation! > In terms of the source / binary compatibility, the main reason we do not provide binary compatibility in minor releases for any API stability lev

Re: [PR] [FLINK-33541][table-planner] function RAND and RAND_INTEGER should return type nullable if the arguments are nullable [flink]

2023-12-05 Thread via GitHub
libenchao commented on PR #23779: URL: https://github.com/apache/flink/pull/23779#issuecomment-1840508653 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (FLINK-33670) Public operators cannot be reused in multi sinks

2023-12-05 Thread Jeyhun Karimov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793232#comment-17793232 ] Jeyhun Karimov commented on FLINK-33670: Hi [~zicat] I tried with Flink master b

[jira] [Created] (FLINK-33751) use modules correctly when deserializing json plan

2023-12-05 Thread shuaiqi.guo (Jira)
shuaiqi.guo created FLINK-33751: --- Summary: use modules correctly when deserializing json plan Key: FLINK-33751 URL: https://issues.apache.org/jira/browse/FLINK-33751 Project: Flink Issue Type:

[jira] [Updated] (FLINK-33751) use modules correctly when deserializing json plan

2023-12-05 Thread shuaiqi.guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuaiqi.guo updated FLINK-33751: Attachment: FLINK-33751.patch > use modules correctly when deserializing json plan > -

[jira] [Created] (FLINK-33752) When Duration is greater than or equal to 1 day, the display unit is ms.

2023-12-05 Thread Rui Fan (Jira)
Rui Fan created FLINK-33752: --- Summary: When Duration is greater than or equal to 1 day, the display unit is ms. Key: FLINK-33752 URL: https://issues.apache.org/jira/browse/FLINK-33752 Project: Flink

[jira] [Created] (FLINK-33753) ContinuousFileReaderOperator consume records as mini batch

2023-12-05 Thread Prabhu Joseph (Jira)
Prabhu Joseph created FLINK-33753: - Summary: ContinuousFileReaderOperator consume records as mini batch Key: FLINK-33753 URL: https://issues.apache.org/jira/browse/FLINK-33753 Project: Flink

[jira] [Updated] (FLINK-33752) When Duration is greater than or equal to 1 day, the display unit is ms.

2023-12-05 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33752: Description: When the default value of Duration is 24 hours or 1 day, the display unit is ms. (8640 m

[jira] [Updated] (FLINK-33752) When Duration is greater than or equal to 1 day, the display unit is ms.

2023-12-05 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33752: Attachment: image-2023-12-05-19-58-07-737.png > When Duration is greater than or equal to 1 day, the displ

[jira] [Created] (FLINK-33754) Serialize QueryOperations into SQL

2023-12-05 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-33754: Summary: Serialize QueryOperations into SQL Key: FLINK-33754 URL: https://issues.apache.org/jira/browse/FLINK-33754 Project: Flink Issue Type: Sub-ta

[PR] [FLINK-33752][Configuration] Change the displayed timeunit to day when the duration is an integral multiple of 1 day [flink]

2023-12-05 Thread via GitHub
1996fanrui opened a new pull request, #23873: URL: https://github.com/apache/flink/pull/23873 ## What is the purpose of the change When the default value of Duration is 24 hours or 1 day, the display unit is ms. (8640 ms). For example, the [kubernetes operator doc](https://nightl

[jira] [Updated] (FLINK-33752) When Duration is greater than or equal to 1 day, the display unit is ms.

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33752: --- Labels: pull-request-available (was: ) > When Duration is greater than or equal to 1 day, t

Re: [PR] [FLINK-33266][sql-gateway] Support plan cache for DQL in SQL Gateway [flink]

2023-12-05 Thread via GitHub
zoudan commented on code in PR #23849: URL: https://github.com/apache/flink/pull/23849#discussion_r1415242114 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/internal/ResultProvider.java: ## @@ -59,4 +59,7 @@ public interface ResultProvider { *

Re: [PR] [FLINK-33266][sql-gateway] Support plan cache for DQL in SQL Gateway [flink]

2023-12-05 Thread via GitHub
zoudan commented on code in PR #23849: URL: https://github.com/apache/flink/pull/23849#discussion_r1415242114 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/internal/ResultProvider.java: ## @@ -59,4 +59,7 @@ public interface ResultProvider { *

Re: [PR] [FLINK-33502][network] Prevent DiskTierProducerAgent#getSegmentIdByIndexOfFirstBufferInSegment from throwing NPE when the task is released [flink]

2023-12-05 Thread via GitHub
WencongLiu commented on code in PR #23863: URL: https://github.com/apache/flink/pull/23863#discussion_r1415495161 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/tiered/tier/disk/DiskTierProducerAgent.java: ## @@ -223,9 +228,16 @@ private void

Re: [PR] [FLINK-33752][Configuration] Change the displayed timeunit to day when the duration is an integral multiple of 1 day [flink]

2023-12-05 Thread via GitHub
flinkbot commented on PR #23873: URL: https://github.com/apache/flink/pull/23873#issuecomment-1840670193 ## CI report: * 3bbbddd74077c28f009567d49f99e6277223c03b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-33338) Bump FRocksDB version

2023-12-05 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793246#comment-17793246 ] Yanfei Lei commented on FLINK-8: [~mayuehappy]/[~pnowojski]  Some updates: I fi

Re: [PR] [FLINK-33502][network] Prevent DiskTierProducerAgent#getSegmentIdByIndexOfFirstBufferInSegment from throwing NPE when the task is released [flink]

2023-12-05 Thread via GitHub
WencongLiu commented on code in PR #23863: URL: https://github.com/apache/flink/pull/23863#discussion_r1415504026 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/tiered/tier/disk/DiskTierProducerAgent.java: ## @@ -223,9 +228,16 @@ private void

[jira] [Commented] (FLINK-33232) Kubernetive Operator Not Able to Take Other Python paramters While Submitting Job Deployment

2023-12-05 Thread chaoran.su (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793249#comment-17793249 ] chaoran.su commented on FLINK-33232: I think this can be done by change the jobSpec.

Re: [PR] [FLINK-33669][doc] Update the documentation for RestartStrategy, Checkpoint Storage, and State Backend. [flink]

2023-12-05 Thread via GitHub
zhuzhurk closed pull request #23847: [FLINK-33669][doc] Update the documentation for RestartStrategy, Checkpoint Storage, and State Backend. URL: https://github.com/apache/flink/pull/23847 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Closed] (FLINK-33669) Update the documentation for RestartStrategy, Checkpoint Storage, and State Backend.

2023-12-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-33669. --- Fix Version/s: 1.19.0 Resolution: Done master: e27f8a3a0783d551457a2f424b01267bd1c8c2c2 d9bcb3b40ed5c

Re: [PR] [FLINK-33502][network] Prevent DiskTierProducerAgent#getSegmentIdByIndexOfFirstBufferInSegment from throwing NPE when the task is released [flink]

2023-12-05 Thread via GitHub
WencongLiu commented on code in PR #23863: URL: https://github.com/apache/flink/pull/23863#discussion_r1415504026 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/tiered/tier/disk/DiskTierProducerAgent.java: ## @@ -223,9 +228,16 @@ private void

[PR] [FLINK-33751] use modules correctly when deserializing json plan [flink]

2023-12-05 Thread via GitHub
shuaiqig opened a new pull request, #23874: URL: https://github.com/apache/flink/pull/23874 ## What is the purpose of the change use modules correctly when deserializing json plan ## Brief change log fix 2 bug in deserializing json plan: 1. if 2 Operators were foun

[jira] [Updated] (FLINK-33751) use modules correctly when deserializing json plan

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33751: --- Labels: pull-request-available (was: ) > use modules correctly when deserializing json plan

Re: [PR] [FLINK-33751] use modules correctly when deserializing json plan [flink]

2023-12-05 Thread via GitHub
flinkbot commented on PR #23874: URL: https://github.com/apache/flink/pull/23874#issuecomment-1840731716 ## CI report: * 65142b1c17f91f24aeb126db32c89268a5d1b14a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-33713][core] Deprecate RuntimeContext#getExecutionConfig [flink]

2023-12-05 Thread via GitHub
zhuzhurk commented on code in PR #23848: URL: https://github.com/apache/flink/pull/23848#discussion_r1415539068 ## flink-core/src/main/java/org/apache/flink/api/common/functions/util/AbstractRuntimeUDFContext.java: ## @@ -83,10 +86,27 @@ public AbstractRuntimeUDFContext( }

Re: [PR] [FLINK-33470] Implement restore tests for Join node [flink]

2023-12-05 Thread via GitHub
dawidwys commented on code in PR #23869: URL: https://github.com/apache/flink/pull/23869#discussion_r1415600246 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/RestoreTestBase.java: ## @@ -117,6 +122,11 @@ public EnumSet

Re: [PR] [FLIP-321] Update the docs to add migration periods for deprecated APIs. [flink]

2023-12-05 Thread via GitHub
pvary commented on PR #23865: URL: https://github.com/apache/flink/pull/23865#issuecomment-1840787769 I would suggest to change the [previous](https://nightlies.apache.org/flink/flink-docs-master/docs/ops/upgrading/#api-compatibility-guarantees) paragraph, like the following (remove the API

Re: [PR] [FLINK-32894] Use 3.3.0 for maven-shade-plugin to support Java 17 [flink-connector-shared-utils]

2023-12-05 Thread via GitHub
echauchot commented on PR #20: URL: https://github.com/apache/flink-connector-shared-utils/pull/20#issuecomment-1840799581 @snuyanzin as you already started, do you want to take this review ? -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [PR] [FLINK-33710] Prevent triggering cluster upgrades for permutations of the same overrides [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
mxm commented on PR #721: URL: https://github.com/apache/flink-kubernetes-operator/pull/721#issuecomment-1840802299 PTAL @gyfora -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [FLINK-33710] Prevent triggering cluster upgrades for permutations of the same overrides [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
mxm commented on code in PR #721: URL: https://github.com/apache/flink-kubernetes-operator/pull/721#discussion_r1415619399 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/reconciler/deployment/AbstractFlinkResourceReconciler.java: ## @@ -180,13 +

Re: [PR] [FLINK-33667] Implement restore tests for MatchRecognize node [flink]

2023-12-05 Thread via GitHub
dawidwys commented on code in PR #23821: URL: https://github.com/apache/flink/pull/23821#discussion_r1415623981 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/stream/MatchRecognizeTestPrograms.java: ## @@ -0,0 +1,300 @@ +/* + * Li

Re: [PR] [FLINK-33470] Implement restore tests for Join node [flink]

2023-12-05 Thread via GitHub
dawidwys commented on code in PR #23869: URL: https://github.com/apache/flink/pull/23869#discussion_r1415628238 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/JoinTestPrograms.java: ## @@ -0,0 +1,450 @@ +/* + * Licensed

Re: [PR] [FLINK-33470] Implement restore tests for Join node [flink]

2023-12-05 Thread via GitHub
dawidwys commented on code in PR #23869: URL: https://github.com/apache/flink/pull/23869#discussion_r1415631030 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/RestoreTestBase.java: ## @@ -117,6 +122,11 @@ public EnumSet

[jira] [Created] (FLINK-33755) Cleanup usage of deprecated StreamExecutionEnvironment#generateSequence

2023-12-05 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-33755: --- Summary: Cleanup usage of deprecated StreamExecutionEnvironment#generateSequence Key: FLINK-33755 URL: https://issues.apache.org/jira/browse/FLINK-33755 Project

[PR] [FLINK-33755] Cleanup usage of deprecated StreamExecutionEnvironment#generateSequence [flink]

2023-12-05 Thread via GitHub
snuyanzin opened a new pull request, #23875: URL: https://github.com/apache/flink/pull/23875 ## What is the purpose of the change The PR to replace usages of `StreamExecutionEnvironment#generateSequence` with `StreamExecutionEnvironment#fromSequence` as mentioned in javadoc

[jira] [Updated] (FLINK-33755) Cleanup usage of deprecated StreamExecutionEnvironment#generateSequence

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33755: --- Labels: pull-request-available (was: ) > Cleanup usage of deprecated StreamExecutionEnviron

Re: [PR] [FLINK-33386][runtime] Support tasks balancing at slot level for Default Scheduler [flink]

2023-12-05 Thread via GitHub
RocMarshal commented on code in PR #23635: URL: https://github.com/apache/flink/pull/23635#discussion_r1415650282 ## flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/GlobalViewDeclarativeSlotPoolBridge.java: ## @@ -0,0 +1,261 @@ +/* + * Licensed to the Apa

[jira] [Updated] (FLINK-33755) Cleanup usage of deprecated StreamExecutionEnvironment#generateSequence

2023-12-05 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-33755: Component/s: (was: Table SQL / Planner) > Cleanup usage of deprecated StreamExecutionE

Re: [PR] [FLINK-33710] Prevent triggering cluster upgrades for permutations of the same overrides [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
1996fanrui commented on code in PR #721: URL: https://github.com/apache/flink-kubernetes-operator/pull/721#discussion_r1415657657 ## flink-kubernetes-operator/src/test/java/org/apache/flink/kubernetes/operator/autoscaler/KubernetesScalingRealizerTest.java: ## @@ -30,12 +31,23 @

Re: [PR] [FLINK-33755] Cleanup usage of deprecated StreamExecutionEnvironment#generateSequence [flink]

2023-12-05 Thread via GitHub
flinkbot commented on PR #23875: URL: https://github.com/apache/flink/pull/23875#issuecomment-1840847783 ## CI report: * 4acb9f182b43cf89786baa73e7ee1407a12cf58c UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-33710] Prevent triggering cluster upgrades for permutations of the same overrides [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
1996fanrui commented on code in PR #721: URL: https://github.com/apache/flink-kubernetes-operator/pull/721#discussion_r1415657657 ## flink-kubernetes-operator/src/test/java/org/apache/flink/kubernetes/operator/autoscaler/KubernetesScalingRealizerTest.java: ## @@ -30,12 +31,23 @

Re: [PR] [FLINK-33386][runtime] Support tasks balancing at slot level for Default Scheduler [flink]

2023-12-05 Thread via GitHub
RocMarshal commented on code in PR #23635: URL: https://github.com/apache/flink/pull/23635#discussion_r1415663600 ## flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/GlobalViewDeclarativeSlotPoolBridge.java: ## @@ -0,0 +1,261 @@ +/* + * Licensed to the Apa

Re: [PR] [FLINK-33667] Implement restore tests for MatchRecognize node [flink]

2023-12-05 Thread via GitHub
jnh5y commented on code in PR #23821: URL: https://github.com/apache/flink/pull/23821#discussion_r1415662216 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/stream/MatchRecognizeTestPrograms.java: ## @@ -0,0 +1,300 @@ +/* + * Licen

Re: [PR] [FLINK-33710] Prevent triggering cluster upgrades for permutations of the same overrides [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
gyfora commented on code in PR #721: URL: https://github.com/apache/flink-kubernetes-operator/pull/721#discussion_r1415668748 ## flink-kubernetes-operator/src/test/java/org/apache/flink/kubernetes/operator/autoscaler/KubernetesScalingRealizerTest.java: ## @@ -30,12 +31,23 @@ p

Re: [PR] [FLINK-33386][runtime] Support tasks balancing at slot level for Default Scheduler [flink]

2023-12-05 Thread via GitHub
RocMarshal commented on code in PR #23635: URL: https://github.com/apache/flink/pull/23635#discussion_r1415668887 ## flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/GlobalViewDeclarativeSlotPoolBridge.java: ## @@ -0,0 +1,261 @@ +/* + * Licensed to the Apa

Re: [PR] [FLINK-33710] Prevent triggering cluster upgrades for permutations of the same overrides [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
1996fanrui commented on code in PR #721: URL: https://github.com/apache/flink-kubernetes-operator/pull/721#discussion_r1415657657 ## flink-kubernetes-operator/src/test/java/org/apache/flink/kubernetes/operator/autoscaler/KubernetesScalingRealizerTest.java: ## @@ -30,12 +31,23 @

Re: [PR] [FLINK-33470] Implement restore tests for Join node [flink]

2023-12-05 Thread via GitHub
jnh5y commented on code in PR #23869: URL: https://github.com/apache/flink/pull/23869#discussion_r1415682052 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/RestoreTestBase.java: ## @@ -117,6 +122,11 @@ public EnumSet sup

Re: [PR] [FLINK-33470] Implement restore tests for Join node [flink]

2023-12-05 Thread via GitHub
jnh5y commented on code in PR #23869: URL: https://github.com/apache/flink/pull/23869#discussion_r1415680690 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/RestoreTestBase.java: ## @@ -117,6 +122,11 @@ public EnumSet sup

Re: [PR] [FLINK-33710] Prevent triggering cluster upgrades for permutations of the same overrides [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
1996fanrui commented on code in PR #721: URL: https://github.com/apache/flink-kubernetes-operator/pull/721#discussion_r1415688264 ## flink-kubernetes-operator/src/test/java/org/apache/flink/kubernetes/operator/autoscaler/KubernetesScalingRealizerTest.java: ## @@ -30,12 +31,23 @

Re: [PR] [Flink 31966] Flink Kubernetes operator lacks TLS support [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
gyfora commented on code in PR #712: URL: https://github.com/apache/flink-kubernetes-operator/pull/712#discussion_r1415689682 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/service/AbstractFlinkService.java: ## @@ -1075,4 +1106,59 @@ protected v

Re: [PR] [FLINK-33667] Implement restore tests for MatchRecognize node [flink]

2023-12-05 Thread via GitHub
jnh5y commented on PR #23821: URL: https://github.com/apache/flink/pull/23821#issuecomment-1840893823 > LGTM % the ids issue, I'll merge the PR after #23869 which is necessary for the cleanup. FWIW, MR observes the changelog not final results. I *think* it should be ok to merge befo

Re: [PR] [FLINK-33386][runtime] Support tasks balancing at slot level for Default Scheduler [flink]

2023-12-05 Thread via GitHub
RocMarshal commented on PR #23635: URL: https://github.com/apache/flink/pull/23635#issuecomment-1840891716 Thank you @1996fanrui @KarmaGYZ very much for the review I have re evaluated the implementation location of the waiting mechanisms based on @KarmaGYZ offline suggestions.

Re: [PR] [Flink 31966] Flink Kubernetes operator lacks TLS support [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
gaborgsomogyi commented on code in PR #712: URL: https://github.com/apache/flink-kubernetes-operator/pull/712#discussion_r1415671557 ## helm/flink-kubernetes-operator/templates/flink-operator.yaml: ## @@ -130,6 +141,10 @@ spec: - name: flink-artifacts-volume

Re: [PR] [FLINK-33441] Implement restore tests for ExecUnion node [flink]

2023-12-05 Thread via GitHub
jnh5y commented on code in PR #23653: URL: https://github.com/apache/flink/pull/23653#discussion_r1415705636 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/RestoreTestBase.java: ## @@ -91,7 +91,8 @@ public EnumSet suppor

[PR] [FLINK-25857] Add committer metrics to track the status of committables - non-breaking [flink]

2023-12-05 Thread via GitHub
pvary opened a new pull request, #23876: URL: https://github.com/apache/flink/pull/23876 ## What is the purpose of the change This is the a revisited non-breaking implementation of [FLIP-371: Provide initialization context for Committer creation in TwoPhaseCommittingSink](https://cwi

Re: [PR] [Flink 31966] Flink Kubernetes operator lacks TLS support [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
gaborgsomogyi commented on PR #712: URL: https://github.com/apache/flink-kubernetes-operator/pull/712#issuecomment-1840907216 Sorry for the late response we've quite some tasks to do. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [FLINK-33480] Implement restore tests for GroupAggregate node [flink]

2023-12-05 Thread via GitHub
jnh5y commented on PR #23681: URL: https://github.com/apache/flink/pull/23681#issuecomment-1840907198 The CI failure is from spotless. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [FLINK-33667] Implement restore tests for MatchRecognize node [flink]

2023-12-05 Thread via GitHub
dawidwys commented on PR #23821: URL: https://github.com/apache/flink/pull/23821#issuecomment-1840912550 > FWIW, MR observes the changelog not final results. I think it should be ok to merge before or after the Join PR. I don't think it makes a difference. Both access static variables

Re: [PR] Give cluster/job role access to k8s services API [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
gyfora commented on PR #668: URL: https://github.com/apache/flink-kubernetes-operator/pull/668#issuecomment-1840917676 Any update on this @sbrother ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] [FLINK-25857] Add committer metrics to track the status of committables - non-breaking [flink]

2023-12-05 Thread via GitHub
flinkbot commented on PR #23876: URL: https://github.com/apache/flink/pull/23876#issuecomment-1840919846 ## CI report: * 99ec936966af527598ca49712c1263bc4aa03c15 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-32894] Use 3.3.0 for maven-shade-plugin to support Java 17 [flink-connector-shared-utils]

2023-12-05 Thread via GitHub
snuyanzin commented on PR #20: URL: https://github.com/apache/flink-connector-shared-utils/pull/20#issuecomment-1840937326 yep sure @PatrickRen would you mind to bump it to 3.5.1? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [PR] [FLIP-321] Update the docs to add migration periods for deprecated APIs. [flink]

2023-12-05 Thread via GitHub
pvary commented on code in PR #23865: URL: https://github.com/apache/flink/pull/23865#discussion_r1415756044 ## docs/content/docs/ops/upgrading.md: ## @@ -60,6 +60,32 @@ Code written against a `PublicEvolving` API in 1.15.2 will continue to run in 1. That same code would have

Re: [PR] [FLIP-321] Update the docs to add migration periods for deprecated APIs. [flink]

2023-12-05 Thread via GitHub
pvary commented on code in PR #23865: URL: https://github.com/apache/flink/pull/23865#discussion_r1415756044 ## docs/content/docs/ops/upgrading.md: ## @@ -60,6 +60,32 @@ Code written against a `PublicEvolving` API in 1.15.2 will continue to run in 1. That same code would have

Re: [PR] [FLINK-30400][build] Stop bundling flink-connector-base [flink-connector-pulsar]

2023-12-05 Thread via GitHub
tisonkun merged PR #61: URL: https://github.com/apache/flink-connector-pulsar/pull/61 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...

Re: [PR] [FLINK-33470] Implement restore tests for Join node [flink]

2023-12-05 Thread via GitHub
dawidwys commented on code in PR #23869: URL: https://github.com/apache/flink/pull/23869#discussion_r1415790788 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/JoinTestPrograms.java: ## @@ -107,7 +107,7 @@ public class Jo

Re: [PR] [Flink 31966] Flink Kubernetes operator lacks TLS support [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
tagarr commented on code in PR #712: URL: https://github.com/apache/flink-kubernetes-operator/pull/712#discussion_r1415815965 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/service/AbstractFlinkService.java: ## @@ -195,8 +199,25 @@ public void s

Re: [PR] [Flink 31966] Flink Kubernetes operator lacks TLS support [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
tagarr commented on code in PR #712: URL: https://github.com/apache/flink-kubernetes-operator/pull/712#discussion_r1415823972 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/service/AbstractFlinkService.java: ## @@ -1075,4 +1106,59 @@ protected v

Re: [PR] [FLINK-32028][connectors/elasticsearch] Allow customising bulk failure handling [flink-connector-elasticsearch]

2023-12-05 Thread via GitHub
afedulov commented on PR #83: URL: https://github.com/apache/flink-connector-elasticsearch/pull/83#issuecomment-1841113426 @schulzp thanks for the contribution. The approach looks solid. I believe what is missing are some tests that check that the non-default inspector is actually utilized

Re: [PR] [FLINK-33470] Implement restore tests for Join node [flink]

2023-12-05 Thread via GitHub
jnh5y commented on code in PR #23869: URL: https://github.com/apache/flink/pull/23869#discussion_r1415899730 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/JoinTestPrograms.java: ## @@ -107,7 +107,7 @@ public class JoinT

Re: [PR] [FLINK-33755] Cleanup usage of deprecated StreamExecutionEnvironment#generateSequence [flink]

2023-12-05 Thread via GitHub
snuyanzin commented on PR #23875: URL: https://github.com/apache/flink/pull/23875#issuecomment-1841156149 Thanks for taking a look -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[jira] [Closed] (FLINK-33755) Cleanup usage of deprecated StreamExecutionEnvironment#generateSequence

2023-12-05 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin closed FLINK-33755. --- > Cleanup usage of deprecated StreamExecutionEnvironment#generateSequence >

Re: [PR] [FLINK-33755] Cleanup usage of deprecated StreamExecutionEnvironment#generateSequence [flink]

2023-12-05 Thread via GitHub
snuyanzin merged PR #23875: URL: https://github.com/apache/flink/pull/23875 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Resolved] (FLINK-33755) Cleanup usage of deprecated StreamExecutionEnvironment#generateSequence

2023-12-05 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-33755. - Resolution: Fixed > Cleanup usage of deprecated StreamExecutionEnvironment#generateSeque

[jira] [Commented] (FLINK-33755) Cleanup usage of deprecated StreamExecutionEnvironment#generateSequence

2023-12-05 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793352#comment-17793352 ] Sergey Nuyanzin commented on FLINK-33755: - Merged to master as [e74592ca92f4eac

[PR] [FLINK-33666][table] Use the same constraint name in MergeTableLikeUtil and Schema [flink]

2023-12-05 Thread via GitHub
jeyhunkarimov opened a new pull request, #23877: URL: https://github.com/apache/flink/pull/23877 ## What is the purpose of the change The purpose of this change is to make the constraint generation mechanism the same in MergeTableLikeUtil and Schema ## Brief change log

[jira] [Updated] (FLINK-33666) MergeTableLikeUtil uses different constraint name than Schema

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33666: --- Labels: pull-request-available (was: ) > MergeTableLikeUtil uses different constraint name

Re: [PR] [FLINK-33666][table] Use the same constraint name in MergeTableLikeUtil and Schema [flink]

2023-12-05 Thread via GitHub
flinkbot commented on PR #23877: URL: https://github.com/apache/flink/pull/23877#issuecomment-1841235550 ## CI report: * 0fc7e4da09365d5a524a68a715f8c7961d522aac UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [Flink 31966] Flink Kubernetes operator lacks TLS support [flink-kubernetes-operator]

2023-12-05 Thread via GitHub
tagarr commented on PR #712: URL: https://github.com/apache/flink-kubernetes-operator/pull/712#issuecomment-1841240447 So if you prefer not catching the exception I can just add some info in the example readme about ensuring ssl location and password are consistent or you may see exception

Re: [PR] [FLINK-33470] Implement restore tests for Join node [flink]

2023-12-05 Thread via GitHub
jnh5y commented on code in PR #23869: URL: https://github.com/apache/flink/pull/23869#discussion_r1416020844 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/JoinTestPrograms.java: ## @@ -0,0 +1,450 @@ +/* + * Licensed to

  1   2   >