Re: [PR] [FLINK-36685][Kubernetes Operator] allow CREATE/UPDATE operation on flinkdeployments resource on webhook mutation endpoint [flink-kubernetes-operator]

2024-11-21 Thread via GitHub
gyfora merged PR #916: URL: https://github.com/apache/flink-kubernetes-operator/pull/916 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr

[jira] [Commented] (FLINK-35859) [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called

2024-11-21 Thread Xin Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900028#comment-17900028 ] Xin Gong commented on FLINK-35859: -- [~loserwang1024] Users cannot immediately perceive

[jira] [Commented] (FLINK-36535) Optimize the scale down logic based on historical parallelism

2024-11-21 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900029#comment-17900029 ] Gyula Fora commented on FLINK-36535: I think this would be a nice improvement (y) >

[jira] [Updated] (FLINK-36535) Optimize the scale down logic based on historical parallelism

2024-11-21 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-36535: Description: This is a follow-up to FLINK-36018 . FLINK-36018 supported the lazy scale down to avoid freq

[jira] [Updated] (FLINK-36535) Optimize the scale down logic based on historical parallelism

2024-11-21 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-36535: Description: This is a follow-up to FLINK-36018 . FLINK-36018 supported the lazy scale down to avoid freq

[jira] [Commented] (FLINK-36535) Optimize the scale down logic based on historical parallelism

2024-11-21 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900024#comment-17900024 ] Rui Fan commented on FLINK-36535: - cc [~gyfora] [~mxm]  > Optimize the scale down logic

[jira] [Updated] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-21 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feifan Wang updated FLINK-36743: Attachment: image-2024-11-21-20-20-20-536.png > Rescale from unaligend checkpoint failed > ---

[jira] [Commented] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-21 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900025#comment-17900025 ] Feifan Wang commented on FLINK-36743: - Thanks [~arvid]  for helping investigate the

[jira] [Reopened] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-21 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feifan Wang reopened FLINK-36743: - > Rescale from unaligend checkpoint failed > > >

Re: [PR] [FLINK-36739] [WebFrontend] Update the NodeJS to v22.11.0 (LTS) [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25670: URL: https://github.com/apache/flink/pull/25670#issuecomment-2490393427 Reviewed by Chi on 21/11/24. Asked submitter questions @mehdid93 Looks good - but why are the CI tests failing? -- This is an automated message from the Apache Git Service. To r

Re: [PR] [FLINK-36745][docs] Make FixedSizeSplitFetcherManager and FixedFetcherSizeSourceReader examples match Flink 2.0-preview API [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25667: URL: https://github.com/apache/flink/pull/25667#issuecomment-2490395429 Reviewed by Chi on 21/11/24 Need a committer to review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [PR] [FLINK-36745][docs] Make FixedSizeSplitFetcherManager and FixedFetcherSizeSourceReader examples match Flink 2.0-preview API [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25667: URL: https://github.com/apache/flink/pull/25667#issuecomment-2490395974 Reviewed by Chi on 21/11/24 Need a committer to review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [PR] [hotfix] [docs] Update table environment variable name in common.md [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25669: URL: https://github.com/apache/flink/pull/25669#issuecomment-2490393823 Reviewed by Chi on 21/11/24. Asked submitter questions -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [PR] Event latency does not equal window triggering [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25664: URL: https://github.com/apache/flink/pull/25664#issuecomment-2490402911 Reviewed by Chi on 21/11/24 Approve - looking for committer to merge. Notice the tests are failing - but this is a docs change ! -- This is an automated message from the Apache Git Se

Re: [PR] [FLINK-36704] Update TypeInference with StaticArgument and StateTypeStrategy [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25665: URL: https://github.com/apache/flink/pull/25665#issuecomment-2490399670 Reviewed by Chi on 21/11/24 Need a committer / subject area expert to review. Notice that the Tests are failing -- This is an automated message from the Apache Git Service. To respon

Re: [PR] [FLINK-36066][runtime] Introducing the AdaptiveGraphManager component [flink]

2024-11-21 Thread via GitHub
noorall commented on code in PR #25414: URL: https://github.com/apache/flink/pull/25414#discussion_r1851601660 ## flink-runtime/src/main/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGenerator.java: ## @@ -1969,8 +2032,12 @@ private static void setManagedMemoryFrac

Re: [PR] fix:Event latency does not equal window triggering [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25663: URL: https://github.com/apache/flink/pull/25663#issuecomment-2490406949 Reviewed by Chi on 21/11/24 Close if duplicate -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [FLINK-36455] Sinks retry synchronously [1.20] [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25661: URL: https://github.com/apache/flink/pull/25661#issuecomment-2490409340 Reviewed by Chi on 21/11/24. Looks in hand, code conflicts and test failures currently -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [PR] [FLINK-36379] Improve (Global)Committer with UC disabled [1.20] [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25660: URL: https://github.com/apache/flink/pull/25660#issuecomment-2490412290 Reviewed by Chi on 21/11/24. Looks in hand, test failures currently -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[PR] Add release announcement for Flink CDC 3.2.1 [flink-web]

2024-11-21 Thread via GitHub
ruanhang1993 opened a new pull request, #764: URL: https://github.com/apache/flink-web/pull/764 This PR adds release announcement for Flink CDC 3.2.1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Updated] (FLINK-36764) Add checkpoint type to checkpoint trace

2024-11-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36764: --- Labels: pull-request-available (was: ) > Add checkpoint type to checkpoint trace >

Re: [PR] [FLINK-36704] Update TypeInference with StaticArgument and StateTypeStrategy [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25665: URL: https://github.com/apache/flink/pull/25665#issuecomment-2490397302 Reviewed by Chi on 21/11/24 Need a committer/ subject area expert to review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [PR] [FLINK-35825][hive] HiveTableSource supports report statistics for text file [flink]

2024-11-21 Thread via GitHub
reswqa commented on PR #25078: URL: https://github.com/apache/flink/pull/25078#issuecomment-2490379694 Thanks @xuyangzhong for the review, updated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [FLINK-28897] [TABLE-SQL] Fail to use udf in added jar when enabling checkpoint [flink]

2024-11-21 Thread via GitHub
davidradl commented on code in PR #25656: URL: https://github.com/apache/flink/pull/25656#discussion_r1851611252 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/internal/TableEnvironmentImpl.java: ## @@ -1029,6 +1029,8 @@ private TableResultInternal

Re: [PR] [FLINK-28897] [TABLE-SQL] Fail to use udf in added jar when enabling checkpoint [flink]

2024-11-21 Thread via GitHub
davidradl commented on code in PR #25656: URL: https://github.com/apache/flink/pull/25656#discussion_r1851611671 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/internal/TableEnvironmentImpl.java: ## @@ -1069,8 +1072,11 @@ private TableResultInternal

Re: [PR] [FLINK-16077][docs] Translate "Custom State Serialization" page into Chinese [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25648: URL: https://github.com/apache/flink/pull/25648#issuecomment-2490427387 Reviewed by Chi on 21/11/24. Unable to review the translation. Notice the tests are failing. -- This is an automated message from the Apache Git Service. To respond to the messa

[jira] [Created] (FLINK-36764) Add checkpoint type to checkpoint trace

2024-11-21 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-36764: -- Summary: Add checkpoint type to checkpoint trace Key: FLINK-36764 URL: https://issues.apache.org/jira/browse/FLINK-36764 Project: Flink Issue Type: Impro

Re: [PR] [FLINK-28897] [TABLE-SQL] Fail to use udf in added jar when enabling checkpoint [flink]

2024-11-21 Thread via GitHub
davidradl commented on code in PR #25656: URL: https://github.com/apache/flink/pull/25656#discussion_r1851610106 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/internal/TableEnvironmentImpl.java: ## @@ -1029,6 +1029,8 @@ private TableResultInternal

Re: [PR] [FLINK-28897] [TABLE-SQL] Fail to use udf in added jar when enabling checkpoint [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25656: URL: https://github.com/apache/flink/pull/25656#issuecomment-2490421787 Reviewed by Chi on 21/11/24. Asked submitter questions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] Upgrade com.squareup.okio:okio [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25649: URL: https://github.com/apache/flink/pull/25649#issuecomment-2490425525 Reviewed by Chi on 21/11/24. Asked submitter questions Please could you raise a Jira detailing the reason you want to upgrade this component (e.g. is there a particular bug that t

Re: [PR] [FLINK-35966][runtime] Introduce the TASKS for TaskManagerLoadBalanceMode enum [flink]

2024-11-21 Thread via GitHub
davidradl commented on code in PR #25647: URL: https://github.com/apache/flink/pull/25647#discussion_r1851618895 ## flink-core/src/main/java/org/apache/flink/configuration/TaskManagerOptions.java: ## @@ -707,6 +707,12 @@ public class TaskManagerOptions {

[jira] [Assigned] (FLINK-36764) Add checkpoint type to checkpoint trace

2024-11-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-36764: -- Assignee: Piotr Nowojski > Add checkpoint type to checkpoint trace >

Re: [PR] [FLINK-35966][runtime] Introduce the TASKS for TaskManagerLoadBalanceMode enum [flink]

2024-11-21 Thread via GitHub
davidradl commented on code in PR #25647: URL: https://github.com/apache/flink/pull/25647#discussion_r1851620823 ## flink-core/src/main/java/org/apache/flink/configuration/TaskManagerOptions.java: ## @@ -707,6 +707,12 @@ public class TaskManagerOptions {

Re: [PR] [FLINK-36066][runtime] Introducing the AdaptiveGraphManager component [flink]

2024-11-21 Thread via GitHub
zhuzhurk commented on code in PR #25414: URL: https://github.com/apache/flink/pull/25414#discussion_r1851265617 ## flink-runtime/src/main/java/org/apache/flink/streaming/api/graph/AdaptiveGraphManager.java: ## @@ -0,0 +1,697 @@ +/* + * Licensed to the Apache Software Foundation

Re: [PR] [FLINK-34545][cdc-pipeline-connector]Add OceanBase pipeline connector to Flink CDC [flink-cdc]

2024-11-21 Thread via GitHub
yuanoOo commented on PR #3360: URL: https://github.com/apache/flink-cdc/pull/3360#issuecomment-2490158237 @lvyanquan I fixed the above comments, please take a look again. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Assigned] (FLINK-36763) Support schema inference and evolution with single-table-mutliple-partition sources

2024-11-21 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-36763: -- Assignee: yux > Support schema inference and evolution with single-table-mutliple-partition

[jira] [Created] (FLINK-36762) Add E2ECase to run sql client in application mode

2024-11-21 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-36762: - Summary: Add E2ECase to run sql client in application mode Key: FLINK-36762 URL: https://issues.apache.org/jira/browse/FLINK-36762 Project: Flink Issue Typ

Re: [PR] [FLINK-35282][python] Upgrade Apache Beam > 2.54 [flink]

2024-11-21 Thread via GitHub
snuyanzin commented on PR #25541: URL: https://github.com/apache/flink/pull/25541#issuecomment-2490142517 @dianfu , @HuangXingBo could you please have a look here, I think you are more experienced with python in Flink -- This is an automated message from the Apache Git Service. To respond

[jira] [Created] (FLINK-36760) Support to deploy script via sql client

2024-11-21 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-36760: - Summary: Support to deploy script via sql client Key: FLINK-36760 URL: https://issues.apache.org/jira/browse/FLINK-36760 Project: Flink Issue Type: Sub-tas

Re: [PR] [FLINK-35966][runtime] Introduce the TASKS for TaskManagerLoadBalanceMode enum [flink]

2024-11-21 Thread via GitHub
davidradl commented on code in PR #25647: URL: https://github.com/apache/flink/pull/25647#discussion_r1851640826 ## docs/layouts/shortcodes/generated/all_taskmanager_section.html: ## @@ -90,7 +90,7 @@ taskmanager.load-balance.mode NONE Enum

Re: [PR] [FLINK-35966][runtime] Introduce the TASKS for TaskManagerLoadBalanceMode enum [flink]

2024-11-21 Thread via GitHub
davidradl commented on code in PR #25647: URL: https://github.com/apache/flink/pull/25647#discussion_r1851640826 ## docs/layouts/shortcodes/generated/all_taskmanager_section.html: ## @@ -90,7 +90,7 @@ taskmanager.load-balance.mode NONE Enum

Re: [PR] [FLINK-35966][runtime] Introduce the TASKS for TaskManagerLoadBalanceMode enum [flink]

2024-11-21 Thread via GitHub
davidradl commented on code in PR #25647: URL: https://github.com/apache/flink/pull/25647#discussion_r1851640555 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/SlotSharingExecutionSlotAllocatorFactory.java: ## @@ -40,13 +41,16 @@ public SlotSharingExecutionSlo

[jira] [Commented] (FLINK-36688) table.optimizer.reuse-source-enabled may cause disordered metadata columns when reading from Kafka.

2024-11-21 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899969#comment-17899969 ] xuyang commented on FLINK-36688: You're right. There is a bug in ScanReuser. I'll fix it

Re: [PR] [FLINK-35966][runtime] Introduce the TASKS for TaskManagerLoadBalanceMode enum [flink]

2024-11-21 Thread via GitHub
davidradl commented on code in PR #25647: URL: https://github.com/apache/flink/pull/25647#discussion_r1851640826 ## docs/layouts/shortcodes/generated/all_taskmanager_section.html: ## @@ -90,7 +90,7 @@ taskmanager.load-balance.mode NONE Enum

[PR] [FLINK-36764] Add checkpoint type and unaligned flag to the checkpoint trace [flink]

2024-11-21 Thread via GitHub
pnowojski opened a new pull request, #25671: URL: https://github.com/apache/flink/pull/25671 ## What is the purpose of the change Add checkpoint type and unaligned flag to the checkpoint trace ## Verifying this change Expanded unit test. ## Does this pull reque

Re: [PR] [FLINK-36764] Add checkpoint type and unaligned flag to the checkpoint trace [flink]

2024-11-21 Thread via GitHub
flinkbot commented on PR #25671: URL: https://github.com/apache/flink/pull/25671#issuecomment-2490481251 ## CI report: * fe598c5420a55cc01a1e8fc92f6cbb4907ac9d49 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-35966][runtime] Introduce the TASKS for TaskManagerLoadBalanceMode enum [flink]

2024-11-21 Thread via GitHub
davidradl commented on PR #25647: URL: https://github.com/apache/flink/pull/25647#issuecomment-2490489348 Reviewed by Chi on 21/11/24. Asked submitter questions. Mostly to make it clear when to configure this new option, by bringing in appropriate Flip content and reasoning into the docs. I

[jira] [Updated] (FLINK-36685) Enable update/create operation on flinkdeployment resource in mutation webhook

2024-11-21 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-36685: --- Priority: Minor (was: Blocker) > Enable update/create operation on flinkdeployment resource in muta

[PR] [FLINK-36525] Support for AI Model Integration for Data Processing [flink-cdc]

2024-11-21 Thread via GitHub
lvyanquan opened a new pull request, #3753: URL: https://github.com/apache/flink-cdc/pull/3753 The goal is to extend [flink-cdc](https://issues.apache.org/jira/browse/FLINK-cdc) with the capability to invoke AI models during the data stream processing workflow, with a particular focus on s

Re: [PR] [FLINK-36646] Test different versions of the JDK in the Flink image [flink-kubernetes-operator]

2024-11-21 Thread via GitHub
gyfora commented on PR #910: URL: https://github.com/apache/flink-kubernetes-operator/pull/910#issuecomment-2490732713 Closing this as it was merged in another PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] [FLINK-36646] Test different versions of the JDK in the Flink image [flink-kubernetes-operator]

2024-11-21 Thread via GitHub
gyfora closed pull request #910: [FLINK-36646] Test different versions of the JDK in the Flink image URL: https://github.com/apache/flink-kubernetes-operator/pull/910 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[jira] [Comment Edited] (FLINK-36765) How to Handle Multi-Type Maps in Avro Schema with Flink Table API?

2024-11-21 Thread david radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900049#comment-17900049 ] david radley edited comment on FLINK-36765 at 11/21/24 2:07 PM: --

Re: [PR] [FLINK-36769] support fury serializer for pyflink [flink]

2024-11-21 Thread via GitHub
flinkbot commented on PR #25672: URL: https://github.com/apache/flink/pull/25672#issuecomment-2491305074 ## CI report: * c8a1d5309bca19c7d3880fd8b86b1b6b65bd4a07 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-35966][runtime] Introduce the TASKS for TaskManagerLoadBalanceMode enum [flink]

2024-11-21 Thread via GitHub
RocMarshal commented on code in PR #25647: URL: https://github.com/apache/flink/pull/25647#discussion_r1852202449 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/SlotSharingExecutionSlotAllocatorFactory.java: ## @@ -40,13 +41,16 @@ public SlotSharingExecutionSl

[jira] [Updated] (FLINK-36769) Suport fury Serializer for pyflink

2024-11-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36769: --- Labels: pull-request-available (was: ) > Suport fury Serializer for pyflink > -

[jira] [Commented] (FLINK-36765) How to Handle Multi-Type Maps in Avro Schema with Flink Table API?

2024-11-21 Thread Maneendra (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900079#comment-17900079 ] Maneendra commented on FLINK-36765: --- [~davidradl]  The existing schema, which contains

[jira] [Created] (FLINK-36766) Use pyflink to create remote env

2024-11-21 Thread William Que (Jira)
William Que created FLINK-36766: --- Summary: Use pyflink to create remote env Key: FLINK-36766 URL: https://issues.apache.org/jira/browse/FLINK-36766 Project: Flink Issue Type: Bug Comp

[jira] [Created] (FLINK-36767) Bump cyclonedx-maven-plugin from 2.7.9 to 2.9.0

2024-11-21 Thread Siddharth R (Jira)
Siddharth R created FLINK-36767: --- Summary: Bump cyclonedx-maven-plugin from 2.7.9 to 2.9.0 Key: FLINK-36767 URL: https://issues.apache.org/jira/browse/FLINK-36767 Project: Flink Issue Type: Imp

[jira] [Updated] (FLINK-36686) allow customizing env variables for flink-webhook container

2024-11-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36686: --- Labels: pull-request-available (was: ) > allow customizing env variables for flink-webhook

Re: [PR] [FLINK-36764] Add checkpoint type and unaligned flag to the checkpoint trace [flink]

2024-11-21 Thread via GitHub
davidradl commented on code in PR #25671: URL: https://github.com/apache/flink/pull/25671#discussion_r1851895450 ## flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/DefaultCheckpointStatsTrackerTest.java: ## @@ -385,11 +384,10 @@ public void addSpan(SpanBuilder sp

[jira] [Updated] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-21 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feifan Wang updated FLINK-36743: Attachment: image-2024-11-21-20-20-41-644.png > Rescale from unaligend checkpoint failed > ---

Re: [PR] [FLINK-36066][runtime] Introducing the AdaptiveGraphManager component [flink]

2024-11-21 Thread via GitHub
zhuzhurk commented on code in PR #25414: URL: https://github.com/apache/flink/pull/25414#discussion_r1851918943 ## flink-streaming-java/src/test/java/org/apache/flink/streaming/api/graph/AdaptiveGraphManagerTest.java: ## @@ -0,0 +1,354 @@ +/* + * Licensed to the Apache Software

Re: [PR] [FLINK-36764] Add checkpoint type and unaligned flag to the checkpoint trace [flink]

2024-11-21 Thread via GitHub
pnowojski commented on code in PR #25671: URL: https://github.com/apache/flink/pull/25671#discussion_r1851984375 ## flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/DefaultCheckpointStatsTracker.java: ## @@ -256,7 +256,13 @@ private void logCheckpointStatistics(A

[jira] [Created] (FLINK-36768) Empty Checkpoint Directory created when older checkpoint fails due to timeout and the checkpoint interval is same

2024-11-21 Thread Eaugene Thomas (Jira)
Eaugene Thomas created FLINK-36768: -- Summary: Empty Checkpoint Directory created when older checkpoint fails due to timeout and the checkpoint interval is same Key: FLINK-36768 URL: https://issues.apache.org/jir

Re: [PR] [FLINK-31836][table] Upgrade Calcite version to 1.34.0 [flink]

2024-11-21 Thread via GitHub
twalthr commented on code in PR #24256: URL: https://github.com/apache/flink/pull/24256#discussion_r1852228055 ## docs/content.zh/docs/dev/table/sql/queries/deduplication.md: ## @@ -32,13 +32,10 @@ Flink 使用 `ROW_NUMBER()` 去除重复数据,就像 Top-N 查询一样。其 下面的例子展示了去重语句的语法: ```sql -SELEC

Re: [PR] [FLINK-36764] Add checkpoint type and unaligned flag to the checkpoint trace [flink]

2024-11-21 Thread via GitHub
davidradl commented on code in PR #25671: URL: https://github.com/apache/flink/pull/25671#discussion_r1851894006 ## flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/DefaultCheckpointStatsTracker.java: ## @@ -256,7 +256,13 @@ private void logCheckpointStatistics(A

[jira] [Commented] (FLINK-36535) Optimize the scale down logic based on historical parallelism

2024-11-21 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900022#comment-17900022 ] Rui Fan commented on FLINK-36535: - Thanks [~heigebupahei]  for the comment! {quote} I th

[jira] [Updated] (FLINK-36739) Update NodeJS to v22 (LTS)

2024-11-21 Thread Mehdi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehdi updated FLINK-36739: -- Summary: Update NodeJS to v22 (LTS) (was: Update NodeJS to v18.20.5 (LTS)) > Update NodeJS to v22 (LTS) > ---

[jira] [Created] (FLINK-36765) How to Handle Multi-Type Maps in Avro Schema with Flink Table API?

2024-11-21 Thread Maneendra (Jira)
Maneendra created FLINK-36765: - Summary: How to Handle Multi-Type Maps in Avro Schema with Flink Table API? Key: FLINK-36765 URL: https://issues.apache.org/jira/browse/FLINK-36765 Project: Flink

[jira] (FLINK-36535) Optimize the scale down logic based on historical parallelism

2024-11-21 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36535 ] Rui Fan deleted comment on FLINK-36535: - was (Author: fanrui): Thanks [~heigebupahei] for the comment! {quote}that we need to treat job.autoscaler.scale-down.interval as a window. The default is

[jira] [Updated] (FLINK-36769) Suport fury Serializer for pyflink

2024-11-21 Thread xingyuan cheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xingyuan cheng updated FLINK-36769: --- Description: Hi, community. Currently, in the batch verification scenario of our algorithm

Re: [PR] [FLINK-36690][runtime] Fix schema operator hanging under extreme parallelized pressure [flink-cdc]

2024-11-21 Thread via GitHub
yuxiqian commented on PR #3680: URL: https://github.com/apache/flink-cdc/pull/3680#issuecomment-2490188267 @leonardBang Will this PR be reviewed soon? I'm planning to implement FLINK-36763 based on this. -- This is an automated message from the Apache Git Service. To respond to the messag

[jira] [Commented] (FLINK-36765) How to Handle Multi-Type Maps in Avro Schema with Flink Table API?

2024-11-21 Thread david radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900049#comment-17900049 ] david radley commented on FLINK-36765: -- I was trying to find where the Avro specifi

[jira] [Created] (FLINK-36769) Suport fury Serializer for pyflink

2024-11-21 Thread xingyuan cheng (Jira)
xingyuan cheng created FLINK-36769: -- Summary: Suport fury Serializer for pyflink Key: FLINK-36769 URL: https://issues.apache.org/jira/browse/FLINK-36769 Project: Flink Issue Type: New Featur

[jira] [Updated] (FLINK-36769) Suport fury Serializer for pyflink

2024-11-21 Thread xingyuan cheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xingyuan cheng updated FLINK-36769: --- External issue URL: https://github.com/apache/flink/pull/25672 > Suport fury Serializer for

[PR] [ISSUE#36769] support fury serializer for pyflink [flink]

2024-11-21 Thread via GitHub
kaori-seasons opened a new pull request, #25672: URL: https://github.com/apache/flink/pull/25672 ## What is the purpose of the change Hi, community. Currently, in the batch verification scenario of our algorithm data, we use pyflink and encounter low transmission efficiency caused by

[jira] [Updated] (FLINK-36769) Suport fury Serializer for pyflink

2024-11-21 Thread xingyuan cheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xingyuan cheng updated FLINK-36769: --- Docs Text: https://github.com/apache/flink/pull/25672 External issue URL: (was

[jira] [Closed] (FLINK-36686) allow customizing env variables for flink-webhook container

2024-11-21 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-36686. -- Fix Version/s: kubernetes-operator-1.11.0 Resolution: Fixed merged to main 14ded7e8b9f8aa12f54a

[jira] [Updated] (FLINK-36686) allow customizing env variables for flink-webhook container

2024-11-21 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-36686: --- Priority: Minor (was: Blocker) > allow customizing env variables for flink-webhook container >

[jira] [Closed] (FLINK-36685) Enable update/create operation on flinkdeployment resource in mutation webhook

2024-11-21 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-36685. -- Fix Version/s: kubernetes-operator-1.11.0 Resolution: Fixed merged to main 5d29554a179632028ccd

[PR] [FLINK-36469] Bump commons-io from 2.11.0 to 2.17.0 [flink-kubernetes-operator]

2024-11-21 Thread via GitHub
r-sidd opened a new pull request, #917: URL: https://github.com/apache/flink-kubernetes-operator/pull/917 ## What is the purpose of the change Bump commons-io from 2.11.0 to 2.17.0 ## Brief change log Bump cyclonedx-maven-plugin from 2.7.9 to 2.9.0 to remediate the findin

[jira] [Commented] (FLINK-36770) Support Request Timeout for AWS sinks

2024-11-21 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900114#comment-17900114 ] Ahmed Hamdy commented on FLINK-36770: - [~hlteoh37] I would love your feedback here,

[jira] [Created] (FLINK-36770) Support Request Timeout for AWS sinks

2024-11-21 Thread Ahmed Hamdy (Jira)
Ahmed Hamdy created FLINK-36770: --- Summary: Support Request Timeout for AWS sinks Key: FLINK-36770 URL: https://issues.apache.org/jira/browse/FLINK-36770 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-36770) Support Request Timeout for AWS sinks

2024-11-21 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hamdy updated FLINK-36770: Description: h2. Description in [FLIP-451|https://cwiki.apache.org/confluence/display/FLINK/FLIP

[jira] [Updated] (FLINK-36770) Support Request Timeout for AWS sinks

2024-11-21 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hamdy updated FLINK-36770: Description: h2. Description in [FLIP-451|https://cwiki.apache.org/confluence/display/FLINK/FLIP

[PR] [FLINK-36529] Allow flink version configs to be set to greater than given version [flink-kubernetes-operator]

2024-11-21 Thread via GitHub
tomncooper opened a new pull request, #918: URL: https://github.com/apache/flink-kubernetes-operator/pull/918 ## What is the purpose of the change The operator currently allows the following syntax for defining flink version specific defaults: `kubernetes.operator.default-confi

Re: [PR] [FLINK-36529] Allow flink version configs to be set to greater than given version [flink-kubernetes-operator]

2024-11-21 Thread via GitHub
tomncooper commented on PR #918: URL: https://github.com/apache/flink-kubernetes-operator/pull/918#issuecomment-2491802004 I probably need to look at adding an end to end test for this but want to make sure I am on the right track before doing that. -- This is an automated message from

Re: [PR] [FLINK-36529] Allow flink version configs to be set to greater than given version [flink-kubernetes-operator]

2024-11-21 Thread via GitHub
tomncooper commented on PR #918: URL: https://github.com/apache/flink-kubernetes-operator/pull/918#issuecomment-2491803380 CC @gyfora -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[jira] [Updated] (FLINK-36529) Support greater or equals logic for operator flink version default configs

2024-11-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36529: --- Labels: pull-request-available (was: ) > Support greater or equals logic for operator flink

[PR] [hotfix] [docs]Fix miss semicolon on SELECT & WHERE clause example sql [flink]

2024-11-21 Thread via GitHub
camilesing opened a new pull request, #25673: URL: https://github.com/apache/flink/pull/25673 ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring them

Re: [PR] [hotfix] [docs]Fix miss semicolon on SELECT & WHERE clause example sql [flink]

2024-11-21 Thread via GitHub
flinkbot commented on PR #25673: URL: https://github.com/apache/flink/pull/25673#issuecomment-2492789712 ## CI report: * 4740ab5775e6045fbc62736e2a60f75ea4463812 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Comment Edited] (FLINK-35859) [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called

2024-11-21 Thread Xin Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900028#comment-17900028 ] Xin Gong edited comment on FLINK-35859 at 11/22/24 3:19 AM:

[jira] [Commented] (FLINK-36768) Empty Checkpoint Directory created when older checkpoint fails due to timeout and the checkpoint interval is same

2024-11-21 Thread Rui Xia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900228#comment-17900228 ] Rui Xia commented on FLINK-36768: - Hi Thomas, thank you for reporting this. From your de

[jira] [Assigned] (FLINK-36773) Introduce new Group Agg Operator with Async State API

2024-11-21 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee reassigned FLINK-36773: --- Assignee: Yang Xu > Introduce new Group Agg Operator with Async State API > ---

Re: [PR] [FLINK-36772][mysql][cdc-base] Fix error placeholder for errorMessageTemplate of Preconditions [flink-cdc]

2024-11-21 Thread via GitHub
gong commented on PR #3754: URL: https://github.com/apache/flink-cdc/pull/3754#issuecomment-2492953554 > LGTM, could you also check all Preconditions.checkState method call? @leonardBang I checked all Preconditions.checkState method call. -- This is an automated message from the Apa

[jira] [Assigned] (FLINK-36773) Introduce new Group Agg Operator with Async State API

2024-11-21 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee reassigned FLINK-36773: --- Assignee: xuyang (was: Yang Xu) > Introduce new Group Agg Operator with Async State API >

[jira] [Created] (FLINK-36774) SQL gateway should support executing multiple SQL statements once

2024-11-21 Thread tim yu (Jira)
tim yu created FLINK-36774: -- Summary: SQL gateway should support executing multiple SQL statements once Key: FLINK-36774 URL: https://issues.apache.org/jira/browse/FLINK-36774 Project: Flink Issue

[PR] Add blogpost for new KinesisStreamsSource and DynamoDbStreamsSource [flink-web]

2024-11-21 Thread via GitHub
hlteoh37 opened a new pull request, #765: URL: https://github.com/apache/flink-web/pull/765 Add a blogpost to illustrated in detail the KDS and DDB streams source Image of blogpost included: ![KDS_DB_blog](https://github.com/user-attachments/assets/8f9778cd-8ae8-4119-9623-d80a95b1

[jira] [Commented] (FLINK-36535) Optimize the scale down logic based on historical parallelism

2024-11-21 Thread yuanfenghu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900226#comment-17900226 ] yuanfenghu commented on FLINK-36535: nice improvement!  > Optimize the scale down l

Re: [PR] [FLINK-36315][cdc-base]The flink-cdc-base module supports source metric statistics [flink-cdc]

2024-11-21 Thread via GitHub
liuxiao2shf commented on code in PR #3619: URL: https://github.com/apache/flink-cdc/pull/3619#discussion_r1853230011 ## flink-cdc-connect/flink-cdc-source-connectors/flink-cdc-base/src/main/java/org/apache/flink/cdc/connectors/base/source/assigner/SnapshotSplitAssigner.java: ##

  1   2   >