[jira] [Created] (FLINK-35926) During rescale, jobmanager has incorrect judgment logic for the max parallelism.

2024-07-30 Thread yuanfenghu (Jira)
yuanfenghu created FLINK-35926: -- Summary: During rescale, jobmanager has incorrect judgment logic for the max parallelism. Key: FLINK-35926 URL: https://issues.apache.org/jira/browse/FLINK-35926 Project:

Re: [DISCUSS] FLIP-XXX: Aligning timeout logic in the AdaptiveScheduler's WaitingForResources and Executing states

2024-07-30 Thread Zdenek Tison
Hi all, Based on the discussion, I added a new configuration: *jobmanager.adaptive-scheduler.executing.resource-stabilization-timeout*. We considered the following options for the default value: 1. Use a separate default value, e.g., 60s. 2. Fallback to *jobmanager.adaptive-scheduler.res

Re: [DISCUSS] FLIP-XXX: Aligning timeout logic in the AdaptiveScheduler's WaitingForResources and Executing states

2024-07-30 Thread Zdenek Tison
Hi, If there are no further comments, I would propose starting a vote on these changes. But first, I would like to ask a committer to migrate the draft to an FLIP in the Flink Wiki. Thanks a lot. Kind Regards, Zdenek On Tue, Jul 30, 2024 at 10:36 AM Zdenek Tison wrote: > Hi all, > > Based on

[jira] [Created] (FLINK-35927) Support closing ForSt meta file when using object storage

2024-07-30 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-35927: Summary: Support closing ForSt meta file when using object storage Key: FLINK-35927 URL: https://issues.apache.org/jira/browse/FLINK-35927 Project: Flink Iss

[jira] [Created] (FLINK-35928) ForSt supports compiling with RocksDB

2024-07-30 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-35928: Summary: ForSt supports compiling with RocksDB Key: FLINK-35928 URL: https://issues.apache.org/jira/browse/FLINK-35928 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-30 Thread Zhu Zhu
Thanks for sharing the thoughts, David! IIUC, there are two goals to make the APIs used for RPCs as versionless as possible? 1. no version mismatch happens if no code changes 2. supports different versioned Flink clients and clusters The first goal can be achieved by explicitly assigning a serialV

[jira] [Created] (FLINK-35929) In flink insert mode, it supports modifying the parallelism of jdbc sink when the parallelism of source and sink is the same.

2024-07-30 Thread Qiu (Jira)
Qiu created FLINK-35929: --- Summary: In flink insert mode, it supports modifying the parallelism of jdbc sink when the parallelism of source and sink is the same. Key: FLINK-35929 URL: https://issues.apache.org/jira/browse/FL

[jira] [Created] (FLINK-35930) Add FORMAT_STRING function

2024-07-30 Thread Dylan He (Jira)
Dylan He created FLINK-35930: Summary: Add FORMAT_STRING function Key: FLINK-35930 URL: https://issues.apache.org/jira/browse/FLINK-35930 Project: Flink Issue Type: Sub-task Components:

[jira] [Created] (FLINK-35931) Add REGEXP_EXTRACT_ALL function

2024-07-30 Thread Dylan He (Jira)
Dylan He created FLINK-35931: Summary: Add REGEXP_EXTRACT_ALL function Key: FLINK-35931 URL: https://issues.apache.org/jira/browse/FLINK-35931 Project: Flink Issue Type: Sub-task Compon

[jira] [Created] (FLINK-35932) Add REGEXP_COUNT function

2024-07-30 Thread Dylan He (Jira)
Dylan He created FLINK-35932: Summary: Add REGEXP_COUNT function Key: FLINK-35932 URL: https://issues.apache.org/jira/browse/FLINK-35932 Project: Flink Issue Type: Sub-task Components:

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-30 Thread David Morávek
Here is a summary of my current understanding, please correct me if it's wrong. We currently have an API for submitting a list of transformations and configurations called CompiledPlan. However, it is currently specific to the SQL domain. In reviewing the follow-up FLIPs, it is evident that we ar

Re: [DISCUSS] FLIP-470: Support Adaptive Broadcast Join

2024-07-30 Thread Lincoln Lee
Thanks Xia for your explanation! I can understand your concern, but considering the design of this FLIP, which already covers compile-time inaccurate optimization for runtime de-optimization, is it necessary to make the user manually turn off 'table.optimizer.join.broadcast-threshold' and set the

Re: [DISCUSS] FLIP-471: Fixing watermark idleness timeout accounting

2024-07-30 Thread Piotr Nowojski
Thanks Zakelly. I will stick with the current proposal (given 2:1 in favour of having a separate `RelativeClock`). I will open a voting thread soon. Best, Piotrek wt., 30 lip 2024 o 06:04 Zakelly Lan napisał(a): > Hi Piotr, > > I'd prefer to change the semantics of the existing `Clock`, as for

[VOTE] FLIP-471: Fixing watermark idleness timeout accounting

2024-07-30 Thread Piotr Nowojski
Hi all! I would like to open the vote for FLIP-471 [1]. It has been discussed here [2]. The vote will remain open for at least 72 hours. Best, Piotrek [1] https://cwiki.apache.org/confluence/x/oQvOEg [2] https://lists.apache.org/thread/byj1l2236rfx3mcl3v4374rcbkq4rf85

[jira] [Created] (FLINK-35933) Skip distributing maxAllowedWatermark if there are no subtasks

2024-07-30 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-35933: - Summary: Skip distributing maxAllowedWatermark if there are no subtasks Key: FLINK-35933 URL: https://issues.apache.org/jira/browse/FLINK-35933 Project: Fli

[jira] [Created] (FLINK-35934) Add CompiledPlan annotations to BatchExecValues

2024-07-30 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35934: -- Summary: Add CompiledPlan annotations to BatchExecValues Key: FLINK-35934 URL: https://issues.apache.org/jira/browse/FLINK-35934 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-35935) CREATE TABLE AS doesn't work with LIMIT

2024-07-30 Thread Xingcan Cui (Jira)
Xingcan Cui created FLINK-35935: --- Summary: CREATE TABLE AS doesn't work with LIMIT Key: FLINK-35935 URL: https://issues.apache.org/jira/browse/FLINK-35935 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-35936) paimon cdc schema evolution failure when restart job

2024-07-30 Thread MOBIN (Jira)
MOBIN created FLINK-35936: - Summary: paimon cdc schema evolution failure when restart job Key: FLINK-35936 URL: https://issues.apache.org/jira/browse/FLINK-35936 Project: Flink Issue Type: Bug

Re: [VOTE] FLIP-471: Fixing watermark idleness timeout accounting

2024-07-30 Thread Zakelly Lan
+1 (binding) Best, Zakelly On Wed, Jul 31, 2024 at 12:07 AM Piotr Nowojski wrote: > Hi all! > > I would like to open the vote for FLIP-471 [1]. It has been discussed here > [2]. > > The vote will remain open for at least 72 hours. > > Best, > Piotrek > > [1] https://cwiki.apache.org/confluence