Re: Re: Re: Re: [DISCUSS] Early Fire Support for Flink SQL Interval Join

2025-02-28 Thread Becket Qin
Thanks for updating the FLIP, Weiqing. Another question, what is the granularity of the early fire hint? Will the hint be applied to all the outer joins in the same block? What if in the query block there are also aggregations? For example: SELECT window_start, window_end, buyer, count(*) /*+ EAR

Re: Re: FLIP-510: Drop ChangelogNormalize for operations which don't need it

2025-02-28 Thread Dawid Wysakowicz
Hey Xuyang, Ad. 1 Yes, you're right, but we already do that for determining if we need UPDATE_BEFORE or not. FlinkChangelogModeInferenceProgram already deals with that. Ad. 2 Unfortunately it is. This is also the only reason I need a FLIP. We can determine internally for every internal operator if

Minutes of the 2025/02/27 CHI Eastern time zone workgroup meeting

2025-02-28 Thread David Radley
Hi, Here are the minutes of the 13th 30 minute working meeting of the Community Health Initiative (CHI) for Eastern time zone. * 16 PRs came in this week - David Radley

[DISCUSS] FLIP-511: Support transaction id pooling in Kafka connector

2025-02-28 Thread Arvid Heise
Dear Flink devs, I'd like to start discussion around an improvement of the exactly-once Kafka sink. Because of its current design, the sink currently puts a large strain on the main memory of the Kafka broker [1], which hinders adoption of the KafkaSink. Since the KafkaSink will be the only way to

[jira] [Created] (FLINK-37405) Perform upstream YAML config validation for Flink 2.x

2025-02-28 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-37405: -- Summary: Perform upstream YAML config validation for Flink 2.x Key: FLINK-37405 URL: https://issues.apache.org/jira/browse/FLINK-37405 Project: Flink Issue Type:

[jira] [Created] (FLINK-37406) Add support for structured YAML config in FlinkDeployment CRD

2025-02-28 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-37406: -- Summary: Add support for structured YAML config in FlinkDeployment CRD Key: FLINK-37406 URL: https://issues.apache.org/jira/browse/FLINK-37406 Project: Flink Is

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.11.0, release candidate #1

2025-02-28 Thread Maximilian Michels
+1 (binding) 1. Verified the archives, checksums, and signatures 2. Extracted and inspected the source code for binaries 3. Compiled and tested the source code via mvn verify 4. Verified license files / headers -Max On Fri, Feb 28, 2025 at 8:57 AM Rui Fan <1996fan...@gmail.com> wrote: > > +1(bin

Re: Dynamic Iceberg Sink

2025-02-28 Thread Maximilian Michels
Good news. There is now a pull request available: https://github.com/apache/iceberg/pull/12424 -Max On Thu, Jan 2, 2025 at 4:46 AM Anil Dasari wrote: > > Hello Max, Peter, Happy new year. > Could you share the repository, even if it's not fully complete, so I can > extend it further for my POC

[jira] [Created] (FLINK-37407) Add meta information to SQL state connector

2025-02-28 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-37407: - Summary: Add meta information to SQL state connector Key: FLINK-37407 URL: https://issues.apache.org/jira/browse/FLINK-37407 Project: Flink Issue Type: Imp