Re: [DISCUSS] FLIP-523 - Handle TLS Certificate Renewal

2025-05-20 Thread Gabor Somogyi
Hi Nicolas, Related SSLContext I've not gone through all the cases where we need to reload so instead I'm sharing the concept. The main intention is that we must control all execution paths which decide which certificate used for authentication. Creating an SSLContext decorator which checks reload

Re: Issue with Duplicate transactionalIdPrefix in Flink 2.0 Kafka Sinks

2025-05-20 Thread Arvid Heise
I created https://issues.apache.org/jira/browse/FLINK-37818 and provided a fix. I will Look for a reviewer to get it in asap. Best Arvid On Tue, May 20, 2025, 10:46 Teunissen, F.G.J. (Fred) wrote: > Hi Arvid, > > Our application picks up a bunch of DDL/DML SQL statements defined by > end-users

Re: Re: Re: Re: [DISCUSS] FLIP-486: Introduce a new DeltaJoin

2025-05-20 Thread Gustavo de Morais
Hey Xuyang, Thanks for proposing this and driving the discussion. In general, a very interesting idea. - Can you go a bit in detail on how the optimizer will work in AUTO/FORCE modes? When are we returning an error or falling back to the regular streaming join operator? Do we support, for example

Re: Issue with Duplicate transactionalIdPrefix in Flink 2.0 Kafka Sinks

2025-05-20 Thread Teunissen, F.G.J. (Fred)
I cherry-picked your commits on top of the main branch and build a local version. I can confirm that this issue is solved with this fix. From: Arvid Heise Date: Tuesday, 20 May 2025 at 11:17 To: Teunissen, F.G.J. (Fred) Cc: dev@flink.apache.org Subject: Re: Issue with Duplicate transactionalI

Re: [DISCUSS] FLIP-530: Dynamic job configuration

2025-05-20 Thread Gustavo de Morais
Hi Roman, This is a great and important improvement. +1 for the FLIP and to start voting. Best, Gustavo On Mon, 19 May 2025 at 20:28, Roman Khachatryan wrote: > Thanks everyone for the discussion! > > I'm going to start a voting thread soon unless there are other suggestions > or objections. >

Re: [jira] [Created] (FLINK-37222) Table planner exception when sql client submit job

2025-05-20 Thread Sebastien Pereira
Hi, Would it be possible to have the Fix Version/s of the Jira issue FLINK-37222 [1] updated to reflect the fix has been backported to into release-1.20? This issue is closed as fixed in version 2.1.0 only, so it is not reflected in changes expected. In the next maintenance release 1.20.2 [2]

[jira] [Created] (FLINK-37820) AsyncScalarFunction UDFs cannot be loaded via CompiledPlan

2025-05-20 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-37820: Summary: AsyncScalarFunction UDFs cannot be loaded via CompiledPlan Key: FLINK-37820 URL: https://issues.apache.org/jira/browse/FLINK-37820 Project: Flink Is

Re: [VOTE] FLIP-530: Dynamic job configuration

2025-05-20 Thread Junrui Lee
+1 (binding) Best, Junrui Hao Li 于2025年5月21日周三 03:42写道: > +1 (non-binding) > > Thanks, > Hao > > On Tue, May 20, 2025 at 12:39 PM Piotr Nowojski > wrote: > > > Hi, > > > > +1 (binding) > > > > Best, Piotrek > > > > wt., 20 maj 2025 o 20:29 Roman Khachatryan > napisał(a): > > > > > Hi everyone

Re: [DISCUSS] FLIP-530: Dynamic job configuration

2025-05-20 Thread Hangxiang Yu
Thanks everyone for sharing thoughts. Sorry for the late reply. I'm also +1 for the limited white list from the start. Also Thanks Rui for sharing extra information. On Tue, May 20, 2025 at 8:59 PM Gustavo de Morais wrote: > Hi Roman, > > This is a great and important improvement. +1 for the FLI

Re: [VOTE] FLIP-530: Dynamic job configuration

2025-05-20 Thread Hangxiang Yu
+1 (binding) On Wed, May 21, 2025 at 10:25 AM Junrui Lee wrote: > +1 (binding) > > Best, > Junrui > > Hao Li 于2025年5月21日周三 03:42写道: > > > +1 (non-binding) > > > > Thanks, > > Hao > > > > On Tue, May 20, 2025 at 12:39 PM Piotr Nowojski > > wrote: > > > > > Hi, > > > > > > +1 (binding) > > > > >

Re: [VOTE] FLIP-530: Dynamic job configuration

2025-05-20 Thread Feifan Wang
+1 (non-binding) —— Best regards, Feifan Wang Replied Message | From | Hao Li | | Date | 05/21/2025 03:42 | | To | | | Subject | Re: [VOTE] FLIP-530: Dynamic job configuration | +1 (non-binding) Thanks, Hao On Tue, May 20, 2025 at 12:39 PM Piotr Nowojski wrote: H

[DISCUSS] FLIP-531: Initiate Flink Agents as a new Sub-Project

2025-05-20 Thread Xintong Song
Hi devs, Sean, Chris and I would like to start a discussion on FLIP-531 [1], about introducing a new sub-project, Flink Agents. With the rise of agentic AI, we have identified great new opportunities for Flink, particularly in the system-triggered agent scenarios. We believe the future of AI agen

[jira] [Created] (FLINK-37822) OpenTelemetryMetricReporterITCase.testReport test failed of azure ci

2025-05-20 Thread dalongliu (Jira)
dalongliu created FLINK-37822: - Summary: OpenTelemetryMetricReporterITCase.testReport test failed of azure ci Key: FLINK-37822 URL: https://issues.apache.org/jira/browse/FLINK-37822 Project: Flink

Re: [DISCUSS] FLIP-531: Initiate Flink Agents as a new Sub-Project

2025-05-20 Thread Jingsong Li
Thanks Xintong, Sean, and Chris for starting this discussion. +1 to initial Flink Agents sub project. Look forward to its first release! Best, Jingsong On Wed, May 21, 2025 at 11:21 AM Xintong Song wrote: > > Hi devs, > > Sean, Chris and I would like to start a discussion on FLIP-531 [1], abou

[jira] [Created] (FLINK-37818) Kafka connector requires unqiue TransactionalIdPrefix even for non-EOS settings.

2025-05-20 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-37818: --- Summary: Kafka connector requires unqiue TransactionalIdPrefix even for non-EOS settings. Key: FLINK-37818 URL: https://issues.apache.org/jira/browse/FLINK-37818 Projec

Re: [VOTE] FLIP-486: Introduce a new DeltaJoin

2025-05-20 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee 曹振 <15533273...@163.com> 于2025年5月20日周二 14:55写道: > +1(non-binding) > > > > > > > Best, > CaoZhen > Replied Message > | From | weijie guo | > | Date | 5/20/2025 13:42 | > | To | | > | Subject | Re: [VOTE] FLIP-486: Introduce a new DeltaJoin | > +1(bindin

Re: Issue with Duplicate transactionalIdPrefix in Flink 2.0 Kafka Sinks

2025-05-20 Thread Teunissen, F.G.J. (Fred)
Hi Arvid, Our application picks up a bunch of DDL/DML SQL statements defined by end-users and uses the Table-Api to create a Flink Job.​​ So setting unique prefixes per sink is a bit tricky or we should tell all end-users to create unique output table DDL statements (I would rather avoid that).

Flink Pulsar connector new releases in maven

2025-05-20 Thread Fabrizzio Chávez Tejada
Hello, I can see that 7 months ago an important fix was merged into master: https://github.com/apache/flink-connector-pulsar/pull/95 But there is no new connector version deployed in maven, Why is the project stopped and when can we include this fix in a new connector version release? The last v

Re: [DISCUSS] FLIP-523 - Handle TLS Certificate Renewal

2025-05-20 Thread Nicolas Fraison
Hi, Overall your proposal looks great. The event handling must indeed be super fast and we must also not change original code path if reload not needed I have some concerns around the ReloadableSSLContext implementing all SSLContext Do you really mean SSLContext (java SSLContext one) or do you re

Re: [DISCUSS] FLIP-523 - Handle TLS Certificate Renewal

2025-05-20 Thread Nicolas Fraison
Hi Gabor, Thanks for the feedback. The overall proposal with atomic dirty flag being set by the callback will indeed work with any kind of implementation. Will see to update the FLIP in a week or 2 if there are no other comments on it Nicolas On Tue, May 20, 2025 at 11:08 AM Gabor Somogyi wr

Re: Issue with Duplicate transactionalIdPrefix in Flink 2.0 Kafka Sinks

2025-05-20 Thread Arvid Heise
Hi Fred, ah yes, I think I understand the issue. The KafkaSink always creates a KafkaCommitter even if you are not using EXACTLY_ONCE. It's an unfortunate limitation of our Sink design. When I implemented the change, I was assuming that you are running EOS if there is a committer (because else its

Re: [VOTE] FLIP-530: Dynamic job configuration

2025-05-20 Thread Piotr Nowojski
Hi, +1 (binding) Best, Piotrek wt., 20 maj 2025 o 20:29 Roman Khachatryan napisał(a): > Hi everyone, > > I'd like to start a vote on FLIP-530: Dynamic job configuration > [1] which has been discussed in this thread [2]. > > The vote will be open for at least 72 hours unless there is an objecti

Re: [VOTE] FLIP-530: Dynamic job configuration

2025-05-20 Thread Hao Li
+1 (non-binding) Thanks, Hao On Tue, May 20, 2025 at 12:39 PM Piotr Nowojski wrote: > Hi, > > +1 (binding) > > Best, Piotrek > > wt., 20 maj 2025 o 20:29 Roman Khachatryan napisał(a): > > > Hi everyone, > > > > I'd like to start a vote on FLIP-530: Dynamic job configuration > > [1] which has b

[jira] [Created] (FLINK-37819) Add column expansion test for model TVF

2025-05-20 Thread Hao Li (Jira)
Hao Li created FLINK-37819: -- Summary: Add column expansion test for model TVF Key: FLINK-37819 URL: https://issues.apache.org/jira/browse/FLINK-37819 Project: Flink Issue Type: Sub-task

[VOTE] FLIP-530: Dynamic job configuration

2025-05-20 Thread Roman Khachatryan
Hi everyone, I'd like to start a vote on FLIP-530: Dynamic job configuration [1] which has been discussed in this thread [2]. The vote will be open for at least 72 hours unless there is an objection or not enough votes. [1] https://cwiki.apache.org/confluence/x/uglKFQ [2] https://lists.apache.o

[jira] [Created] (FLINK-37821) JobMasterTriggerSavepointITCase.testDoNotCancelJobIfSavepointFails test failed of azure ci

2025-05-20 Thread dalongliu (Jira)
dalongliu created FLINK-37821: - Summary: JobMasterTriggerSavepointITCase.testDoNotCancelJobIfSavepointFails test failed of azure ci Key: FLINK-37821 URL: https://issues.apache.org/jira/browse/FLINK-37821

[SUMMARY] Flink 2.1 Release Sync 05/21/2025

2025-05-20 Thread Ron Liu
Hi, devs, This is the third meeting for Flink 2.1 release cycle. I'd like to share the information synced in the meeting. - Feature Freeze It is worth noting that there are only 4 weeks left until the feature freeze time(June 21, 2025), and developers need to pay attention to the feature free

Re: [VOTE] FLIP-530: Dynamic job configuration

2025-05-20 Thread Rui Fan
+1 (binding) Best, Rui On Wed, May 21, 2025 at 5:03 AM Feifan Wang wrote: > +1 (non-binding) > > > > > —— > > Best regards, > > Feifan Wang > > > > Replied Message > | From | Hao Li | > | Date | 05/21/2025 03:42 | > | To | | > | Subject | Re: [VOTE] FLIP-530: Dynamic job