Re: Subject: [VOTE] Release flink-connector-kafka v3.4.0, release candidate #1

2024-11-14 Thread Yanquan Lv
Thanks Arvid for driving it. +1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK11 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog and LGTM > 2024年11月15日 04:01,Arvid Heis

RE: Flink technical debt.

2024-11-14 Thread David Radley
Hi all, We had good attendance for the kick off meeting for the Community Health Initiative technical debt workgroup. We talked of our goals being: * High level, remove the need for the workgroup and run as BAU * Improve new contributor experience by getting prompt responses to issues an

Re: Kafka connector releases

2024-11-14 Thread Arvid Heise
Hi all, I just sent out the first release candidate for 3.4.0. The only difference to 3.3.0 is that we cease to support 1.19 in favor of supporting the open lineage interfaces [1] that have been added to Flink 1.20. With that release under way (please verify and vote!), the main branch is now goo

Subject: [VOTE] Release flink-connector-kafka v3.4.0, release candidate #1

2024-11-14 Thread Arvid Heise
Hi everyone, Please review and vote on release candidate #1 for flink-connector-kafka v3.4.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release

[jira] [Created] (FLINK-36732) Add CompiledPlan annotations to BatchExecPythonOverAggregate

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36732: -- Summary: Add CompiledPlan annotations to BatchExecPythonOverAggregate Key: FLINK-36732 URL: https://issues.apache.org/jira/browse/FLINK-36732 Project: Flink Iss

[jira] [Created] (FLINK-36731) Add CompiledPlan annotations to BatchExecPythonGroupWindowAggregate

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36731: -- Summary: Add CompiledPlan annotations to BatchExecPythonGroupWindowAggregate Key: FLINK-36731 URL: https://issues.apache.org/jira/browse/FLINK-36731 Project: Flink

[jira] [Created] (FLINK-36729) Add CompiledPlan annotations to BatchExecPythonCorrelate

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36729: -- Summary: Add CompiledPlan annotations to BatchExecPythonCorrelate Key: FLINK-36729 URL: https://issues.apache.org/jira/browse/FLINK-36729 Project: Flink Issue Ty

[jira] [Created] (FLINK-36730) Add CompiledPlan annotations to BatchExecPythonGroupAggregate

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36730: -- Summary: Add CompiledPlan annotations to BatchExecPythonGroupAggregate Key: FLINK-36730 URL: https://issues.apache.org/jira/browse/FLINK-36730 Project: Flink Is

[jira] [Created] (FLINK-36728) Add CompiledPlan annotations to BatchExecPythonCalc

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36728: -- Summary: Add CompiledPlan annotations to BatchExecPythonCalc Key: FLINK-36728 URL: https://issues.apache.org/jira/browse/FLINK-36728 Project: Flink Issue Type: S

[jira] [Created] (FLINK-36725) Add CompiledPlan annotations to BatchExecRuntimeFilter exec nodes

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36725: -- Summary: Add CompiledPlan annotations to BatchExecRuntimeFilter exec nodes Key: FLINK-36725 URL: https://issues.apache.org/jira/browse/FLINK-36725 Project: Flink

[jira] [Created] (FLINK-36727) Add a completeness test to cover BatchExecNodes

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36727: -- Summary: Add a completeness test to cover BatchExecNodes Key: FLINK-36727 URL: https://issues.apache.org/jira/browse/FLINK-36727 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-36726) Add CompiledPlan annotations to BatchExecInputAdapter

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36726: -- Summary: Add CompiledPlan annotations to BatchExecInputAdapter Key: FLINK-36726 URL: https://issues.apache.org/jira/browse/FLINK-36726 Project: Flink Issue Type:

[jira] [Created] (FLINK-36724) Add CompiledPlan annotations to BatchExecExecutionOrderEnforcer

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36724: -- Summary: Add CompiledPlan annotations to BatchExecExecutionOrderEnforcer Key: FLINK-36724 URL: https://issues.apache.org/jira/browse/FLINK-36724 Project: Flink

[jira] [Created] (FLINK-36723) Add CompiledPlan annotations to BatchExecDynamicFilteringDataCollector

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36723: -- Summary: Add CompiledPlan annotations to BatchExecDynamicFilteringDataCollector Key: FLINK-36723 URL: https://issues.apache.org/jira/browse/FLINK-36723 Project: Flink

[jira] [Created] (FLINK-36722) Add CompiledPlan annotations to BatchExecSortWindowAggregate

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36722: -- Summary: Add CompiledPlan annotations to BatchExecSortWindowAggregate Key: FLINK-36722 URL: https://issues.apache.org/jira/browse/FLINK-36722 Project: Flink Iss

[jira] [Created] (FLINK-36721) Add CompiledPlan annotations to BatchExecHashWindowAggregate

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36721: -- Summary: Add CompiledPlan annotations to BatchExecHashWindowAggregate Key: FLINK-36721 URL: https://issues.apache.org/jira/browse/FLINK-36721 Project: Flink Iss

[jira] [Created] (FLINK-36720) Add CompiledPlan annotations to BatchExecWindowTableFunction

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36720: -- Summary: Add CompiledPlan annotations to BatchExecWindowTableFunction Key: FLINK-36720 URL: https://issues.apache.org/jira/browse/FLINK-36720 Project: Flink Iss

[jira] [Created] (FLINK-36719) Add CompiledPlan annotations to BatchExecMultipleInput

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36719: -- Summary: Add CompiledPlan annotations to BatchExecMultipleInput Key: FLINK-36719 URL: https://issues.apache.org/jira/browse/FLINK-36719 Project: Flink Issue Type

[jira] [Created] (FLINK-36718) Add CompiledPlan annotations to BatchExecLookupJoin and BatchExecSortMergeJoin

2024-11-14 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-36718: -- Summary: Add CompiledPlan annotations to BatchExecLookupJoin and BatchExecSortMergeJoin Key: FLINK-36718 URL: https://issues.apache.org/jira/browse/FLINK-36718 Project: F

[RESULT][VOTE] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-11-14 Thread Timo Walther
Hi everyone, I'm happy to announce that FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF) [1] has been accepted. There are 11 approving votes, 8 of which are binding: - Sergey Nuyanzin (binding) - Konstantin Knauf (binding) - Jim Hughes (non-binding) - Xuyang (non-binding) - S

Re: [VOTE] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-11-14 Thread Timo Walther
And of course myself: +1 (binding) I will close the vote now. Thanks everyone! Best, Timo On 14.11.24 11:26, Martijn Visser wrote: I'm very much looking forward to this. Thanks all. +1 (binding) On Wed, Nov 13, 2024 at 5:06 PM David Radley wrote: +1 (non-binding) kind regards, David Fro

[jira] [Created] (FLINK-36717) Add health check to detect tasks stuck in DEPLOYING state

2024-11-14 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-36717: -- Summary: Add health check to detect tasks stuck in DEPLOYING state Key: FLINK-36717 URL: https://issues.apache.org/jira/browse/FLINK-36717 Project: Flink

RE: [jira] [Created] (FLINK-36716) Address vulnerabilities in Flink UI

2024-11-14 Thread Mehdi Deboub
Hi, I already started working on this issue to remove the critical/high vulnerabilities and I'm currently able to raise a PR. Could you please assign the current issue to me ? On 2024/11/14 13:13:00 "Mehdi (Jira)" wrote: > Mehdi created FLINK-36716: > - > >

[jira] [Created] (FLINK-36716) Address vulnerabilities in Flink UI

2024-11-14 Thread Mehdi (Jira)
Mehdi created FLINK-36716: - Summary: Address vulnerabilities in Flink UI Key: FLINK-36716 URL: https://issues.apache.org/jira/browse/FLINK-36716 Project: Flink Issue Type: Improvement Compo

Re: Dynamic Iceberg Sink

2024-11-14 Thread Ferenc Csaky
Hi Peter, Max, Thanks for starting this discussion, +1 for the proposal. I agree that the added functionality would solve some major pain points for Flink -> Iceberg use-cases! Best, Ferenc On Thursday, November 14th, 2024 at 03:54, Congxian Qiu wrote: > > > Thanks for kicking off this d

[jira] [Created] (FLINK-36715) Changed behavior for filter push down for IS NOT DISTINCT FROM after Calcite upgrade to 1.33

2024-11-14 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-36715: --- Summary: Changed behavior for filter push down for IS NOT DISTINCT FROM after Calcite upgrade to 1.33 Key: FLINK-36715 URL: https://issues.apache.org/jira/browse/FLINK-3671

Re: [DISCUSS] FLIP-482: Add OpenTelemetryEventReporter

2024-11-14 Thread Roman Khachatryan
Hi Piotr, Adding OTel implementation makes sense, +1 for the proposal. Thanks Regards, Roman On Thu, Nov 7, 2024 at 2:37 PM Piotr Nowojski wrote: > Hi all! > > I would like to open up for discussion a new FLIP-482 [1]. > > Motivation > FLIP-481 [2] is adding the EventReporter interface. Howe

Re: FLIP-484: Add custom metric variables to operators

2024-11-14 Thread Roman Khachatryan
Hi Piotr, thanks for the proposal, Can you please clarify 1. The scope of the variables added - is it only the last transformation? Do I understand correctly, that chaining does NOT affect this scoping? 2. Is Python API going to be supported as well? Thanks Regards, Roman On Thu, Nov 7, 2024

Re: [DISCUSS] FLIP-483: Add support for children Spans

2024-11-14 Thread Roman Khachatryan
Hi Piotr, thanks for the proposal, I see the need for reporting child spans, however I have a couple of questions about the proposed design: 1. Why do we give up on the idea of reporting child spans independently from the parent? I couldn't find much details in the Rejected Alternatives section

[jira] [Created] (FLINK-36714) sstmerge/CompactionScheduler termination can be interrupted

2024-11-14 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-36714: - Summary: sstmerge/CompactionScheduler termination can be interrupted Key: FLINK-36714 URL: https://issues.apache.org/jira/browse/FLINK-36714 Project: Flink

Re: Re: [VOTE] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-11-14 Thread Martijn Visser
I'm very much looking forward to this. Thanks all. +1 (binding) On Wed, Nov 13, 2024 at 5:06 PM David Radley wrote: > +1 (non-binding) > kind regards, > David > > From: Dawid Wysakowicz > Date: Tuesday, 12 November 2024 at 10:47 > To: dev@flink.apache.org > Subject: [EXTERNAL] Re: Re: [VOTE] F

Re: [DISCUSS] FLIP-481: Introduce Event Reporting

2024-11-14 Thread Roman Khachatryan
Hi Piotr, thanks for the proposal! I think this would be a very valuable addition to Flink as it would simplify operations a lot (disclaimer: we already use it in our internal Flink version) I have a couple of remarks regarding the FLIP: 1. Should it list the events that would be emitted in the