Re: [DISCUSS] FLIP-511: Support transaction id pooling in Kafka connector

Hi Hongshun, this thread is about addressing your first pain point. It would be awesome if you could read the FLIP and provide feedback whether this approach would work in your setup. The other issues won't need a FLIP but need a smaller bugfix. Best, Arvid On Tue, Mar 25, 2025 at 7:57 AM Hong

Re: [DISCUSS] FLIP-515: Dynamic Kafka Sink

Hi Matyas, thanks for clarifying. The design LGTM. Based on your description, I'd phrase the state management a bit differently: * The source of truth is and always will be the MDS. * The response is cached/replicated in Flink state to bridge MDS downtime. * Since MDS is queried periodically, sta

Re: [DISCUSS] FLIP-512: Add meta information to SQL state connector

Hi everyone, I'm fine with a seperate SQL connector for metadata, so maybe we could update the FLIP about our discussion? And Shengkai provides a PTF implementation, does that also meet the requirement? Best, Zakelly On Thu, Mar 20, 2025 at 4:47 PM Gabor Somogyi wrote: > Hi All, > > @Zakelly:

Re: [ANNOUNCE] Apache Flink 2.0.0 released

Congratulations! Thanks for the great work! Best, Xuannan > On Mar 25, 2025, at 15:14, Neelesh Salian wrote: > > Congratulations! > > Regards, > Neelesh S. Salian > > > > On Tue, Mar 25, 2025 at 15:50 Jark Wu > wrote: >> Congratulations! And thanks to all who made

Re: [VOTE] FLIP-495: Support AdaptiveScheduler record and query the rescale history

+1 (binding) Best, Wei > 2025年3月25日 17:50，Yuepeng Pan 写道： > > Hi all, Thanks for all the feedback on FLIP-495[1][2]. I'd like to start a > vote for FLIP-495. The vote will last for at least 72 hours unless there is > an objection or insufficient votes. Thanks, Yuepeng Pan [1] > https://cwiki

Re: [DISCUSS] Release externalized Kudu connector

+1 for the release and the release manager. Cheers, Attila On Fri, 21 Mar 2025 at 14:46, Márton Balassi wrote: > Hi Ferenc, > > +1. It makes sense to move the Kudu connector under the Flink umbrella, I > agree that it should support Flink 1.19 and 1.20 (maybe 2.0 soon) and > thanks for voluntee

Re: [DISCUSS] Planning Flink 2.1

Thanks for the kick off and volunteering as release manager, Ron. +1 for start preparing release 2.1 and Ron as the release manager. The proposed feature freeze date sounds good to me. @David, Just to provide some background information. In the Flink community, we use the terminologies Major, M

Re: [DISCUSS] Planning Flink 2.1

Hi, David Thanks for your kind reminder, we are planning the next minor release 2.1. Thanks also to Xingtong for additional background information. Best, Ron Xintong Song 于2025年3月26日周三 11:08写道： > Thanks for the kick off and volunteering as release manager, Ron. > > +1 for start preparing rele

Re: [ANNOUNCE] Apache Flink 2.0.0 released

Congratulations! Thanks for the great work! Best, Yuepeng On 2025/03/25 06:48:58 Jark Wu wrote: > Congratulations! And thanks to all who made this release possible! > > Best, > Jark > > On Tue, 25 Mar 2025 at 14:46, Jingsong Li wrote: > > > Congratulations! > > > > Best, > > Jingsong > > > >

[jira] [Created] (FLINK-37518) Optimize number of files created by flink history server

Biao Geng created FLINK-37518: - Summary: Optimize number of files created by flink history server Key: FLINK-37518 URL: https://issues.apache.org/jira/browse/FLINK-37518 Project: Flink Issue Type

Re: [ANNOUNCE] Apache Flink 1.20.1 released

Hi Alex, I found that only one wheel package was uploaded to pypi[1]. Could you help upload other wheel packages as well? Best, Xingbo [1] https://pypi.org/project/apache-flink/1.20.1/#files Ferenc Csaky 于2025年2月20日周四 00:31写道： > Congrats to everyone involved! > > Thanks Alex for managing the

Re: [DISCUSS] FLIP-XXX: Blue/Green Deployments for Flink on Kubernetes: Phase 1 (basic)

> for now we’re keeping it simple and yes the cluster needs double the resources during the transition time to have both Blue and Green jobs running. Sounds make sense to keep it simple at the first version. > Now in order to not be blocked when we’re out of room for a 2n job, we could add someth

[jira] [Created] (FLINK-37558) Check right variable on MetricRegistryImpl#addSpan

Chahyeong Cho created FLINK-37558: - Summary: Check right variable on MetricRegistryImpl#addSpan Key: FLINK-37558 URL: https://issues.apache.org/jira/browse/FLINK-37558 Project: Flink Issue Ty

RE: [DISCUSS] Planning Flink 2.1

Hi , I am wondering what the thinking is about calling the next release 2.1 rather than 2.0.1. This numbering implies to me you are considering a minor release rather than a point release. For example https://commons.apache.org/releases/versioning.html, Kind r

Re: [DISCUSS] Planning Flink 2.1

Thanks, Ron Liu for kicking off the 2.1 release. +1 for Ron Liu to be the release manager and +1 for the feature freeze date Best, Jark On Mon, 24 Mar 2025 at 16:33, Ron Liu wrote: > Hi everyone, > With the release announcement of Flink 2.0, it's a good time to kick off > discussion of the nex

Re: [DISCUSS] Release externalized Kudu connector

By starting the release process I meant the steps to create a RC, but the wording was confusing. On Tuesday, March 25th, 2025 at 12:09, Ferenc Csaky wrote: > > > Thank you all for the inputs! If no objections until then, > I will start the release process in Thursday (03-27). > > Thanks,

Re: [DISCUSS] Release externalized Kudu connector

Thank you all for the inputs! If no objections until then, I will start the release process in Thursday (03-27). Thanks, Ferenc On Monday, March 24th, 2025 at 16:59, Mate Czagany wrote: > > > Hi Ferenc, > > I think the current state is great to have the first release. Thank you for > the e

[jira] [Created] (FLINK-37556) OpenTelemetry reporter does not package all required classes

Mate Czagany created FLINK-37556: Summary: OpenTelemetry reporter does not package all required classes Key: FLINK-37556 URL: https://issues.apache.org/jira/browse/FLINK-37556 Project: Flink

[VOTE] FLIP-495: Support AdaptiveScheduler record and query the rescale history

Hi all, Thanks for all the feedback on FLIP-495[1][2]. I'd like to start a vote for FLIP-495. The vote will last for at least 72 hours unless there is an objection or insufficient votes. Thanks, Yuepeng Pan [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-495:+Support+AdaptiveScheduler

[jira] [Created] (FLINK-37555) Postgres cdc supports starting from a specified offset or confirmed lsn

ouyangwulin created FLINK-37555: --- Summary: Postgres cdc supports starting from a specified offset or confirmed lsn Key: FLINK-37555 URL: https://issues.apache.org/jira/browse/FLINK-37555 Project: Flink

[jira] [Created] (FLINK-37554) Add unit tests for state compatibility between ForStKeyeStateBackend and ForStSyncKeyeStateBackend

Yue Ma created FLINK-37554: -- Summary: Add unit tests for state compatibility between ForStKeyeStateBackend and ForStSyncKeyeStateBackend Key: FLINK-37554 URL: https://issues.apache.org/jira/browse/FLINK-37554

[jira] [Created] (FLINK-37553) Make ForStKeyedStateBackend consider namespaceSerializer compatibility when restoring state

Yue Ma created FLINK-37553: -- Summary: Make ForStKeyedStateBackend consider namespaceSerializer compatibility when restoring state Key: FLINK-37553 URL: https://issues.apache.org/jira/browse/FLINK-37553 Proje

[jira] [Created] (FLINK-37552) Made StateMetaInfo consistent for ForStKeyeStateBackend and ForStSyncKeyeStateBackend.

Yue Ma created FLINK-37552: -- Summary: Made StateMetaInfo consistent for ForStKeyeStateBackend and ForStSyncKeyeStateBackend. Key: FLINK-37552 URL: https://issues.apache.org/jira/browse/FLINK-37552 Project: F

Re: [ANNOUNCE] Apache Flink 2.0.0 released

Congratulations! Regards, Neelesh S. Salian On Tue, Mar 25, 2025 at 15:50 Jark Wu wrote: > Congratulations! And thanks to all who made this release possible! > > Best, > Jark > > On Tue, 25 Mar 2025 at 14:46, Jingsong Li wrote: > >> Congratulations! >> >> Best, >> Jingsong >> >> On Tue, Mar

[jira] [Created] (FLINK-37551) Improve the state compatibility of ForStKeyeStateBackend and ForStSyncKeyeStateBackend

Yue Ma created FLINK-37551: -- Summary: Improve the state compatibility of ForStKeyeStateBackend and ForStSyncKeyeStateBackend Key: FLINK-37551 URL: https://issues.apache.org/jira/browse/FLINK-37551 Project: F