Re: Kafka connector releases

2024-09-30 Thread Arvid Heise
Hi folks, thanks for the feedback. I'm still not convinced that it's the best approach to start with a bugfix release but I did a poor job in highlighting my thoughts. * I don't think we have any precedent of deprecating API in a bugfix release. * It's not obvious to me if a bugfix release counts

Re: Kafka connector releases

2024-09-30 Thread Danny Cranmer
Thanks for driving this Arvid. +1 for the releases and the RM For the 4.0.0 version it would be good to drop the Flink version from the connector version (4.0.0, not 4.0.0-2.0). I started a discussion some time ago [1], however the thread went stale. But I think the feedback was generally aligned

[jira] [Created] (FLINK-36410) Improve Lineage Info Collection for flink app

2024-09-30 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-36410: - Summary: Improve Lineage Info Collection for flink app Key: FLINK-36410 URL: https://issues.apache.org/jira/browse/FLINK-36410 Project: Flink Issue Type: S

FW: RE: Kafka connector releases

2024-09-30 Thread David Radley
Hi again Arvid, I realise we actually have 3 releases (2 bug releases) supporting 1.18 – the renumbering threw me 😊. So I think your proposal looks good, kind regards, David. From: David Radley Date: Monday, 30 September 2024 at 17:07 To: dev@flink.apache.org Subject: [EXTERNAL] RE: Kafk

Re: Kafka connector releases

2024-09-30 Thread Arvid Heise
Hi Danny, thanks for bringing this to my attention. I'm also in favor of starting with Flink 2.0. It's just a nice opportunity to break with some traditions and we are almost there anyways. We could resume the discussion over there if you'd like. Regarding the deprecation. I think you misundersto

Re: [VOTE] FLIP-477: Amazon SQS Source Connector

2024-09-30 Thread Robert Metzger
+1 (binding) On Fri, Sep 27, 2024 at 12:12 PM Danny Cranmer wrote: > +1 (binding) > > Thanks, > Danny > > On Fri, Sep 27, 2024 at 8:15 AM Arvid Heise wrote: > > > +1 (binding), > > > > Best, > > > > Arvid > > > > On Tue, Sep 3, 2024 at 12:35 PM Saurabh Singh < > saurabhsingh9...@gmail.com> > >

[jira] [Created] (FLINK-36409) Publish some autoscaler metrics during stabilisation period

2024-09-30 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-36409: -- Summary: Publish some autoscaler metrics during stabilisation period Key: FLINK-36409 URL: https://issues.apache.org/jira/browse/FLINK-36409 Project: Flink Issu

[jira] [Created] (FLINK-36413) Reenable the test case that related to Source/Sink APi deprecated.

2024-09-30 Thread LvYanquan (Jira)
LvYanquan created FLINK-36413: - Summary: Reenable the test case that related to Source/Sink APi deprecated. Key: FLINK-36413 URL: https://issues.apache.org/jira/browse/FLINK-36413 Project: Flink

[jira] [Created] (FLINK-36414) NoSuchMethodError while trying flink cdc

2024-09-30 Thread Yang Hua Jie (Jira)
Yang Hua Jie created FLINK-36414: Summary: NoSuchMethodError while trying flink cdc Key: FLINK-36414 URL: https://issues.apache.org/jira/browse/FLINK-36414 Project: Flink Issue Type: Bug

RE: Kafka connector releases

2024-09-30 Thread David Radley
Hi Arvid, Thanks for your reply on this. So we could do a 3.2.1, if we supported Flink 1.18? Is there a compelling reason to not support 1.18? I see that Kafka connectors that supported Flink 1.17 and below had 2 to 6 bug releases. Is there not an expectation that there will be a Flink 1.18 c

Re: Question around Flink's AdaptiveBatchScheduler

2024-09-30 Thread Venkatakrishnan Sowrirajan
First of all my sincere apologies for slow progress on this one. @Junrui Lee and Xia, I updated the PR with respect to the last set of feedback comments on the PR. Please take a look. I am hoping to finish this one quickly. Regards Venkata krishnan On Thu, May 9, 2024 at 4:35 AM Venkatakrishn

[jira] [Created] (FLINK-36411) Allow configuring job vertex throughput limits for auto scaler

2024-09-30 Thread Sai Sharath Dandi (Jira)
Sai Sharath Dandi created FLINK-36411: - Summary: Allow configuring job vertex throughput limits for auto scaler Key: FLINK-36411 URL: https://issues.apache.org/jira/browse/FLINK-36411 Project: Fli

[jira] [Created] (FLINK-36412) Retry strategies on Kinesis Sink

2024-09-30 Thread Ed Berezitsky (Jira)
Ed Berezitsky created FLINK-36412: - Summary: Retry strategies on Kinesis Sink Key: FLINK-36412 URL: https://issues.apache.org/jira/browse/FLINK-36412 Project: Flink Issue Type: Improvement