Re: [DISCUSS] FLIP-515: Dynamic Kafka Sink

Hi Matyas, I also have another question. This FLIP-515 seems based on FLIP-246 and then I read FLIP-246. It seems that KafkaMetadataService is a key concept in the FLIP. In this FLIP-515 and FLIP-246, KafkaMetadataServiceImpl is mentioned ,but I didn't found it in flink-connector-kafka repo wh

[RESULT][VOTE] FLIP-512: Add meta information to SQL state connector

Hi All, The voting [1] on FLIP-512: Add meta information to SQL state connector [2] concluded with the following result. Approving votes: Gyula Fóra (binding) Yuepeng Pan (non-binding) Zakelly Lan (binding) Andrei Kaigorodov (non-binding) Rui Fan (binding) Ferenc Csaky (binding) Shengkai Fang (bi

Re: [DISCUSS] FLIP-515: Dynamic Kafka Sink

Hi Matyas, Sorry for the late reply. Dynamic Kafka Source has been introduced for a long time, and it is a little confusing for developers like me that KafkaDynamicSource and DynamicKafkaSource have the same kafka connector repo for different things. Now DynamicKafkaSink will be introduced again.

Re: [VOTE] FLIP-432: Faster Checkpoint & Recovery for Disaggregated State

Thanks for driving this :-) +1 On Thu, Apr 3, 2025 at 12:34 PM Han Yin wrote: > Hi everyone, > > I'd like to start a vote on the FLIP-432: Faster Checkpoint & Recovery for > Disaggregated State [1]. The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless ther

Re: [DISCUSS] FLIP-432: Faster Checkpoint & Recovery for Disaggregated State

Hi everyone, Thanks for all the comments! Since there have been no further comments for a while, I would like to start a vote for this FLIP. > 2025年3月19日 16:36，Yanfei Lei 写道： > > Hi Han, > > Thanks for the proposal. > Faster Checkpoint & Recovery lays the groundwork for Disaggregated > State t

[VOTE] FLIP-432: Faster Checkpoint & Recovery for Disaggregated State

Hi everyone, I'd like to start a vote on the FLIP-432: Faster Checkpoint & Recovery for Disaggregated State [1]. The discussion thread is here [2]. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1] https://cwiki.apache.org/confluence/pages/view

[VOTE] Release flink-connector-elasticsearch v3.1.0, release candidate #1

Hi everyone, Please review and vote on the release candidate #1 for v3.1.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) This release supports Flink 1.18, 1.19 and 1.20. The complete staging area is available for your review,

Re: [DISCUSS] FLIP-517: Better Handling of Dynamic Table Primitives with PTFs

Hi Timo, Any question I have is what's the SEARCH_KEY result schema you have in mind? Can it output multiple rows for every row in the left table or it needs to pack the result in a single row as an array? Thanks, Hao On Mon, Mar 24, 2025 at 10:20 AM Hao Li wrote: > Thanks Timo for the FLIP! T

Re: [EXTERNAL] Re: Executing PyFlink Cluster

Yeah, exactly. Go ahead and ping me, we'll punt it in... On Wed, Apr 2, 2025 at 7:17 PM Ferenc Csaky wrote: > AFAIK the standard YAML config possibility were introduced in > Flink 1.19, it just coexisted with the old solution to keep bw > compatibility in the 1.x line. > > If we bp it to 1.20, i

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

Hi Paul Lam, Is this FLIP still active? I am not able to find the vote for this FLIP and any corresponding JIRA or Github PR with POC. Can you please share more on the current status of this FLIP? Thanks! Regards Venkata krishnan On Fri, Jan 5, 2024 at 2:40 AM Márton Balassi wrote: > Thanks,

[jira] [Created] (FLINK-37605) SinkWriter may incorrectly infer end of input during rescale

Arvid Heise created FLINK-37605: --- Summary: SinkWriter may incorrectly infer end of input during rescale Key: FLINK-37605 URL: https://issues.apache.org/jira/browse/FLINK-37605 Project: Flink I

[jira] [Created] (FLINK-37603) FLIP-502: QueryOperation SQL Serialization customization

Dawid Wysakowicz created FLINK-37603: Summary: FLIP-502: QueryOperation SQL Serialization customization Key: FLINK-37603 URL: https://issues.apache.org/jira/browse/FLINK-37603 Project: Flink

Re: [ANNOUNCE] New Apache Flink PMC Member - Zakelly Lan

Congrats! BR, G On Tue, Apr 1, 2025 at 9:53 AM Yuan Mei wrote: > On behalf of the PMC, I'm very happy to announce a new Apache Flink PMC > Member > - Zakelly Lan. > > Zakelly has been a dedicated and invaluable contributor to the Flink > community for over five years. He became a committer ear

Re: [ANNOUNCE] New Apache Flink PMC Member - Zakelly Lan

Congrats Zakelly! Ryan van Huuksloot Sr. Production Engineer | Streaming Platform [image: Shopify] On Tue, Apr 1, 2025 at 3:53 AM Yuan Mei wrote: > On behalf of the PMC, I'm very happy to announce a new Apache Flink PMC

Re: [EXTERNAL] Re: Executing PyFlink Cluster

AFAIK the standard YAML config possibility were introduced in Flink 1.19, it just coexisted with the old solution to keep bw compatibility in the 1.x line. If we bp it to 1.20, it's not much overhead to move it over to 1.19 as well I guess. WDYT? On Wednesday, April 2nd, 2025 at 17:23, Gabor S

[jira] [Created] (FLINK-37604) Flink CDC pipeline composer doesn't assign UIDs to operators

Sergei Morozov created FLINK-37604: -- Summary: Flink CDC pipeline composer doesn't assign UIDs to operators Key: FLINK-37604 URL: https://issues.apache.org/jira/browse/FLINK-37604 Project: Flink

Re: [EXTERNAL] Re: Executing PyFlink Cluster

I've double checked it and the mentioned fix must be adopted to at least 1.20 with the is_standard_yaml condition. On Wed, Apr 2, 2025 at 5:07 PM Gabor Somogyi wrote: > But as a general saying, if the issue exists on 1.x line then at least > 1.20 must have this fix. > Let me check that and act

Re: [EXTERNAL] Re: Executing PyFlink Cluster

But as a general saying, if the issue exists on 1.x line then at least 1.20 must have this fix. Let me check that and act accordingly... BR, G On Wed, Apr 2, 2025 at 5:00 PM Gabor Somogyi wrote: > Yeah, new version of Kafka connector is needed to use 2.x. > > > > On Wed, Apr 2, 2025 at 4:56 PM

Re: [EXTERNAL] Re: Executing PyFlink Cluster

I'm able to use the 2.x line, but I see that the "flink-connector-kafka" latest version is still on 3.4.0-1.20 with no 2.0 tag yet. Will I need to wait for the 2.x tag to be released? From: Gabor Somogyi Sent: Wednesday, April 2, 2025 10:13 AM To: dev@flink.apac

Re: Executing PyFlink Cluster

I think I've already fixed this here [1] but only on 2.x line. Up until now I thought that only 2.x is using YAML based configs... [1] https://github.com/apache/flink/pull/26327 BR, G On Wed, Apr 2, 2025 at 4:08 PM Andreas Bube wrote: > There's an open issue that looks very similar: > https:/

Re: Executing PyFlink Cluster

There's an open issue that looks very similar: https://issues.apache.org/jira/browse/FLINK-36457. No idea how to work around this. On Wed, 2 Apr 2025 at 15:13, Gulan, Jacob wrote: > Hello, > > I've been running into a wall for the past few days trying to get my > PyFlink cluster running in a Doc

Re: [ANNOUNCE] New Apache Flink PMC Member - Zakelly Lan

Congratulations, Zakelly! Best, Shengkai Yash Anand 于2025年4月2日周三 13:07写道： > Congratulations, Zakelly! > > On Wed, Apr 2, 2025 at 12:03 AM Sergey Nuyanzin > wrote: > > > Congratulations, Zakelly! > > > > On Wed, Apr 2, 2025, 05:59 Yunfeng Zhou > > wrote: > > > > > Congratulations! > > > > > >