Re: [DISCUSS] State Schema Evolution for RowData

Thanks for the suggestions, Zakelly! Regarding *migrateElement* - it is specifically needed for ListState, which stores elements individually with delimiters. Its implementation deserializes and processes each element one by one during migration, so I introduced the *migrateElement* API to handle

[jira] [Created] (FLINK-37748) Remove JDK only JVM arguments from Flink operator Helm chart

Eduardas Kazakas created FLINK-37748: Summary: Remove JDK only JVM arguments from Flink operator Helm chart Key: FLINK-37748 URL: https://issues.apache.org/jira/browse/FLINK-37748 Project: Flink

Re: [DISCUSS] FLIP-486: Introduce a new DeltaJoin

Hi Xuyang, Thanks for driving this! The state of two-stream join is a very headache-inducing problem in stream computing system. After reading this FLIP, I have two question: 1. Can the two sides of the join operator be any stream or must it be immediately followed by the LookupSource? If it is

Re: [DISCUSS] FLIP-527 Support EXPLAIN EXECUTE STATEMENT SET Syntax in Flink SQL

Hi, Ramin Thanks for starting this proposal. After glancing at the content of FLIP, I have a question, how valuable is it to introduce this new syntax, if users want to EXPLAIN STATEMENT SET, the EXPLAIN keyword itself has to be written, how much does it cost to remove the EXECUTE keyword at this

Re: [DISCUSS] FLIP-526: Model ML_PREDICT, ML_EVALUATE Table API

Hi, Hao. +1 for the proposal. Best, Shengkai Hao Li 于2025年4月29日周二 07:27写道： > Hi All, > > I would like to start a discussion about FLIP-526 [1]: Model ML_PREDICT, > ML_EVALUATE Table API. > > This FLIP is a follow up of FLIP-507 [2] to propose the table api for model > related functions. This F

Re: [DISCUSS] FLIP-525: Model ML_PREDICT, ML_EVALUATE Implementation Design

Hi, Hao. Thanks for your proposal about ML related functions. This FLIP will help others to implement their own model provider. +1 for the proposal. Best, Shengkai Hao Li 于2025年4月29日周二 07:22写道： > Hi All, > > I would like to start a discussion about FLIP-525 [1]: Model ML_PREDICT, > ML_EVALUAT

[DISCUSS] FLIP-526: Model ML_PREDICT, ML_EVALUATE Table API

Hi All, I would like to start a discussion about FLIP-526 [1]: Model ML_PREDICT, ML_EVALUATE Table API. This FLIP is a follow up of FLIP-507 [2] to propose the table api for model related functions. This FLIP is also closely related to FLIP-525 [3] which is the proposal for model related function

[DISCUSS] FLIP-525: Model ML_PREDICT, ML_EVALUATE Implementation Design

Hi All, I would like to start a discussion about FLIP-525 [1]: Model ML_PREDICT, ML_EVALUATE Implementation Design. This FLIP is co-authored with Shengkai Fang. This FLIP is a follow up of FLIP-437 [2] to propose the implementation design for ML_PREDICT and ML_EVALUATE function which were introdu

[jira] [Created] (FLINK-37747) GlobalCommitterOperator cannot commit after scaling writer/committer

David created FLINK-37747: - Summary: GlobalCommitterOperator cannot commit after scaling writer/committer Key: FLINK-37747 URL: https://issues.apache.org/jira/browse/FLINK-37747 Project: Flink Issue

KinesisStreamSource de-aggregation support via DeserializationSchema

Hello the current version of Kinesis source (5.0.0) lacks support for KLP de-aggregation [1] There is a pending PR [2] but it breaks the API and will require a new major version of the connector. I implemented an alternative solution using a DeserializationSchema wrapper which adds de-aggregation

RE: [DISCUSS] FLIP-527 Support EXPLAIN EXECUTE STATEMENT SET Syntax in Flink SQL

Hi Ramin, Thanks for making the changes. As far as I can see the EXECUTE STATEMENT SET is Flink specific; so I am not sure this is part of the SQL standard. So, I guess adding the explain syntax as an alias for the existing explain would be ok. I assume Flink decided not to use stored procedures

[jira] [Created] (FLINK-37746) Missing serialVersionUID in MapTypeInfo class

Pranav Mahajan created FLINK-37746: -- Summary: Missing serialVersionUID in MapTypeInfo class Key: FLINK-37746 URL: https://issues.apache.org/jira/browse/FLINK-37746 Project: Flink Issue Type:

[jira] [Created] (FLINK-37745) ChangelogModeJsonSerializer doesn't handle partial deletes

Timo Walther created FLINK-37745: Summary: ChangelogModeJsonSerializer doesn't handle partial deletes Key: FLINK-37745 URL: https://issues.apache.org/jira/browse/FLINK-37745 Project: Flink Is

[jira] [Created] (FLINK-37744) [Helm] Add Helm lint and test CI

Yi Chen created FLINK-37744: --- Summary: [Helm] Add Helm lint and test CI Key: FLINK-37744 URL: https://issues.apache.org/jira/browse/FLINK-37744 Project: Flink Issue Type: Improvement Re

Re: [DISCUSS] FLIP-527 Support EXPLAIN EXECUTE STATEMENT SET Syntax in Flink SQL

Hello David, Many thanks for the response! I have moved the discussion to a new link. The FLIP number was wrong (now it is at 528). You can find the new link below https://lists.apache.org/thread/28llyjdks9hrj5rvpbxhd3zd7bfqwrw8 I have fixed the inconsistency in the text. Thanks for raising the

[jira] [Created] (FLINK-37743) Add benchmark test for Flink CDC Pipeline job

Yanquan Lv created FLINK-37743: -- Summary: Add benchmark test for Flink CDC Pipeline job Key: FLINK-37743 URL: https://issues.apache.org/jira/browse/FLINK-37743 Project: Flink Issue Type: Improve

[DISCUSS] FLIP-528 Support EXPLAIN EXECUTE STATEMENT SET Syntax in Flink SQL

Hi Flink Community, I want to discuss FLIP-528: Support EXPLAIN EXECUTE STATEMENT SET Syntax in Flink SQL. This FLIP proposes to extend the EXPLAIN statement in Flink SQL to support the EXECUTE STATEMENT SET syntax. The goal is to provide users with a way to understand the execution plan of a bat

RE: [DISCUSS] FLIP-516: Multi-Way Join Operator

Hi Gustavo,This sounds like a great idea. I notice the link limitations in the Flip points outside of the document to something I do not have access to. Please could you include t

Re: [DISCUSS] FLIP-527 Support EXPLAIN EXECUTE STATEMENT SET Syntax in Flink SQL

Hi Ramin, Thanks for the Flip. In the text you say EXECUTE STATEMENT SET BEGIN INSERT INTO `sales` SELECT ...; INSERT INTO `products` SELECT ...; END; Twice, I think you are intending the 2nd text to be different. Maybe EXPLAIN STATEMENT SET I am worried that in the SQL standard EXECUTE a

Re: [DISCUSS] FLIP-523 - Handle TLS Certificate Renewal

Thanks all for your feedback and sorry for the late answer (I was on holiday). 1. Indeed it would add 4 threads. For the non pekko component we can indeed have one watcher service used to reload SSLContext for those components For pekko this is a little more challenging as the creation of the pekk

Re: [DISCUSS] FLIP-516: Multi-Way Join Operator

Hi Gustavo, the idea and approach LGTM. +1 to proceed. Best, Arvid On Thu, Apr 24, 2025 at 4:58 PM Gustavo de Morais wrote: > Hi everyone, > > I'd like to propose FLIP-516: Multi-Way Join Operator [1] for discussion. > > Chained non-temporal joins in Flink SQL often cause a "big state issue"

Re: [DISCUSS] State Schema Evolution for RowData

Hi Weiqiang, Thanks for your answers! It seems a simple deserialization-serialization lacks flexibility, thus I'd agree to introduce new methods. I'd suggest changing the signature to: ``` public void migrateState( TypeSerializerSnapshot oldSerializerSnapshot, DataI

[DISCUSS] FLIP-527 Support EXPLAIN EXECUTE STATEMENT SET Syntax in Flink SQL

Hi Flink Community, ​ I want to discuss FLIP-527: Support EXPLAIN EXECUTE STATEMENT SET Syntax in Flink SQL. This FLIP proposes to extend the EXPLAIN statement in Flink SQL to support the EXECUTE STATEMENT SET syntax. The goal is to provide users with a way to understand the execution plan of a b

[jira] [Created] (FLINK-37742) POJO type expected but was: GenericType when resume from savepoint

Youjun Yuan created FLINK-37742: --- Summary: POJO type expected but was: GenericType when resume from savepoint Key: FLINK-37742 URL: https://issues.apache.org/jira/browse/FLINK-37742 Project: Flink

Re: [VOTE] Apache Flink CDC Release 3.4.0, release candidate #2

Thanks @Yanquan and @Xiqian for preparing the RC2. -1 as FLINK-37104 is a blocker issue, we should fix it before release. @Hongshun, FLINK-37738 is a feature request and which is created yesterday, I tend to postpone it to cdc 3.5 version. Best, Leonard > 2025 4月 28 16:04，Hongshun Wang 写道： >

Re: [VOTE] Apache Flink CDC Release 3.4.0, release candidate #2

Hi Yanquan, 1. Xiqian has found that significant performance regressions in FLINK-37104[1]. It's better to block until this is fixed. 2. FLINK-37738[2] n your release note is still not ready, maybe we can modify it to 3.4.1 or until it is merged. [1] https://issues.apache.org/jira/browse/FLINK-37

[jira] [Created] (FLINK-37741) Severe performance regression of transform operator node

yux created FLINK-37741: --- Summary: Severe performance regression of transform operator node Key: FLINK-37741 URL: https://issues.apache.org/jira/browse/FLINK-37741 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-37740) Fix flink-docker snapshots GitHub workflow

Muhammet Orazov created FLINK-37740: --- Summary: Fix flink-docker snapshots GitHub workflow Key: FLINK-37740 URL: https://issues.apache.org/jira/browse/FLINK-37740 Project: Flink Issue Type: