[DISCUSS] FLIP-486: Introduce a new DeltaJoin

Hi, devs. I'd like to start a discussion on FLIP-486: Introduce a new DeltaJoin[1]. In Flink streaming jobs, the large state of Join nodes has been a persistent concern for users. Since streaming jobs are long-running, the state of join generally increases in size over time. Although use

Re: [DISCUSS] FLIP-519: Introduce async lookup key ordered mode

Hi, Shuai Thanks for driving this proposal. The FLIP looks good to me overall, +1 for it. I have a small question about the table's contents. When 'table.exec.async-lookup.key-ordered-enabled=true' and 'table.exec.async-lookup.output-mode=ORDERD', the lookup join in key ordered should be 'yes', n

[jira] [Created] (FLINK-37726) Read incremental data for existing tables

Yanquan Lv created FLINK-37726: -- Summary: Read incremental data for existing tables Key: FLINK-37726 URL: https://issues.apache.org/jira/browse/FLINK-37726 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-37725) Share PythonCorrelateSplitRule with Async Scalar

Alan Sheinberg created FLINK-37725: -- Summary: Share PythonCorrelateSplitRule with Async Scalar Key: FLINK-37725 URL: https://issues.apache.org/jira/browse/FLINK-37725 Project: Flink Issue Ty

[VOTE] FLIP-505: Flink History Server Scability Improvements, Remote Data Store Fetch and Per Job Fetch

Hi devs, I would like to start a vote for FLIP-505 which has been discussed on this thread

Re: [DISCUSS] FLIP-520: Simplify StructuredType handling

Hi Timo, Thanks for the clarification. It's very helpful. For the classpath, I suppose it can also support Python later if it's called in Python table api? Do we want to indicate if it's Java classpath or Python class? Or we support a list of classpath which can consist both Python, Java or other

[jira] [Created] (FLINK-37724) Add AsyncTableFunction as new UDF type

Alan Sheinberg created FLINK-37724: -- Summary: Add AsyncTableFunction as new UDF type Key: FLINK-37724 URL: https://issues.apache.org/jira/browse/FLINK-37724 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-37723) FLIP-498: AsyncTableFunction for async table function support

Alan Sheinberg created FLINK-37723: -- Summary: FLIP-498: AsyncTableFunction for async table function support Key: FLINK-37723 URL: https://issues.apache.org/jira/browse/FLINK-37723 Project: Flink

[jira] [Created] (FLINK-37722) Eliminate redundant field initialization when deserializing POJOs

Zhanghao Chen created FLINK-37722: - Summary: Eliminate redundant field initialization when deserializing POJOs Key: FLINK-37722 URL: https://issues.apache.org/jira/browse/FLINK-37722 Project: Flink

[jira] [Created] (FLINK-37721) Fix Janino Bug which resulted in

Alan Sheinberg created FLINK-37721: -- Summary: Fix Janino Bug which resulted in Key: FLINK-37721 URL: https://issues.apache.org/jira/browse/FLINK-37721 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-37720) Enable table.optimizer.reuse-sink by default

xiangyu feng created FLINK-37720: Summary: Enable table.optimizer.reuse-sink by default Key: FLINK-37720 URL: https://issues.apache.org/jira/browse/FLINK-37720 Project: Flink Issue Type: Sub-

[jira] [Created] (FLINK-37719) Support Java 25 (LTS)

Liam Miller-Cushon created FLINK-37719: -- Summary: Support Java 25 (LTS) Key: FLINK-37719 URL: https://issues.apache.org/jira/browse/FLINK-37719 Project: Flink Issue Type: New Feature

[DISCUSS] FLIP-516: Multi-Way Join Operator

Hi everyone, I'd like to propose FLIP-516: Multi-Way Join Operator [1] for discussion. Chained non-temporal joins in Flink SQL often cause a "big state issue" due to large intermediate results, impacting performance and stability. This FLIP introduces a StreamingMultiJoinOperator to tackle this b

[jira] [Created] (FLINK-37718) Refactor ApplicationSubmissionContextReflector

tianzhu.wen created FLINK-37718: --- Summary: Refactor ApplicationSubmissionContextReflector Key: FLINK-37718 URL: https://issues.apache.org/jira/browse/FLINK-37718 Project: Flink Issue Type: Impr

Re: [DISCUSS] FLIP-520: Simplify StructuredType handling

Hi Timo, thank you very much for responding. I see that this is just the first step to get consistency between SQL and Table API and more work is to come. I still think that there is some redundancy between STRUCT and ROW but tbh I have more issues with ROW than with STRUCT. (What is even the mea

[jira] [Created] (FLINK-37717) Stuck occurred during the full synchronization phase, resulting in incomplete synchronization of all data

vertern created FLINK-37717: --- Summary: Stuck occurred during the full synchronization phase, resulting in incomplete synchronization of all data Key: FLINK-37717 URL: https://issues.apache.org/jira/browse/FLINK-37717

Re: [DISCUSS] FlinkSQL support enableObjectReuse to optimize CopyingChainingOutput

You will get into trouble if some Op caches the data locally and its downstream Op in the same operator chain modifies the data in-place. AFAIK, all Flink SQL operators handle it properly (deep copy when caching is needed), but you should be careful with UDFs and custom connectors. Example: sup

[VOTE] FLIP-518: Introduce a community review process

Hi, Thanks @Robert Metzger . I have tweaked the words in the Flup to say GitHub Action - which is the correct technical term for what I was previously called git action. Thanks @Tom Cooper for pointing this out. I'd like to start a vote for

[ANNOUNCE] Apache flink-connector-kafka 4.0.0 released

The Apache Flink community is very happy to announce the release of Apache flink-connector-kafka 4.0.0. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is available for download a

Re: [DISCUSS] FLIP-520: Simplify StructuredType handling

Hi Arvid, Hi Hao, thanks for this valuable feedback. Let me clarify a few things before I go into the details. Just to avoid any confusion: the FLIP does not propose introducing the StructuredType. Structured types backed by classes already exist in Flink for years and are already supported

Re: [DISCUSS] FLIP-518: Introduce a community review process

Awesome, thanks a lot. I'm +1 on putting this FLIP for a VOTE. On Tue, Apr 22, 2025 at 10:49 PM David Radley wrote: > Hi Seb and Robert, > Thanks for your feedback I have taken it on board, and have amended the > Flip[1] to be a Git action that will automatically set and remove the > labels. Se

[RESULT][VOTE] FLIP-522: Add generalized type information to SQL state connector

Hi All, The voting [1] on FLIP-522: Add generalized type information to SQL state connector [2] concluded with the following result. Approving votes: Márton Balassi (binding) Zakelly Lan (binding) Mátyás Őrhidi (binding) There are no disapproving votes, so I'm happy to announce that it has been