Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

Hi all, I would like to follow up on my previous email regarding your feedback. Below is a concise summary of my main points: 1. Compiled Plan: IIUC, the compiled plan is primarily for ensuring execution plan compatibility across job versions (e.g., during upgrades). Eventually, it needs to be co

[jira] [Created] (FLINK-35863) Doc build faild due to npm failure

Samrat Deb created FLINK-35863: -- Summary: Doc build faild due to npm failure Key: FLINK-35863 URL: https://issues.apache.org/jira/browse/FLINK-35863 Project: Flink Issue Type: Bug Com

[jira] [Created] (FLINK-35862) Chinese and English documents are different

ye.nova created FLINK-35862: --- Summary: Chinese and English documents are different Key: FLINK-35862 URL: https://issues.apache.org/jira/browse/FLINK-35862 Project: Flink Issue Type: Bug C

[jira] [Created] (FLINK-35861) The dependency of kafka sql connector seems wrong

xuyang created FLINK-35861: -- Summary: The dependency of kafka sql connector seems wrong Key: FLINK-35861 URL: https://issues.apache.org/jira/browse/FLINK-35861 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

Hi, Weijie Thanks for your feedback! `StreamGraphOptimizationStrategy` is a reasonable abstract, I'd like to know what built-in strategy implementations you have in mind so far? We will introduce two optimization strategies: AdaptiveBroadcastJoinOptimizeStrategy, which dynamically determines and

Re: [DISCUSS]: Flink code generation porting to Calcite

Hi James, After reading the comments in CALCITE-3094, I think what you are looking for is the Flink code-splitting tools. Code splitting is a common need for Java code generation and Flink has extracted the code splitting into a separate module "flink-table-code-splitter"[1] with little dependenci

[jira] [Created] (FLINK-35860) S5CmdOnMinioITCase failed due to IllegalAccessError

Weijie Guo created FLINK-35860: -- Summary: S5CmdOnMinioITCase failed due to IllegalAccessError Key: FLINK-35860 URL: https://issues.apache.org/jira/browse/FLINK-35860 Project: Flink Issue Type: B

Re: [VOTE] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

+1(binding) Best regards, Weijie Wencong Liu 于2024年7月17日周三 21:31写道： > Hi dev, > > I'd like to start a vote on FLIP-466. > > Discussion thread: > https://lists.apache.org/thread/sw2or62299w0hw9jm5kdqjqj3j8rnrdt > FLIP: > https://cwiki.apache.org/confluence/display/FLINK/FLIP-466%3A+Introduce+P

[DISCUSS]: Flink code generation porting to Calcite

Hi Flink developer community, I’m contributing to the Apache Calcite project and there’s interest in making use of Flink’s code generation. See the comments on https://issues.apache.org/jira/browse/CALCITE-3094 Would someone be able to point me to where Flink integrates Janino? I originally th

Re: Request to make ContinuousFileReaderOperator public

I wanted to bump this request from last year. As I understand it the new FileSource is not suitable for my existing use case. The TLDR is that we have extensively customized/extended the file splits and input formats so a single ContinuousFileReaderOperator can handle non-homogenous files and acts

Supporting fields containing "." in watermark

Hi there, It looks like Flink does not support fields containing a dot character in the watermark. The validation done on Flink code to determine whether the property is "nested", is to check if they contain a dot in the name, so even if the property is not nested, but contains a dot, it is rep

[VOTE] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

Hi dev, I'd like to start a vote on FLIP-466. Discussion thread: https://lists.apache.org/thread/sw2or62299w0hw9jm5kdqjqj3j8rnrdt FLIP: https://cwiki.apache.org/confluence/display/FLINK/FLIP-466%3A+Introduce+ProcessFunction+Attribute+in+DataStream+API+V2 Best regards, Wencong Liu

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

Thanks for the proposal! I like this idea as it gives Flink's adaptive batching processing more room to imagine and optimize. So, +1 from my side. I just have two questions: 1. `StreamGraphOptimizationStrategy` is a reasonable abstract, I'd like to know what built-in strategy implementations yo

Re: [DISCUSS] CLI action deprecation process

Hi Xintong, Muhammet, Thank you for your thoughts! I agree with Xintong regarding 1), and 2). About making users aware of these compatibility guarantees, documentation and CLI print deprecation is what I already aimed for when I was merging the "run" and "run-application" actions functionality [

[jira] [Created] (FLINK-35859) [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called

Hongshun Wang created FLINK-35859: - Summary: [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called Key: FLINK-35859 URL: https://issues.apache.org/jira/browse/FL

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

+1 (non-binding) Best, Yuepeng Pan At 2024-07-17 05:57:28, "Aleksandr Pilipenko" wrote: >+1 (non-binding) > >Thanks, >Aleksandr > >On Tue, 16 Jul 2024 at 22:56, Ahmed Hamdy wrote: > >> +1 (non-binding) >> >> Best Regards >> Ahmed Hamdy >> >> >> On Tue, 16 Jul 2024 at 21:58, Becket

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

Thanks Junrui for the updates. The proposal looks good to me. With the stream graph added to the REST API result, I think we are also quite close to enable Flink to expand a job vertex to show its operator-chain topology. Thanks, Zhu Junrui Lee 于2024年7月15日周一 14:58写道： > Hi Zhu, > > Thanks for yo

[jira] [Created] (FLINK-35858) Namespace support for async state

Zakelly Lan created FLINK-35858: --- Summary: Namespace support for async state Key: FLINK-35858 URL: https://issues.apache.org/jira/browse/FLINK-35858 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35857) Operator restart failed job without latest checkpoint

chenyuzhi created FLINK-35857: - Summary: Operator restart failed job without latest checkpoint Key: FLINK-35857 URL: https://issues.apache.org/jira/browse/FLINK-35857 Project: Flink Issue Type: B