[jira] [Created] (FLINK-37009) Migrate PruneAggregateCallRule

2025-01-05 Thread Jacky Lau (Jira)
Jacky Lau created FLINK-37009: - Summary: Migrate PruneAggregateCallRule Key: FLINK-37009 URL: https://issues.apache.org/jira/browse/FLINK-37009 Project: Flink Issue Type: Sub-task Compo

Re: [DISCUSS] Is it a bug that the AdaptiveScheduler does not prioritize releasing TaskManagers during downscaling in Application mode?

2025-01-05 Thread Yuepeng Pan
Thank you Matthias and all for the feedback and suggestions. Please let me make a brief summary based on the historical comments: - It's agreeded to optimize/fix this issue in the 1.x TLS versions. - The primary goal of this optimization/fix is to minimize the number of TaskManagers used in appli

Re: [DISCUSS] Is it a bug that the AdaptiveScheduler does not prioritize releasing TaskManagers during downscaling in Application mode?

2025-01-05 Thread Yuepeng Pan
Thank you Matthias and all for the feedback and suggestions. Please let me make a brief summary based on the historical comments: - It's agreeded to optimize/fix this issue in the 1.x TLS versions. - The primary goal of this optimization/fix is to minimize the number of TaskManagers used in appli

Re: [DISCUSS] FLIP-499: Support Event Time by Generalized Watermark in DataStream V2

2025-01-05 Thread Xu Huang
Hi, Anil Maybe the watermark alignment mechanism on DataStream V1 can solve your problem, it can align the watermark of SourceSplit. please refer to the documentation [1][2]. And we don't provide this feature on this FLIP, this feature will be in our future planning. [1] https://cwiki.apache.org/

Re: [DISCUSS] FLIP-499: Support Event Time by Generalized Watermark in DataStream V2

2025-01-05 Thread Junrui Lee
Hi, Xu Thanks for your work, I noticed that in this FLIP, event-time watermark is created and sent through a separate WatermarkGenerator. I would like to know if there is support for Source to send event-time watermark? Best, Junrui Xu Huang 于2025年1月6日周一 10:31写道: > Hi, Anil > > Maybe the water

Re: [DISCUSS] FLIP-499: Support Event Time by Generalized Watermark in DataStream V2

2025-01-05 Thread Xu Huang
Hi, Junrui Thanks for your question, Source is able to send event-time watermark. It can be sent via SourceReaderContext as mentioned in FLIP-467. Example is as follows: > sourceReaderContext.emitWatermark(EventTimeExtension.EVENT_TIME_WATERMARK_DECLARATION.newWatermark(eventTime)) We will add it

[jira] [Created] (FLINK-37008) Flink UI should show the type of checkpoint (full vs incremental)

2025-01-05 Thread Ryan van Huuksloot (Jira)
Ryan van Huuksloot created FLINK-37008: -- Summary: Flink UI should show the type of checkpoint (full vs incremental) Key: FLINK-37008 URL: https://issues.apache.org/jira/browse/FLINK-37008 Project

[jira] [Created] (FLINK-37010) Unify KeyedProcessFunction and the async one

2025-01-05 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37010: --- Summary: Unify KeyedProcessFunction and the async one Key: FLINK-37010 URL: https://issues.apache.org/jira/browse/FLINK-37010 Project: Flink Issue Type: Sub-ta

Re: Re: [VOTE] FLIP-494: Add missing createTable/createView methods to TableEnvironment

2025-01-05 Thread Sergey Nuyanzin
also myself +1 (binding) On Thu, Jan 2, 2025 at 4:08 AM Xuyang wrote: > +1 (non-binding) > > > -- > > Best! > Xuyang > > > > > > 在 2024-12-31 16:48:15,"Dawid Wysakowicz" 写道: > >+1(binding) > >Best, > >Dawid > > > >On Tue, 24 Dec 2024 at 08:27, Feng Jin wrote: > > > >> +1 (non-binding)

[RESULT][VOTE] FLIP-494: Add missing createTable/createView methods to TableEnvironment

2025-01-05 Thread Sergey Nuyanzin
Hi everyone, I'm delighted to announce that FLIP-494 [1] has been accepted. There were 6 +1 votes, 3 of which are binding: - Ron Liu (binding) - Yuepeng Pan (non-binding) - Feng Jin (non-binding) - Dawid Wysakowicz (binding) - Xuyang (non-binding) - Sergey Nuyanzin (binding) There were no -1 vo

Re: Re: [VOTE] FLIP-494: Add missing createTable/createView methods to TableEnvironment

2025-01-05 Thread Sergey Nuyanzin
The voting time for FLIP-494: Add missing createTable/createView methods to TableEnvironment [1] has passed. I'm closing the vote now. [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=334760466 On Sun, Jan 5, 2025 at 7:21 PM Sergey Nuyanzin wrote: > also myself > +1 (bin

Re: [DISCUSS] Is it a bug that the AdaptiveScheduler does not prioritize releasing TaskManagers during downscaling in Application mode?

2025-01-05 Thread Matthias Pohl
Hi everyone and sorry for the late reply. I was mostly off in November and forgot about that topic in December last year. Thanks for summarizing and bringing up user feedback. I see the problem and agree with your view that it's a topic that we might want to address in the 1.x LTS version. I see h

[jira] [Created] (FLINK-36934) Enrich numSubpartitions to TierMasterAgent#addPartitionAndGetShuffleDescriptor

2025-01-05 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-36934: -- Summary: Enrich numSubpartitions to TierMasterAgent#addPartitionAndGetShuffleDescriptor Key: FLINK-36934 URL: https://issues.apache.org/jira/browse/FLINK-36934 Project: F

[jira] [Created] (FLINK-37007) FLIP-494: Add missing createTable/createView methods to TableEnvironment

2025-01-05 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-37007: --- Summary: FLIP-494: Add missing createTable/createView methods to TableEnvironment Key: FLINK-37007 URL: https://issues.apache.org/jira/browse/FLINK-37007 Projec