Re: [RESULT] [VOTE] Release 2.1.0, release candidate #1

2025-08-01 Thread Maximilian Michels
Hi Ron, Thanks for the update! Cheers, Max On Thu, Jul 31, 2025 at 8:33 AM Ron Liu wrote: > > Hi, Max > > Flink 2.1.0 has released, you can find the source and binary packages in: > https://flink.apache.org/downloads/ > > Best, > Ron > > Maximilian Michels 于2025

Re: [RESULT] [VOTE] Release 2.1.0, release candidate #1

2025-07-30 Thread Maximilian Michels
Thanks for managing the release, Ron! When are we planning to publish source and binaries? Cheers, Max On Tue, Jul 29, 2025 at 3:52 AM Ron Liu wrote: > > Hi, dev, > > I'm happy to announce that we have unanimously approved this release. > > There are 11 approving votes, 5 of which are binding:

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.12.1, release candidate #1

2025-07-09 Thread Maximilian Michels
+1 (binding) 1. Verified the archives, checksums, and signatures 2. Extracted and inspected the source code for binaries 3. Compiled and tested the source code via mvn install 4. Verified license files / headers Thanks for preparing the release! -Max On Wed, Jul 9, 2025 at 8:38 AM Gyula Fóra

Re: [RESULT][VOTE] Release 1.19.3, release candidate #2

2025-07-03 Thread Maximilian Michels
@Ferenc: Apologies this took so long. Thanks for doing this release! On Wed, Jul 2, 2025 at 2:49 PM Ferenc Csaky wrote: > I'm happy to announce that we have unanimously approved this release. > > There are 5 approving votes, 3 of which are binding: > > - Mate Czagany (non-binding) > - Márton Bal

Re: [RESULT][VOTE] Release 1.20.2, release candidate #2

2025-07-03 Thread Maximilian Michels
Thanks for doing the release, Ferenc! There are several critical fixes in this release. Cheers, Max On Wed, Jul 2, 2025 at 2:52 PM Ferenc Csaky wrote: > I'm happy to announce that we have unanimously approved this release. > > There are 4 approving votes, 3 of which are binding: > > - Mate Czag

[jira] [Created] (FLINK-37971) SQL hints are dropped by planner when

2025-06-18 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-37971: -- Summary: SQL hints are dropped by planner when Key: FLINK-37971 URL: https://issues.apache.org/jira/browse/FLINK-37971 Project: Flink Issue

Re: [DISCUSS] Proposal: Modernizing Cassandra Sink with Sink V2 & Async Support

2025-06-03 Thread Maximilian Michels
+1 On Tue, Jun 3, 2025 at 7:35 AM wrote: > > Sounds like a great plan, +1 > > Gyula > > > > > On 3 Jun 2025, at 05:57, Leonard Xu wrote: > > > > +1 for the proposed plan and timeline, thanks Poorvank for driving this > > FLIP. > > > > > > Best, > > Leonard > > > >> 2025 6月 3 11:30,Poorvank Bha

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.12.0, release candidate #1

2025-06-02 Thread Maximilian Michels
+1 (binding) 1. Verified the archives, checksums, and signatures 2. Extracted and inspected the source code for binaries 3. Compiled and tested the source code via mvn install 4. Verified license files / headers 5. Deployed helm chart to test cluster 6. Ran example job -Max On Mon, Jun 2, 2025 a

Re: [VOTE] FLIP-514: Custom Evaluator plugin for Flink Autoscaler

2025-04-11 Thread Maximilian Michels
+1 (binding) Cheers, Max On Mon, Apr 7, 2025 at 9:49 AM Rui Fan <1996fan...@gmail.com> wrote: > > +1(binding) > > Best, > Rui > > On Mon, Apr 7, 2025 at 3:25 PM Gyula Fóra wrote: > > > +1 (binding) > > > > Gyula > > > > On Mon, Apr 7, 2025 at 9:23 AM Pradeepta Choudhury > > wrote: > > > > > Hi

Re: [VOTE] FLIP-515: Dynamic Kafka Sink

2025-04-10 Thread Maximilian Michels
+1 (binding) Cheers, Max On Thu, Apr 3, 2025 at 2:04 PM Gabor Somogyi wrote: > > +1 (binding) > > BR, > G > > > On Thu, Apr 3, 2025 at 11:49 AM wrote: > > > +1 (binding) > > > > Gyula > > Sent from my iPhone > > > > > On 3 Apr 2025, at 00:32, Őrhidi Mátyás wrote: > > > > > > Hi devs, > > > >

[jira] [Created] (FLINK-37546) KryoSerializer breaks without Twitter Chill library

2025-03-24 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-37546: -- Summary: KryoSerializer breaks without Twitter Chill library Key: FLINK-37546 URL: https://issues.apache.org/jira/browse/FLINK-37546 Project: Flink

Re: [DISCUSS] FLIP-514: Custom Evaluator plugin for Flink Autoscaler

2025-03-20 Thread Maximilian Michels
Hi Pradeepta, Generally, the proposal looks good to me. The only issue I see is that it is fairly generic. On the one hand, it allows plugging in additional evaluation logic into the autoscaler, which allows for many new ways to extend the current autoscaling logic. On the other hand, normal users

[jira] [Created] (FLINK-37526) Promote SinkV2 API classes from @Experimental to @PublicEvolving

2025-03-20 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-37526: -- Summary: Promote SinkV2 API classes from @Experimental to @PublicEvolving Key: FLINK-37526 URL: https://issues.apache.org/jira/browse/FLINK-37526 Project

Re: Dynamic Iceberg Sink

2025-02-28 Thread Maximilian Michels
it further for my POC? > ThanksOn Tuesday, December 3, 2024 at 02:01:46 AM PST, Anil Dasari > wrote: > > Hi Max,That’s great to hear—thank you for the update. I look forward to > reviewing the code when it’s available. > > Thanks,Anil > On Thursday, November 28, 20

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.11.0, release candidate #1

2025-02-28 Thread Maximilian Michels
+1 (binding) 1. Verified the archives, checksums, and signatures 2. Extracted and inspected the source code for binaries 3. Compiled and tested the source code via mvn verify 4. Verified license files / headers -Max On Fri, Feb 28, 2025 at 8:57 AM Rui Fan <1996fan...@gmail.com> wrote: > > +1(bin

Re: Question about in-place rescaling support in Flink k8s operator

2025-02-17 Thread Maximilian Michels
Hi Jiazhou, Autoscaling via the Flink operator supports "in-place" rescaling, but it is like you described it: When scaling up, more resources are allocated first to increase the cluster size, then the job is restarted. This isn't the kind of "in-place" rescaling which works without a job restart.

Re: [VOTE] Release 1.20.1, release candidate #1

2025-02-06 Thread Maximilian Michels
+1 (binding) 1. Verified the archives, checksums, and signatures 2. Extracted and inspected the source code for binaries 3. Built the source code 4. Verified license files / headers Max On Wed, Feb 5, 2025 at 6:30 PM Alexander Fedulov wrote: > > Hi David, > > Thanks for verifying the release. >

[jira] [Created] (FLINK-37253) Display state size in application status and deployment metrics

2025-02-04 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-37253: -- Summary: Display state size in application status and deployment metrics Key: FLINK-37253 URL: https://issues.apache.org/jira/browse/FLINK-37253 Project

Re: [DISCUSS] Is it a bug that the AdaptiveScheduler does not prioritize releasing TaskManagers during downscaling in Application mode?

2025-02-04 Thread Maximilian Michels
abled by default. > >Therefore, it doesn't add complexity in terms of configuration for > > them. > > b. However, this would require users who want to keep the original > > behavior to actively configure this setting. > > So, this still gives

Re: Flink Operator 1.11 release planning

2025-02-03 Thread Maximilian Michels
+1 On Sun, Feb 2, 2025 at 4:11 AM Sharath wrote: > > +1, Looking forward to the release! > > On Sat, Feb 1, 2025 at 6:50 PM Peter Huang > wrote: > > > +1 from me. I can help with some release verification. > > > > On Sat, Feb 1, 2025 at 6:40 PM ConradJam wrote: > > > > > +1 > > > > > > Tom Coop

Re: [VOTE] Release 1.19.2, release candidate #1

2025-02-03 Thread Maximilian Michels
+1 (binding) 1. Verified the archives, checksums, and signatures 2. Extracted and inspected the source code for binaries 3. Built the source code 4. Verified license files / headers Sergey wrote: >one minor finding: >in staging repos [1] it has wrong description (1.9.2 instead of 1.19.2) Good ca

[jira] [Created] (FLINK-37245) RowData#createFieldGetter can resurrect null values for non-null fields

2025-02-02 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-37245: -- Summary: RowData#createFieldGetter can resurrect null values for non-null fields Key: FLINK-37245 URL: https://issues.apache.org/jira/browse/FLINK-37245

Re: Upgrade to Netty 4.x (1.19.2, 1.20.1 releases)

2025-01-22 Thread Maximilian Michels
> > > > > > > > > > > Am Mo., 20. Jan. 2025 um 04:53 Uhr schrieb He Pin > > > > > > > he...@apache.org: > > > > > > > > > > > > > > > I think so, not sure how Flink works, but if they share the > > > > > > > > s

Re: Upgrade to Netty 4.x (1.19.2, 1.20.1 releases)

2025-01-17 Thread Maximilian Michels
+1 for Netty4 with UNPOOLED memory allocator to not change the default memory footprint. -Max On Fri, Jan 17, 2025 at 1:15 PM Samrat Deb wrote: > > +1 to move to netty4. > > bests, > Samrat > > On Fri, 17 Jan 2025 at 5:30 PM, Luke Chen wrote: > > > Thanks for the summary! > > > > +1 to upgrade

Re: [RESULT][VOTE] FLIP-496: SQL connector for keyed state data

2025-01-15 Thread Maximilian Michels
Thanks for working on this awesome new feature! -Max On Mon, Jan 13, 2025 at 1:01 PM Gabor Somogyi wrote: > > Hi All, > > I'm glad to announce that the FLIP-496: SQL connector for keyed state > data[1] has been accepted. The voting thread is here[2]. > > The proposal received 4 approving votes,

Re: [DISCUSS] Is it a bug that the AdaptiveScheduler does not prioritize releasing TaskManagers during downscaling in Application mode?

2025-01-15 Thread Maximilian Michels
s 1), 2), 3), and 4), using the new slot prioritization strategy > mentioned previous may be a good option. > If I'm wrong, please feel free to correct me. > And I would greatly appreciate it if you could provide more information. > > > > > Looking forward to your rep

Re: [DISCUSS] Is it a bug that the AdaptiveScheduler does not prioritize releasing TaskManagers during downscaling in Application mode?

2025-01-10 Thread Maximilian Michels
only take effect > >in the session mode. And the new option could be ignored in > >the application mode. > > > >So I'm not sure whether we will fix this issue in flink 1.x for both > >application mode and session mode? > > > >Generally, I'm +1 for

Re: [VOTE] FLIP-493: Add K8S conditions to CRD's Status

2025-01-08 Thread Maximilian Michels
+1 Thanks for working on adding support for Conditions! -Max On Sat, Dec 21, 2024 at 7:54 PM wrote: > > +1 (binding) > > The simplified approach makes complete sense! > > Gyula > > Sent from my iPhone > > > On 20 Dec 2024, at 16:33, David Radley wrote: > > > >  > > > > +1 (non-binding) from m

Re: [DISCUSS] Is it a bug that the AdaptiveScheduler does not prioritize releasing TaskManagers during downscaling in Application mode?

2025-01-06 Thread Maximilian Michels
Thanks Yuepeng for your work on this issue! I would advise not to add yet another config option to Flink. In application mode, the scheduler should default to using the least amount of resources required. From my perspective, the current behavior is a bug and it doesn't help that we can come up wi

[jira] [Created] (FLINK-36890) ObservedGeneration is not updated on NOOP spec updates

2024-12-11 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-36890: -- Summary: ObservedGeneration is not updated on NOOP spec updates Key: FLINK-36890 URL: https://issues.apache.org/jira/browse/FLINK-36890 Project: Flink

[jira] [Created] (FLINK-36870) Start scale down timer after initial scale up

2024-12-09 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-36870: -- Summary: Start scale down timer after initial scale up Key: FLINK-36870 URL: https://issues.apache.org/jira/browse/FLINK-36870 Project: Flink

Re: Blue/Green Deployments support for Flink

2024-12-04 Thread Maximilian Michels
Hi Sergio, Out of the box blue/green deployments would be a great addition to Flink. +1 for starting a FLIP. That will allow us to better describe the architecture and flesh out the technical details. I reckon the handover between the two pipelines is going to be the most difficult part. Particul

Re: Dynamic Iceberg Sink

2024-11-28 Thread Maximilian Michels
t; > need to restart the job if there is any schema evolution, Look forward > to > > > seeing this integrated with FlinkCDC > > > > > > Best, > > > Congxian > > > > > > > > > Leonard Xu xbjt...@gmail.com 于2024年11月14日周四 09:37写道:

[jira] [Created] (FLINK-36717) Add health check to detect tasks stuck in DEPLOYING state

2024-11-14 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-36717: -- Summary: Add health check to detect tasks stuck in DEPLOYING state Key: FLINK-36717 URL: https://issues.apache.org/jira/browse/FLINK-36717 Project: Flink

Re: Dynamic Iceberg Sink

2024-11-13 Thread Maximilian Michels
Thanks for driving this Peter! The Dynamic Iceberg Sink is meant to solve several pain points of the current Flink Iceberg sink. Note that the Iceberg sink lives in Apache Iceberg, not Apache Flink, although that may change one day when the interfaces are stable enough. >From the user perspective,

Re: [ANNOUNCE] New Apache Flink Committer - Junrui Li

2024-11-06 Thread Maximilian Michels
Welcome Junrui! On Wed, Nov 6, 2024 at 1:53 PM Hong Liang wrote: > Congratulations Junrui! > > Hong > > On Wed, Nov 6, 2024 at 12:36 PM Yanquan Lv wrote: > > > Congratulations, Junrui! > > > > Best, > > Yanquan > > > > > 2024年11月5日 19:59,Zhu Zhu 写道: > > > > > > Hi everyone, > > > > > > On beha

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.10.0, release candidate #1

2024-10-25 Thread Maximilian Michels
+1 (binding) 1. Verified the archives, checksums, and signatures 2. Extracted and inspected the source code for binaries 3. Compiled and tested the source code via mvn verify 4. Verified license files / headers 5. Deployed helm chart to test cluster 6. Ran example job 7. Tested autoscaling without

[ANNOUNCE] Apache Flink Kubernetes Operator 1.8.0 released

2024-03-25 Thread Maximilian Michels
The Apache Flink community is very happy to announce the release of the Apache Flink Kubernetes Operator version 1.8.0. The Flink Kubernetes Operator allows users to manage their Apache Flink applications on Kubernetes through all aspects of their lifecycle. Release highlights: - Flink Autotuning

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.8.0, release candidate #1

2024-03-21 Thread Maximilian Michels
The vote is now closed. I'm happy to announce that we have unanimously approved this release. There are 6 approving votes, 3 of which are binding: * Gyula Fora (binding) * Marton Balassi (binding) * Maximilian Michels (binding) * Rui Fan (non-binding) * Alexander Fedulov (non-binding) *

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.8.0, release candidate #1

2024-03-21 Thread Maximilian Michels
./flink-autoscaler-standalone/dependency-reduced-pom.xml though > > > - Verified that chart and appVersion matches the target release (91d67d9) > > > - Verified that Helm chart can be installed from the local Helm folder > > > without overriding any parameters &

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.8.0, release candidate #1

2024-03-18 Thread Maximilian Michels
.memory.tuning.enabled: "true" > > - Download Autoscaler standalone: wget > > > > https://repository.apache.org/content/repositories/orgapacheflink-1710/org/apache/flink/flink-autoscaler-standalone/1.8.0/flink-autoscaler-standalone-1.8.0.jar > > - Ran Autoscaler standalone

[VOTE] Apache Flink Kubernetes Operator Release 1.8.0, release candidate #1

2024-03-14 Thread Maximilian Michels
Hi everyone, Please review and vote on the release candidate #1 for the version 1.8.0 of the Apache Flink Kubernetes Operator, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) **Release Overview** As an overview, the release consists

Re: [DISCUSS] Kubernetes Operator 1.8.0 release planning

2024-03-14 Thread Maximilian Michels
Hey everyone, I don't see any immediate blockers, so I'm going to start the release process. Thanks, Max On Tue, Feb 20, 2024 at 8:55 PM Maximilian Michels wrote: > > Hey Rui, hey Ryan, > > Good points. Non-committers can't directly release but they can assist >

Re: Flink Kubernetes Operator Failing Over FlinkDeployments to a New Cluster

2024-03-13 Thread Maximilian Michels
Hi Kevin, Theoretically, as long as you move over all k8s resources, failover should work fine on the Flink and Flink Operator side. The tricky part is the handover. You will need to backup all resources from the old cluster, shutdown the old cluster, then re-create them on the new cluster. The op

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-11 Thread Maximilian Michels
thank working > > > > > hours or contributions from individual volunteers which I think > > > > > is recognized in other ways > > > > > (e.g., credit of committer and PMC member). > > > > > > > > > > Best, > > > > &g

Re: [DISCUSS] FLIP-433: State Access on DataStream API V2

2024-03-11 Thread Maximilian Michels
The FLIP mentions: "The contents described in this FLIP are all new APIs and do not involve compatibility issues." In this thread it looks like the plan is to remove the old state declaration API. I think we should consider keeping the old APIs to avoid breaking too many jobs. The new APIs will st

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

2024-03-11 Thread Maximilian Michels
+1 (binding) Max On Thu, Feb 29, 2024 at 4:24 AM Hang Ruan wrote: > > +1 (non-binding) > > Best, > Hang > > weijie guo 于2024年2月29日周四 09:55写道: > > > +1 (binding) > > > > Best regards, > > > > Weijie > > > > > > Feng Jin 于2024年2月29日周四 09:37写道: > > > > > +1 (non-binding) > > > > > > Best, > > >

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-05 Thread Maximilian Michels
I'm a bit torn on this idea. On the one hand, it makes sense to thank sponsors and entities who have supported Flink in the past. On other hand, this list is bound to be incomplete and maybe also biased, even if not intended to be so. I think the power of open-source comes from the unconditional do

[jira] [Created] (FLINK-34540) Tune number of task slots

2024-02-28 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-34540: -- Summary: Tune number of task slots Key: FLINK-34540 URL: https://issues.apache.org/jira/browse/FLINK-34540 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34539) Tune JobManager memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-34539: -- Summary: Tune JobManager memory of autoscaled jobs Key: FLINK-34539 URL: https://issues.apache.org/jira/browse/FLINK-34539 Project: Flink Issue

[jira] [Created] (FLINK-34538) Tune memory of autoscaled jobs

2024-02-28 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-34538: -- Summary: Tune memory of autoscaled jobs Key: FLINK-34538 URL: https://issues.apache.org/jira/browse/FLINK-34538 Project: Flink Issue Type: New

Re: [DISCUSS] Kubernetes Operator 1.8.0 release planning

2024-02-20 Thread Maximilian Michels
> > I can volunteer to be a release manager. I haven't done it for > > Apache/Flink or the operator before so I may be a good candidate. > > > > Ryan van Huuksloot > > Sr. Production Engineer | Streaming Platform > > [image: Shopify] > > <http

Re: Re: [VOTE] FLIP-417: Expose JobManagerOperatorMetrics via REST API

2024-02-14 Thread Maximilian Michels
SCUSS]` thread and FLIP doc. Please let me know if there are any > > > concerns. > > > > > > Best, > > > Mason > > > > > > On Mon, Jan 29, 2024 at 5:32 AM Thomas Weise wrote: > > > > > >> +1 (binding)

Re: [DISCUSS] Kubernetes Operator 1.8.0 release planning

2024-02-07 Thread Maximilian Michels
committers (or other >> contributors) in the operator release process so that we have some fresh >> eyes on the process. >> Would anyone be interested in volunteering to help with the next release? >> >> Cheers, >> Gyula >> >> On Tue, Feb 6, 2024 at 4:

Re: [DISCUSS] Kubernetes Operator 1.8.0 release planning

2024-02-06 Thread Maximilian Michels
fixes and improvements to both the operator and the > > autoscaler logic. > > > > There are a few outstanding PRs currently, including some larger features > > for the Autoscaler (JDBC event handler, Heap tuning), we have to make a > > decision regarding those as well

Re: [VOTE] Release flink-connector-kafka v3.1.0, release candidate #1

2024-02-06 Thread Maximilian Michels
+1 (binding) - Inspected source release (checked license, headers, no binaries) - Verified checksums and signature Cheers, Max On Sun, Feb 4, 2024 at 5:41 AM Qingsheng Ren wrote: > > Thanks for driving this, Martijn! > > +1 (binding) > > - Verified checksum and signature > - Verified no binarie

Re: [VOTE] Release flink-connector-parent, release candidate #1

2024-01-29 Thread Maximilian Michels
- Inspected the source for licenses and corresponding headers - Checksums and signature OK +1 (binding) On Tue, Jan 23, 2024 at 4:08 PM Etienne Chauchot wrote: > > Hi everyone, > > Please review and vote on the release candidate #1 for the version > 1.1.0, as follows: > > [ ] +1, Approve the rel

Re: Re: [VOTE] FLIP-417: Expose JobManagerOperatorMetrics via REST API

2024-01-29 Thread Maximilian Michels
+1 (binding) On Fri, Jan 26, 2024 at 6:03 AM Rui Fan <1996fan...@gmail.com> wrote: > > +1(binding) > > Best, > Rui > > On Fri, Jan 26, 2024 at 11:55 AM Xuyang wrote: > > > +1 (non-binding) > > > > > > -- > > > > Best! > > Xuyang > > > > > > > > > > > > 在 2024-01-26 10:12:34,"Hang Ruan" 写

[jira] [Created] (FLINK-34213) Consider using accumulated busy time instead of busyMsPerSecond

2024-01-23 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-34213: -- Summary: Consider using accumulated busy time instead of busyMsPerSecond Key: FLINK-34213 URL: https://issues.apache.org/jira/browse/FLINK-34213 Project

[jira] [Created] (FLINK-34152) Tune memory of autoscaled jobs

2024-01-18 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-34152: -- Summary: Tune memory of autoscaled jobs Key: FLINK-34152 URL: https://issues.apache.org/jira/browse/FLINK-34152 Project: Flink Issue Type: New

[jira] [Created] (FLINK-34151) Integrate Karpenter resource limits into cluster capacity check

2024-01-18 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-34151: -- Summary: Integrate Karpenter resource limits into cluster capacity check Key: FLINK-34151 URL: https://issues.apache.org/jira/browse/FLINK-34151 Project

Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-10 Thread Maximilian Michels
+1 (binding) On Wed, Jan 10, 2024 at 11:22 AM Martijn Visser wrote: > > +1 (binding) > > On Wed, Jan 10, 2024 at 4:43 AM Xingbo Huang wrote: > > > > +1 (binding) > > > > Best, > > Xingbo > > > > Dian Fu 于2024年1月10日周三 11:35写道: > > > > > +1 (binding) > > > > > > Regards, > > > Dian > > > > > > On

[jira] [Created] (FLINK-33993) Ineffective scaling detection events are misleading

2024-01-04 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33993: -- Summary: Ineffective scaling detection events are misleading Key: FLINK-33993 URL: https://issues.apache.org/jira/browse/FLINK-33993 Project: Flink

Re: [Discuss][Flink-31326] Flink autoscaler code

2024-01-04 Thread Maximilian Michels
x27;s unexpected IIUC. >> Would you like to fix it? >> >> Feel free to create a FLINK JIRA to fix it if you would like to, and I'm >> happy to >> review! >> >> And cc @Maximilian Michels >> >> Best, >> Rui >> &g

[ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

2024-01-02 Thread Maximilian Michels
Happy New Year everyone, I'd like to start the year off by announcing Alexander Fedulov as a new Flink committer. Alex has been active in the Flink community since 2019. He has contributed more than 100 commits to Flink, its Kubernetes operator, and various connectors [1][2]. Especially notewort

Re: [DISCUSS] Release flink-connector-parent v1.01

2023-12-21 Thread Maximilian Michels
> Anyone for pushing my pub key to apache dist ? Done. On Thu, Dec 21, 2023 at 2:36 PM Etienne Chauchot wrote: > > Hello, > > All the ongoing PRs on this repo were merged. But, I'd like to leave > some more days until feature freeze in case someone had a feature ready > to integrate. > > Let' pu

Re: [DISCUSS] Should Configuration support getting value based on String key?

2023-12-13 Thread Maximilian Michels
Hi Rui, +1 for removing the @Deprecated annotation from `getString(String key, String defaultValue)`. I would remove the other typed variants with default values but I'm ok with keeping them if they are still used. -Max On Wed, Dec 13, 2023 at 4:59 AM Rui Fan <1996fan...@gmail.com> wrote: > > Hi

Re: [VOTE] FLIP-401: REST API JSON response deserialization unknown field tolerance

2023-12-12 Thread Maximilian Michels
+1 (binding) On Tue, Dec 12, 2023 at 2:23 PM Peter Huang wrote: > > +1 Non-binding > > > Peter Huang > > Őrhidi Mátyás 于2023年12月12日 周二下午9:14写道: > > > +1 > > Matyas > > > > On Mon, Dec 11, 2023 at 10:26 PM Gyula Fóra wrote: > > > > > +1 > > > > > > Gyula > > > > > > On Mon, Dec 11, 2023 at 1:26 P

Re: [DISCUSS] Change the default restart-strategy to exponential-delay

2023-12-12 Thread Maximilian Michels
; > Looking forward to your feedback, thanks~ > > [1] https://github.com/apache/flink/pull/23247#discussion_r1422626734 > [2] > https://github.com/apache/flink/assets/38427477/642c57e0-b415-4326-af05-8b506c5fbb3a > [3] https://issues.apache.org/jira/browse/FLINK-33736 > > Bes

Re: [DISCUSS] Change the default restart-strategy to exponential-delay

2023-12-07 Thread Maximilian Michels
Hey Rui, +1 for changing the default restart strategy to exponential-delay. This is something all users eventually run into. They end up changing the restart strategy to exponential-delay. I think the current defaults are quite balanced. Restarts happen quickly enough unless there are consecutive

[jira] [Created] (FLINK-33773) Add fairness to scaling decisions

2023-12-07 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33773: -- Summary: Add fairness to scaling decisions Key: FLINK-33773 URL: https://issues.apache.org/jira/browse/FLINK-33773 Project: Flink Issue Type

[jira] [Created] (FLINK-33771) Add cluster capacity awareness to Autoscaler

2023-12-07 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33771: -- Summary: Add cluster capacity awareness to Autoscaler Key: FLINK-33771 URL: https://issues.apache.org/jira/browse/FLINK-33771 Project: Flink

[jira] [Created] (FLINK-33770) Autoscaler logs are full of deprecated key warnings

2023-12-07 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33770: -- Summary: Autoscaler logs are full of deprecated key warnings Key: FLINK-33770 URL: https://issues.apache.org/jira/browse/FLINK-33770 Project: Flink

[jira] [Created] (FLINK-33710) Autoscaler redeploys pipeline for a NOOP parallelism change

2023-11-30 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33710: -- Summary: Autoscaler redeploys pipeline for a NOOP parallelism change Key: FLINK-33710 URL: https://issues.apache.org/jira/browse/FLINK-33710 Project

Re: [ANNOUNCE] Apache Flink 1.16.3 released

2023-11-30 Thread Maximilian Michels
Thank you Rui for driving this! On Thu, Nov 30, 2023 at 3:01 AM Rui Fan <1996fan...@gmail.com> wrote: > > The Apache Flink community is very happy to announce the release of > Apache Flink 1.16.3, which is the > third bugfix release for the Apache Flink 1.16 series. > > > > Apache Flink® is an ope

Re: [VOTE] FLIP-364: Improve the restart-strategy

2023-11-30 Thread Maximilian Michels
+1 (binding) -Max On Thu, Nov 30, 2023 at 9:15 AM Rui Fan <1996fan...@gmail.com> wrote: > > +1(binding) > > Best, > Rui > > On Mon, Nov 13, 2023 at 11:01 AM Rui Fan <1996fan...@gmail.com> wrote: > > > Hi everyone, > > > > Thank you to everyone for the feedback on FLIP-364: Improve the > > restart

Re: [DISCUSS] FLIP-395: Migration to GitHub Actions

2023-11-24 Thread Maximilian Michels
Thanks for reviving the efforts here Matthias! +1 for the transition to GitHub Actions. As for ASF Infra Jenkins, it works fine. Jenkins is extremely feature-rich. Not sure about the spare capacity though. I know that for Apache Beam, Google donated a bunch of servers to get additional build capac

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.7.0, release candidate #1

2023-11-20 Thread Maximilian Michels
+1 (binding) 1. Downloaded the archives, checksums, and signatures 2. Verified the signatures and checksums 3. Extract and inspect the source code for binaries 4. Compiled and tested the source code via mvn verify 5. Verified license files / headers 6. Deployed helm chart to test cluster 7. Build

Re: [DISCUSS] FLIP-394: Add Metrics for Connector Agnostic Autoscaling

2023-11-17 Thread Maximilian Michels
Hi Mason, Thank you for the proposal. This is a highly requested feature to make the source scaling of Flink Autoscaling generic across all sources. The current implementation handles every source individually, and if we don't find any backlog metrics, we default to using busy time only. At this p

[jira] [Created] (FLINK-33572) Minimize ConfigMap API operations for autoscaler state

2023-11-16 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33572: -- Summary: Minimize ConfigMap API operations for autoscaler state Key: FLINK-33572 URL: https://issues.apache.org/jira/browse/FLINK-33572 Project: Flink

[jira] [Created] (FLINK-33522) Savepoint upgrade mode fails despite the savepoint succeeding

2023-11-10 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33522: -- Summary: Savepoint upgrade mode fails despite the savepoint succeeding Key: FLINK-33522 URL: https://issues.apache.org/jira/browse/FLINK-33522 Project

Re: [DISCUSS] Kubernetes Operator 1.7.0 release planning

2023-11-01 Thread Maximilian Michels
+1 for targeting the release as soon as possible. Given the effort that Rui has undergone to decouple the autoscaling implementation, it makes sense to also include an alternative implementation with the release. In the long run, I wonder whether the standalone implementation should even be part of

[jira] [Created] (FLINK-33429) Metric collection during stabilization phase may error due to missing metrics

2023-11-01 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33429: -- Summary: Metric collection during stabilization phase may error due to missing metrics Key: FLINK-33429 URL: https://issues.apache.org/jira/browse/FLINK-33429

Re: off for a week

2023-10-26 Thread Maximilian Michels
Have a great time off, Etienne! On Thu, Oct 26, 2023 at 3:38 PM Etienne Chauchot wrote: > > Hi, > > FYI, I'll be off and unresponsive for a week starting tomorrow evening. > For ongoing work, please ping me before tomorrow evening or within a week > > Best > > Etienne

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.6.1, release candidate #1

2023-10-26 Thread Maximilian Michels
+1 (binding) 1. Downloaded the archives, checksums, and signatures 2. Verified the signatures and checksums ( gpg --recv-keys B2D64016B940A7E0B9B72E0D7D0528B28037D8BC ) 3. Extract and inspect the source code for binaries 4. Compiled and tested the source code via mvn verify 5. Verified license fil

Re: [DISCUSS] FLIP-364: Improve the restart-strategy

2023-10-19 Thread Maximilian Michels
Hey Rui, +1 for making exponential backoff the default. I agree with Konstantin that retrying forever is a good default for exponential backoff because oftentimes the issue will resolve eventually. The purpose of exponential backoff is precisely to continue to retry without causing too much load.

Re: [VOTE] FLIP-361: Improve GC Metrics

2023-09-14 Thread Maximilian Michels
+1 (binding) On Thu, Sep 14, 2023 at 4:26 AM Venkatakrishnan Sowrirajan wrote: > > +1 (non-binding) > > On Wed, Sep 13, 2023, 6:55 PM Matt Wang wrote: > > > +1 (non-binding) > > > > > > Thanks for driving this FLIP > > > > > > > > > > -- > > > > Best, > > Matt Wang > > > > > > Replied Messa

Re: [VOTE] FLIP-334: Decoupling autoscaler and kubernetes and support the Standalone Autoscaler

2023-09-13 Thread Maximilian Michels
+1 (binding) On Wed, Sep 13, 2023 at 12:28 PM Gyula Fóra wrote: > > +1 (binding) > > Gyula > > On Wed, 13 Sep 2023 at 09:33, Matt Wang wrote: > > > Thank you for driving this FLIP, > > > > +1 (non-binding) > > > > > > -- > > > > Best, > > Matt Wang > > > > > > Replied Message > > | Fro

Re: [DISCUSS] FLIP-334 : Decoupling autoscaler and kubernetes

2023-09-06 Thread Maximilian Michels
aise a pull request > > (PR) for YARN as well. > > > > Our initial approach was to create a decoupled interface as part of > > FLIP-334 and then implement it for YARN in the subsequent phase. > > However, if you recommend combining both phases, we can certainly consi

Re: [DISSCUSS] Kubernetes Operator Flink Version Support Policy

2023-09-05 Thread Maximilian Michels
Sep 5, 2023 at 8:13 AM Gyula Fóra wrote: > > > > > Hi All! > > > > > > @Maximilian Michels has raised the question of Flink > > > version support in the operator before the last release. I would like to > > > open this discussion pu

Re: [DISCUSS] FLIP-334 : Decoupling autoscaler and kubernetes

2023-09-05 Thread Maximilian Michels
gt; handlerScalingFailure/handlerScalingReport (one of the >> handles the event of scale failure, and the other handles >> the event of scale success). >> >> >> >> -- >> >> Best, >> Matt Wang >> >> >> Replied Message >

Re: [DISCUSS] FLIP-361: Improve GC Metrics

2023-09-05 Thread Maximilian Michels
Hi Gyula, +1 The proposed changes make sense and are in line with what is available for other metrics, e.g. number of records processed. -Max On Tue, Sep 5, 2023 at 2:43 PM Gyula Fóra wrote: > > Hi Devs, > > I would like to start a discussion on FLIP-361: Improve GC Metrics [1]. > > The current

[jira] [Created] (FLINK-32991) Some metrics from autoscaler never get registered

2023-08-29 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-32991: -- Summary: Some metrics from autoscaler never get registered Key: FLINK-32991 URL: https://issues.apache.org/jira/browse/FLINK-32991 Project: Flink

[jira] [Created] (FLINK-32992) Recommended parallelism metric is a duplicate of Parallelism metric

2023-08-29 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-32992: -- Summary: Recommended parallelism metric is a duplicate of Parallelism metric Key: FLINK-32992 URL: https://issues.apache.org/jira/browse/FLINK-32992

[jira] [Created] (FLINK-32960) Logic to log vertex exclusion only once does not work correctly

2023-08-25 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-32960: -- Summary: Logic to log vertex exclusion only once does not work correctly Key: FLINK-32960 URL: https://issues.apache.org/jira/browse/FLINK-32960 Project

[jira] [Created] (FLINK-32959) Operator standalone mode throws NoClassDefFoundError

2023-08-25 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-32959: -- Summary: Operator standalone mode throws NoClassDefFoundError Key: FLINK-32959 URL: https://issues.apache.org/jira/browse/FLINK-32959 Project: Flink

[jira] [Created] (FLINK-32903) Add a load simulation example pipeline for canary testing

2023-08-21 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-32903: -- Summary: Add a load simulation example pipeline for canary testing Key: FLINK-32903 URL: https://issues.apache.org/jira/browse/FLINK-32903 Project: Flink

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.6.0, release candidate #2

2023-08-14 Thread Maximilian Michels
+1 (binding) 1. Downloaded the archives, checksums, and signatures 2. Verified the signatures and checksums 3. Extract and inspect the source code for binaries 4. Compiled and tested the source code via mvn verify 5. Verified license files / headers 6. Deployed helm chart to test cluster 7. Ran ex

Re: [VOTE] FLIP-322 Cooldown period for adaptive scheduler. Second vote.

2023-08-09 Thread Maximilian Michels
+1 (binding) -Max On Tue, Aug 8, 2023 at 10:56 AM Etienne Chauchot wrote: > > Hi all, > > As part of Flink bylaws, binding votes for FLIP changes are active > committer votes. > > Up to now, we have only 2 binding votes. Can one of the committers/PMC > members vote on this FLIP ? > > Thanks > >

[jira] [Created] (FLINK-32813) Split autoscaler ConfigMap

2023-08-08 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-32813: -- Summary: Split autoscaler ConfigMap Key: FLINK-32813 URL: https://issues.apache.org/jira/browse/FLINK-32813 Project: Flink Issue Type

  1   2   3   4   5   6   7   8   9   >