[Discuss][Flink-31326] Flink autoscaler code

2024-01-02 Thread Yang LI
is? Regards, Yang LI

Re: [Discuss][Flink-31326] Flink autoscaler code

2024-01-02 Thread Yang LI
ian Michels > > Best, > Rui > > On Tue, Jan 2, 2024 at 11:03 PM Yang LI wrote: > > > Hello, > > > > I see we have 2 times the same condition check in the > > function getNumRecordsInPerSecond (L220 > > < > > > https://githu

Flink pending record metric weired after autoscaler rescaling

2024-01-08 Thread Yang LI
etric for pending records, especially when different partitions exhibit varying lags. This discrepancy might be causing the pending record metric to malfunction. I would appreciate your insights on these observations. Best regards, Yang LI

Re: Flink pending record metric weired after autoscaler rescaling

2024-01-10 Thread Yang LI
;Discovered new partitions:", and only then does the consumption of data from partition-10 recommence. Could you provide any insights or hypotheses regarding the underlying cause of this delayed recognition and processing of certain partitions? Best regards, Yang On Mon, 8 Jan 2024 at 16:24, Yan

Re: Flink pending record metric weired after autoscaler rescaling

2024-01-12 Thread Yang LI
related to the issue reported here? > https://issues.apache.org/jira/browse/FLINK-34063 > > Gyula > > On Wed, Jan 10, 2024 at 4:04 PM Yang LI wrote: > > > Just to give more context, my setup uses Apache Flink 1.18 with the > > adaptive scheduler enabled, issues h

Flink autoscaler scaling report

2024-01-18 Thread Yang LI
Hello dear flink community, I noticed that there's a scaling report feature (specifically, the strings defined in AutoscalerEventHandler) in the Flink operator autoscaler. However, I'm unable to find this information in the Flink operator logs. Could anyone guide me on how to access or visualize t

ARM flink docker image

2024-03-14 Thread Yang LI
Dear Flink Community, Do you know if we have somewhere a tested ARM based flink docker image? I think we can already run locally on an ARM macbook. But we don't have a ARM specified docker image yet. Regards, Yang LI

Flink 1.18.2 release date

2024-05-30 Thread Yang LI
Dear Flink Community, Anyone know about the release date for 1.18.2? Thanks very much, Yang

Re: Blue/Green Deployments support for Flink

2024-12-09 Thread Yang LI
Hello Sergio and Jose, Apologies for jumping into the conversation. I’m very interested in what you’ve learned about blue/green Flink deployments. I’m currently working on a project aimed at achieving no-downtime Flink deployments, so your insights would be highly valuable. Thank you, Yang

Re: Flink 1.18.2 release date

2025-02-14 Thread Yang LI
> Hi Yang > > IIRC, 1.18.2 has not been kicked off yet. > > Best regards, > > Weijie > > > Yang LI 于2024年5月30日周四 22:33写道: > > > Dear Flink Community, > > > > Anyone know about the release date for 1.18.2? > > > > Thanks very much, > > Yang > > >

[jira] [Created] (FLINK-33966) Fix the getNumRecordsInPerSecond Utility Function

2024-01-02 Thread Yang LI (Jira)
Yang LI created FLINK-33966: --- Summary: Fix the getNumRecordsInPerSecond Utility Function Key: FLINK-33966 URL: https://issues.apache.org/jira/browse/FLINK-33966 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-34096) Upscale of kafka source operator leads to some splits getting lost

2024-01-15 Thread Yang LI (Jira)
Yang LI created FLINK-34096: --- Summary: Upscale of kafka source operator leads to some splits getting lost Key: FLINK-34096 URL: https://issues.apache.org/jira/browse/FLINK-34096 Project: Flink

[jira] [Created] (FLINK-34563) Autoscaling decision improvement

2024-03-01 Thread Yang LI (Jira)
Yang LI created FLINK-34563: --- Summary: Autoscaling decision improvement Key: FLINK-34563 URL: https://issues.apache.org/jira/browse/FLINK-34563 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-36377) Support the use of the LAST_VALUE aggregate function on ROW type data

2024-09-26 Thread Yang Li (Jira)
Yang Li created FLINK-36377: --- Summary: Support the use of the LAST_VALUE aggregate function on ROW type data Key: FLINK-36377 URL: https://issues.apache.org/jira/browse/FLINK-36377 Project: Flink