Re: Flink Accumulators don't show in Flink history server

2025-04-28 Thread Lu Niu
Thanks Jiadong! Could you elaborate more? I use application mode to run job in yarn, and the yarn application will shutdown right after the flink batch job completed Best Lu On Mon, Apr 28, 2025 at 6:49 PM archzi lu wrote: > hi, Lu Niu > > As a workaround, you could use the following ways to

Re: Flink Accumulators don't show in Flink history server

2025-04-28 Thread archzi lu
hi, Lu Niu As a workaround, you could use the following ways to get the custom accumulator you defined. 1. RestCluserClient#getAccumulators method 2. /jobs/:jobid/accumulators Rest API Best. Jiadong Lu Lu Niu 于2025年4月29日周二 00:41写道: > > I am currently running a Flink job in batch mode and usin

Flink Accumulators don't show in Flink history server

2025-04-28 Thread Lu Niu
I am currently running a Flink job in batch mode and using the Accumulator API to develop some statistics: https://nightlies.apache.org/flink/flink-docs-release-1.7/api/java/index.html?org/apache/flink/api/common/accumulators/class-use/Accumulator.html I expected the job to display the accumulator

Re: Flink 2.0, large state and KeyedCoProcessFunction based stream joins - Async state store questions

2025-04-28 Thread Zakelly Lan
Hi Francis, Actually it is implemented[1,2] but has not been released yet. This allows you to write a customized `KeyedCoProcessFunction` using async state. This will be released in the next version (2.1). It would be great if you could try this out on the master branch of Flink to see if there is

Flink 2.0, large state and KeyedCoProcessFunction based stream joins - Async state store questions

2025-04-28 Thread Francis Altomare
Hi everyone, I have a question regarding the async state store changes introduced with Flink 2.x. Specifically, I'm wondering if it is currently possible or if any work is planned to allow enabling asynchronous state for a custom KeyedCoProcessFunction. From what I understand, this is possible