JVM Metaspace for Task Mangers and Job Managers are not getting released.

2023-05-12 Thread Ajinkya Pathrudkar
Hello, I am observing JVM Metaspace memory for Task Managers and Job Manager is not getting released. Any thoughts? [image: image.png] Thanks, Ajinkya

Re: How to know when a pipeline ends

2023-05-12 Thread Luke Xiong
Hi Weihua and Shammon, Thanks for the pointers.I tried both, unfortunately neither works. By enabling "execution.attached", there doesn't seem to be any difference than the default settings. doSomeCleanupTasks() is called right away while the pipeline is still running; and env.executeAsync().getJ

Re: akka.remote.OversizedPayloadException after we upgrade to Flink 1.15

2023-05-12 Thread Yang LI
Hi wei, I had a similar issue when I changed from FlinkKafkaConsumer to KafkaSource. In my case, I had the _metadata size increase inside the checkpoint. I have tried to rollback to the old flink version with the old checkpoint/savepoint, and then change the uid of the flink kafka source and sink

Re: StatsdMetricsReporter is emitting all metric types as gauges

2023-05-12 Thread Chesnay Schepler
nit: Whether the Flink counter abstraction is cumulative or not is irrelevant w.r.t. what we send to metric backends. For example, for Datadog we do send count diffs instead of the current total count. On 10/05/2023 09:33, Hang Ruan wrote: Hi, Iris, The Flink counter is cumulative. There ar

Re: Flink Job Failure for version 1.16

2023-05-12 Thread neha goyal
Hi Everyone, can someone please shade some light when the Checkpoint Coordinator is suspending Error comes and what should I do to avoid this? it is impacting the production pipeline after the version upgrade. It is related to resource crunch in the pipeline? Thank You On Thu, May 11, 2023 at 10:3