Re: Kafka transactions drastically limit usability of Flink savepoints

> enabled, the current Flink behaviour shouldn't cause any problems (except for > maybe some logged errors). > > Best, > Piotrek > > wt., 15 lis 2022 o 15:36 Yordan Pavlov napisał(a): >> >> Hi, >> we are using Kafka savepoints as a recovery tool and w

Kafka transactions drastically limit usability of Flink savepoints

Hi, we are using Kafka savepoints as a recovery tool and want to store multiple ones for the past months. However as we use Kafka transactions for our KafkaSink this puts expiration time on our savepoints. We can use a savepoint only as old as our Kafka transaction timeout. The problem is explained

New settings are not honored unless checkpoint is cleared.

Hello there, I am running Flink 1.11.3 on Kubernetes deployment. If I change a setting and re-deploy my Flink setup, the new setting is correctly applied in the config file but is not being honored by Flink. In other words, I can ssh into the pod and check the config file - it has the new setting a

Very slow recovery from Savepoint

Hello there, I am trying to find the solution for a problem we are having in our Flink setup related to very slow recovery from a Savepoint. I have searched in the mailing list, found a somewhat similar problem, the bottleneck there was the HD usage, but I am not seeing this in our case. Here is a