Re: Snappy Compression for Checkpoints

2025-04-19 Thread Ferenc Csaky
Hi, The code was already shipped in the 1.18 release, as FLINK-30113 reflects it, but the docs are still not updated. So setting `execution.checkpointing.snapshot-compression` will also compress regular and broadcast operator state. Best, Ferenc On Monday, April 14th, 2025 at 16:02, Prasanna

Re: Snappy Compression for Checkpoints

2025-04-14 Thread Prasanna kumar
Hi all, Is Snappy Compression Enabled for broadcast state ? https://issues.apache.org/jira/browse/FLINK-30113 and FLINK-30112 are marked as closed. Documentation link https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/ops/state/lar

Re: Snappy Compression for Checkpoints

2023-01-09 Thread Martijn Visser
Hi Prasanna, There is no support for compression in operator state. This can be tracked under https://issues.apache.org/jira/browse/FLINK-30113 Best regards, Martijn On Fri, Jan 6, 2023 at 7:53 AM Prasanna kumar wrote: > Hello Flink Community , > > > > We are running Jobs in flink version 1.1

Snappy Compression for Checkpoints

2023-01-05 Thread Prasanna kumar
Hello Flink Community , We are running Jobs in flink version 1.12.7 which reads from Kafka , apply some rules(stored in broadcast state) and then writes to kafka. This is a very low latency and high throughput and we have set up at least one semantics. Checkpoint Configuration Used 1. We