Cross posting answer from SO:|BroadcastState| is an operator state not a |KeyedState|. The referenced docs refer to a |KeyedState|:
Compression works on the granularity of key-groups in keyed state, Probably docs could be more explicit about this behaviour.Unfortunately as far as I know there is no compression for OperatorState. I am not 100% sure, but I believe it's just has never been implemented, because we did not want to invest in it, as |KeyedState| should be preferred in majority of cases.
Best, Dawid On 16/11/2022 23:27, Ken Krugler wrote:
Hi all,Just posted this question on SO: How to enable compression for Flink broadcast state checkpoints <https://stackoverflow.com/q/74466988/231762?sem=2>Basically it doesn’t look like broadcast state respects the compressed state (checkpoints/savepoints) setting, but I might be reading the code wrong.Hoping someone (like Dawid Wysakowicz) can chime in here, thanks! — Ken -------------------------- Ken Krugler http://www.scaleunlimited.com Custom big data solutions Flink, Pinot, Solr, Elasticsearch
OpenPGP_0x31D2DD10BFC15A2D.asc
Description: OpenPGP public key
OpenPGP_signature
Description: OpenPGP digital signature
