Re: Stack Overflow Question re compressing broadcast state

Hey, Would be great if you could help with any of that. I could definitely help with reviews. Best, Dawid On 22/11/2022 01:17, Ken Krugler wrote: Hi Dawid, Thanks for following up on this. Let me know if you’d like me to update the documentation, that seems pretty straightforward :) Ad

Re: Stack Overflow Question re compressing broadcast state

Hi Dawid, Thanks for following up on this. Let me know if you’d like me to update the documentation, that seems pretty straightforward :) Adding support for compressing broadcast state feels like something more challenging, but I could take a swing at it if you’d like. Regards, — Ken PS - r

Re: Stack Overflow Question re compressing broadcast state

And yes, I read "Compression works on the granularity of key-groups in keyed state” as meaning “When compressing keyed state, it’s done per key-group” and not “Compression only works on keyed state” :) Totally agree. Docs could definitely be more straightforward about that. I created FLINK-

Re: Stack Overflow Question re compressing broadcast state

Hi Dawid, Thanks for getting back to me. And yes, I read "Compression works on the granularity of key-groups in keyed state” as meaning “When compressing keyed state, it’s done per key-group” and not “Compression only works on keyed state” :) I agree that "KeyedState should be preferred in maj

Re: Stack Overflow Question re compressing broadcast state

Cross posting answer from SO: |BroadcastState| is an operator state not a |KeyedState|. The referenced docs refer to a |KeyedState|: Compression works on the granularity of key-groups in keyed state, Probably docs could be more explicit about this behaviour. Unfortunately as far as I know

Stack Overflow Question re compressing broadcast state

Hi all, Just posted this question on SO: How to enable compression for Flink broadcast state checkpoints Basically it doesn’t look like broadcast state respects the compressed state (checkpoints/savepoints) setting, but I might be reading the c