It makes sense from my side.Could you, just for completeness, extend it with the info what will be the compression unit? If understand it correctly you envision each state to be compressed separately.
Best, Dawid On 17/01/2023 15:47, Etienne Chauchot wrote:
Hi everyone,I just published a new FLIP to introduce operator state compression (1). This feature is pretty straightforward to implement, so a PR is already under review (2) but it appeared during the review that to be able to insure backward compatibility of the operator state snapshots, we needed to modify the snapshot format hence the FLIP.Please tell me if you have any thoughts about it.[1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-290+Operator+state+compression[2] https://github.com/apache/flink/pull/21636 Best, Etienne
OpenPGP_0x31D2DD10BFC15A2D.asc
Description: OpenPGP public key
OpenPGP_signature
Description: OpenPGP digital signature
