Thanks for driver this flip,I think have some question about this flip

   - Can we select the compression format, for example? such as snappy or
   lz0
   - If compression format is supported, I think the metadata will probably
   have to include which compression format

and I agree idea with Dawid

Dawid Wysakowicz <dwysakow...@apache.org> 于2023年1月18日周三 20:55写道:

> It makes sense from my side.
>
> Could you, just for completeness, extend it with the info what will be
> the compression unit? If understand it correctly you envision each state
> to be compressed separately.
>
> Best,
>
> Dawid
>
> On 17/01/2023 15:47, Etienne Chauchot wrote:
> > Hi everyone,
> >
> > I just published a new FLIP to introduce operator state compression
> > (1). This feature is pretty straightforward to implement, so a PR is
> > already under review (2) but it appeared during the review that to be
> > able to insure backward compatibility of the operator state snapshots,
> > we needed to modify the snapshot format hence the FLIP.
> >
> > Please tell me if you have any thoughts about it.
> >
> >
> > [1]
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-290+Operator+state+compression
> >
> >
> > [2] https://github.com/apache/flink/pull/21636
> >
> >
> > Best,
> >
> > Etienne
> >
>


-- 
Best

ConradJam

Reply via email to