FsStateBackend vs RocksDBStateBackend

2020-01-29 Thread Ran Zhang
choosing between these 2 stateBackend.* Our checkpoint size is 200 - 300 GB in stable state. For now we know one benefits of RocksDB is it supports incremental checkpoint, but would love to know what else we are losing in choosing FsStateBackend. Thanks a lot! Ran Zhang

Re: FsStateBackend vs RocksDBStateBackend

2020-01-30 Thread Ran Zhang
, Jan 29, 2020 at 6:37 PM Tzu-Li (Gordon) Tai wrote: > Hi Ran, > > On Thu, Jan 30, 2020 at 9:39 AM Ran Zhang wrote: > >> Hi all, >> >> We have a Flink app that uses a KeyedProcessFunction, and in the function >> it requires a ValueState(of TreeSet) and the proc