Re: Checkpointing very large state in RocksDB?

> > This also describes the implications on checkpointing time but please let > me know if I should provide more details. We should probably also add more > description to the documentation for this. > > Cheers, > Aljoscha > > On Wed, 29 Jun 2016 at 23:04 Daniel Li

Re: Switch to skip the stream alignment during a checkpoint?

don't wait for all barriers to align. Example > for checkpoint mode setting is here: > > https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/fault_tolerance.html > > > On Wed, Jun 29, 2016 at 10:58 PM, Daniel Li wrote: > > I am reading Stream Checkpoint

Checkpointing very large state in RocksDB?

When RocksDB holds a very large state, is there a concern over the time takes in checkpointing the RocksDB data to HDFS? Is asynchronous checkpointing a recommended practice here? https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/state_backends.html "The RocksDBStateBackend h

Switch to skip the stream alignment during a checkpoint?

I am reading Stream Checkpointing doc below. But somehow couldn't find that "switch" in any other Apache Flink docs. Has anyone of you tried this switch? https://ci.apache.org/projects/flink/flink-docs-master/internals/stream_checkpointing.html "Flink has a switch to skip the stream alignment du