Aljoscha Krettek created FLINK-3718:
---------------------------------------
Summary: Add Option For Completely Async Backup in RocksDB State
Backend
Key: FLINK-3718
URL: https://issues.apache.org/jira/browse/FLINK-3718
Project: Flink
Issue Type: Bug
Components: Streaming
Reporter: Aljoscha Krettek
Assignee: Aljoscha Krettek
Right now, the snapshotting for RocksDB has a synchronous part where a backup
of the RocksDB database is drawn and an asynchronous part where this backup is
written to HDFS.
We should add an option that uses the snapshot feature of RocksDB to get an
iterator over all keys at a set point in time. The iterator can be used to
store everything to HDFS. Normal operation can continue while we store the
keys. This makes the snapshot completely asynchronous.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)