Sihua Zhou created FLINK-8790:
---------------------------------
Summary: Improve performance for recovery from incremental
checkpoint
Key: FLINK-8790
URL: https://issues.apache.org/jira/browse/FLINK-8790
Project: Flink
Issue Type: Improvement
Components: State Backends, Checkpointing
Affects Versions: 1.5.0
Reporter: Sihua Zhou
Assignee: Sihua Zhou
Fix For: 1.5.0
When there are multi state handle to be restored, we can improve the
performance as follow:
1. Choose the best state handle to init the target db
2. Use the other state handles to create temp db, and clip the db according to
the target key group range (via rocksdb.deleteRange()), this can help use get
rid of the `key group check` in
`data insertion loop` and also help us get rid of traversing the useless
record.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)