[ https://issues.apache.org/jira/browse/FLINK-36186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Weijie Guo updated FLINK-36186: ------------------------------- Affects Version/s: 2.1.0 (was: 2.0.0) > Speed up RocksDB close during manual compaction > ------------------------------------------------ > > Key: FLINK-36186 > URL: https://issues.apache.org/jira/browse/FLINK-36186 > Project: Flink > Issue Type: Bug > Components: Runtime / State Backends > Affects Versions: 2.1.0 > Reporter: Yue Ma > Priority: Major > Fix For: 2.0.0 > > > After https://issues.apache.org/jira/browse/FLINK-26050, Flink RocksDB may > schedule manual compaction asynchronously, but if a failover occurs at this > time, RocksDB will need to wait for the manual comparison to complete before > it can close. This may result in a very long time for task cancellation, > affecting the time for task recovery. > {code:java} > // After this function call, CompactRange() or CompactFiles() will not > // run compactions and fail. Calling this function will tell outstanding > // manual compactions to abort and will wait for them to finish or abort > // before returning. > virtual void DisableManualCompaction() = 0; {code} > The solution is relatively simple. We can manually call > _DisabManulCompaction_ during db close to abort the running ManulCompaction, > which can accelerate db close faster. -- This message was sent by Atlassian Jira (v8.20.10#820010)