Aravindan Vijayan created HDDS-1105:
---------------------------------------

             Summary: Create an OM API that takes in a RocksDB sequence number 
and attempts to return all transactions after that.
                 Key: HDDS-1105
                 URL: https://issues.apache.org/jira/browse/HDDS-1105
             Project: Hadoop Distributed Data Store
          Issue Type: Sub-task
            Reporter: Aravindan Vijayan
            Assignee: Aravindan Vijayan


*Some context*

The FSCK server will periodically invoke this OM API passing in the most recent 
sequence number of its own RocksDB instance. The OM will use the RockDB 
getUpdateSince() API to answer this query. Since the getUpdateSince API only 
works against the RocksDB WAL, we have to configure OM RocksDB WAL 
(https://github.com/facebook/rocksdb/wiki/Write-Ahead-Log) with sufficient max 
size to make this API useful. If the OM cannot get all transactions since the 
given sequence number (due to WAL flushing), it can error out. In that case the 
FSCK server can fall back to getting the entire checkpoint snapshot implemented 
in HDDS-1085.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Reply via email to