Mukul Kumar Singh created HDFS-12099:
----------------------------------------

             Summary: Block Storage: Add flushid in place of timestamp in 
DirtyLog file signatures
                 Key: HDFS-12099
                 URL: https://issues.apache.org/jira/browse/HDFS-12099
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: ozone
    Affects Versions: HDFS-7240
            Reporter: Mukul Kumar Singh
            Assignee: Mukul Kumar Singh
             Fix For: HDFS-7240


If the config  "dfs.cblock.block.buffer.flush.interval.seconds" is set to an 
extremely low value i.e 1 sec. Then multiple dirty logs files are generated 
during block buffer flush with the same timestamp signature.

This can be avoided by keeping a notion of flush id in BlockBuffer manager, 
which can be incremented in BlockBufferManager#triggerBlockBufferFlush.

When block is restarted, then the current flush id can easily be reconstructed 
by comparing the timestamp of all the dirty log files choosing the *max flushid 
+ 1* as the next flush id.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Reply via email to