[
https://issues.apache.org/jira/browse/HDDS-13011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Swaminathan Balachandran updated HDDS-13011:
--------------------------------------------
Description:
After snapshot compaction it can so happen that the sst file may not exist in
the snapshot. since the LSM tree structure of the snapshots would have changed
though the contents of the rocksdb is the same. Thus we have to disable the DAG
pruner which deletes output sst files and change snapshot diff to look for the
delta sst file in the AOS rocksdb directory and then look at the backup sst
file directory in the same order for creating a hardlink for the delta sst
files instead of looking at source and target snapshot.
[https://github.com/apache/ozone/blob/413538480154dba6199fcfb95545a0849488af77/hadoop-hdds/rocksdb-checkpoint-differ/src/main/java/org/apache/ozone/rocksdiff/RocksDBCheckpointDiffer.java#L771]
was:After snapshot compaction it can so happen that the sst file may not
exist in the snapshot. since the LSM tree structure of the snapshots would have
changed though the contents of the rocksdb is the same. Thus we have to disable
the DAG pruner which deletes output sst files and change snapshot diff to look
for the delta sst file in the AOS rocksdb directory and then look at the backup
sst file directory in the same order for creating a hardlink for the delta sst
files.
> Disable Snapshot DAG Pruner Thread
> ----------------------------------
>
> Key: HDDS-13011
> URL: https://issues.apache.org/jira/browse/HDDS-13011
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Swaminathan Balachandran
> Priority: Major
>
> After snapshot compaction it can so happen that the sst file may not exist in
> the snapshot. since the LSM tree structure of the snapshots would have
> changed though the contents of the rocksdb is the same. Thus we have to
> disable the DAG pruner which deletes output sst files and change snapshot
> diff to look for the delta sst file in the AOS rocksdb directory and then
> look at the backup sst file directory in the same order for creating a
> hardlink for the delta sst files instead of looking at source and target
> snapshot.
> [https://github.com/apache/ozone/blob/413538480154dba6199fcfb95545a0849488af77/hadoop-hdds/rocksdb-checkpoint-differ/src/main/java/org/apache/ozone/rocksdiff/RocksDBCheckpointDiffer.java#L771]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@ozone.apache.org
For additional commands, e-mail: issues-h...@ozone.apache.org
