0At 08:07 PM 5/2/2020, you wrote:
My two cents:
1- Do you have an encrypted filesystem on top of VDO? If yes, you will see
no benefit from dedupe.
2- can you post the stats of vdostats verbose /dev/mapper/xxxxx (replace
with your device)
you can do something like: "vdostats -verbose /dev/mapper/xxxxxxxx | grep
-B6 'save percentage'
On Sat, May 2, 2020 at 9:54 PM david <da...@daku.org> wrote:
> Folks
>
> I'm looking for a solution for backups because ZFS has failed on me
> too many times. In my environment, I have a large amount of data
> <snip>
BTW: I think the 'saving percent' of 13 is
consistent with my computation of 1.16 if one
takes into account the overhead blocks. Is that true?
/dev/mapper/vdo1 :
version : 28
release version : 131337
data blocks used : 783273575
overhead blocks used : 2904168
logical blocks used : 906620366
physical blocks : 1465131008
logical blocks : 9395240960
1K-blocks : 5860524032
1K-blocks used : 3144710972
1K-blocks available : 2715813060
used percent : 53
saving percent : 13
block map cache size : 134217728
write policy : async
block size : 4096
completed recovery count : 0
read-only recovery count : 0
operating mode : normal
recovery progress (%) : N/A
compressed fragments written : 0
compressed blocks written : 0
compressed fragments in packer : 0
slab count : 2793
slabs opened : 1613
slabs reopened : 235
journal disk full count : 0
journal commits requested count : 34097873
journal entries batching : 0
journal entries started : 1880569968
journal entries writing : 0
journal entries written : 1880569968
journal entries committed : 1880569968
journal blocks batching : 0
journal blocks started : 8188291
journal blocks writing : 0
journal blocks written : 8188291
journal blocks committed : 8188291
slab journal disk full count : 0
slab journal flush count : 114673
slab journal blocked count : 0
slab journal blocks written : 746351
slab journal tail busy count : 0
slab summary blocks written : 730308
reference blocks written : 288851
block map dirty pages : 3756
block map clean pages : 29012
block map free pages : 0
block map failed pages : 0
block map incoming pages : 0
block map outgoing pages : 0
block map cache pressure : 0
block map read count : 1138077465
block map write count : 939724573
block map failed reads : 0
block map failed writes : 0
block map reclaimed : 1711
block map read outgoing : 1561
block map found in cache : 1514592207
block map discard required : 1544144
block map wait for page : 561632919
block map fetch required : 32768
block map pages loaded : 1576912
block map pages saved : 1205988
block map flush count : 1122965
dedupe advice valid : 147896569
dedupe advice stale : 225
concurrent data matches : 3387826
concurrent hash collisions : 0
invalid advice PBN count : 0
no space error count : 0
read only error count : 0
instance : 0
512 byte emulation : off
current VDO IO requests in progress : 1
maximum VDO IO requests in progress : 2000
dedupe advice timeouts : 14440
flush out : 317216
write amplification ratio : 0.85
bios in read : 198353413
bios in write : 940041789
bios in discard : 0
bios in flush : 317216
bios in fua : 317215
bios in partial read : 0
bios in partial write : 0
bios in partial discard : 0
bios in partial flush : 0
bios in partial fua : 0
bios out read : 345735015
bios out write : 784844888
bios out discard : 0
bios out flush : 0
bios out fua : 0
bios meta read : 1576973
bios meta write : 14763096
bios meta discard : 0
bios meta flush : 4645639
bios meta fua : 71947
bios journal read : 0
bios journal write : 9285980
bios journal discard : 0
bios journal flush : 1169635
bios journal fua : 71946
bios page cache read : 1576912
bios page cache write : 3442890
bios page cache discard : 0
bios page cache flush : 2236902
bios page cache fua : 0
bios out completed read : 345735014
bios out completed write : 784844888
bios out completed discard : 0
bios out completed flush : 0
bios out completed fua : 0
bios meta completed read : 1576973
bios meta completed write : 12481556
bios meta completed discard : 0
bios meta completed flush : 0
bios meta completed fua : 71947
bios journal completed read : 0
bios journal completed write : 8188291
bios journal completed discard : 0
bios journal completed flush : 0
bios journal completed fua : 71946
bios page cache completed read : 1576912
bios page cache completed write : 2319925
bios page cache completed discard : 0
bios page cache completed flush : 0
bios page cache completed fua : 0
bios acknowledged read : 198353412
bios acknowledged write : 940041789
bios acknowledged discard : 0
bios acknowledged flush : 317216
bios acknowledged fua : 317215
bios acknowledged partial read : 0
bios acknowledged partial write : 0
bios acknowledged partial discard : 0
bios acknowledged partial flush : 0
bios acknowledged partial fua : 0
bios in progress read : 1
bios in progress write : 0
bios in progress discard : 0
bios in progress flush : 0
bios in progress fua : 0
read cache accesses : 0
read cache hits : 0
read cache data hits : 0
KVDO module bytes used : 2038454192
KVDO module peak bytes used : 2038461936
KVDO module bios used : 37286
KVDO module peak bio count : 37574
entries indexed : 66628855
posts found : 147900030
posts not found : 784827215
queries found : 0
queries not found : 0
updates found : 2853
updates not found : 0
current dedupe queries : 0
maximum dedupe queries : 2000
_______________________________________________
CentOS mailing list
CentOS@centos.org
https://lists.centos.org/mailman/listinfo/centos
