Hi, as I know mmbackup creates a local shadow db (data on SP server) and uses it with the policy engine to identify candidate files for backup without requests to the SP server. In the process of backup, the policy engine creates temporary files with fs metadata and then compares it with shadow db, performing simultaneous sorting and distribution by nodes. If the database is out of sync, the copy results will not be correct. The shadow db can be synchronized with SP server using the option mmbackup --rebuild and in fact you are doing just that but manually and without error correction.
Regards, Efim > 9 сент. 2022 г., в 15:01, Martin Lischewski <m.lischew...@fz-juelich.de> > написал(а): > > Hello everyone, > > it is my first time posting to this group, so I am sorry if this > question is to trivial. > > We are using mmbackup to backup our Spectrum Scale filesystems. Because > of some bad experience in the past we do not trust the output of mmbackup. > > Therefore we wrote our own scripts validating the backup state of our > filesystems. Basically this is what we are doing: > > We compare the output of a policy run by gpfs policy engine on the > filesystem with the output of: `dsmc query backup -subdir=yes -quiet > <filesystem_mountpoint>` > > The policy engine listing all files is relatively fast. The `dsmc q ba` > takes way longer. (3 hours for roughly 36_000_000 entries.) > > Can you recommend me a faster way to list all files which are in backup? > > Regards, > > Martin > > > > > > ------------------------------------------------------------------------------------------------ > ------------------------------------------------------------------------------------------------ > Forschungszentrum Juelich GmbH > 52425 Juelich > Sitz der Gesellschaft: Juelich > Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498 > Vorsitzender des Aufsichtsrats: MinDir Volker Rieke > Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender), > Karsten Beneke (stellv. Vorsitzender), Prof. Dr. Astrid Lambrecht, > Prof. Dr. Frauke Melchior > ------------------------------------------------------------------------------------------------ > ------------------------------------------------------------------------------------------------