All,
Background: We have a large tape backup that run on a daily cycle. Individual
files range from a few Kilobytes to tens of Gigabytes. The backup runs
Saturday through Friday. Saturday is the Full backup. Each of the following
days alternate from Differential and Incremental jobs. The Full backup has
approximately 2,413,000 files at 3.6 TB running in about 15 hours. The
Incrementals average 99,000 files at 158 GB in about 3 hours, and the
Differentials are from 92,000 to about 194,000 files at 126 GB to 293 GB in
about 2 hours 25 mins to 3 hours perspectively throughout the week. Due to
time constraints we are not hashing the files (trials with MD5 added several
hours to the full), and we are using hardware (LTO7) compression. Backups are
going nicely, but we need to implement best practice verification.
We currently have a verification process for smaller backup jobs. We have
setup an additional Verify VolumeToCatalog job scheduled to run after the
backup job completes. From what I understand it verifies the hashes in the
catalog to the files in the volume. If there are inconsistencies it errors.
If it does we first attempt to rerun the verification, if it fails twice we
rerun the backup and followup with another verify until success.
With the MD5 hash we do on the files when they are added to the catalog, and
the Verification job we are pretty certain that the files we backed up did
indeed get backed up, and that backup Volume is sound. We are planning
quarterly test restores to verify that that files in that volume can indeed be
restored and those restored files do match the files we backed up.
So I am looking to the community to help with the following questions to save
me from trial and error:
1. Is there a verification job or a sequence of jobs "built in" to Bacula
that can accomplish an automated restore with an automated verification of
Volume to Restore on Disk?
2. Will the VolumeToCatalog job verify Catalog files to the Tape without
first hashing and when hardware compression is in place?
3. Is there a verification job or a sequence of jobs "built in" to Bacula
that can accomplish an automated Restore with an automated Verification of Tape
to Restore on Disk?
4. Are there other options or best practices to accomplish both a post job
verification of Catalog to Volume and a periodic verification of Volume (Tape
or Disk) to Restore on Disk?
5. Is there a Bacula Systems whitepaper that covers best practices for
Verification and Testing of backups?
I have looked into DiskToCatalog this will not work. (someone argue with me).
It will compare files on the client disk to the catalog. After 15 hours +
verification run time many files have changes - archived, reached retention
period and deleted, etc. Ideally, I want a complete restore to different
location and a verification that the files in the Catalog and the Volume are
actually the files on disk after the Restore.
Thank you in advance.
Jim Richardson
CONFIDENTIALITY: This email (including any attachments) may contain
confidential, proprietary and privileged information, and unauthorized
disclosure or use is prohibited. If you received this email in error, please
notify the sender and delete this email from your system. Thank you.
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
