Silver Salonen wrote: > Hello. > > As keeping multiple full backups of the whole data is a very expensive task, > I > think it's wise to minimize the size of full backups. The simple idea for > doing that is to separate files/folders into "active" and "inactive" ones. > Active files/folders would then get backed up into multiple full volumes, but > inactive files would be held in one copy only, eg. by doing only incremental > backups. If the amounts are smth like 1TB for active files and 2TB for > inactive files, the save would be noticeable (2TB times the number of full > backups) :) > > The question about Bacula is that is there any way for achieving this without > scripting filesets? Currently I've done it with simple find-script, but > lately > I tried it on a server having about 1TB of data - when I let the script to > exclude every old file from the fileset, the incremental job would last about > 16 hours, even though the backup itself was only 1GB. I guess it's because > the > enormous amount of old files. > Is it the script itself that runs that long, or does bacula take that long to process the output from the script?
If it is the script itself: maybe you can cache the results of the script in some form? Have the script generate a text file, and the next time it runs, read it back in. Or run the script as a cron job independent of bacula store the output in a file, and then use that. If it is bacula itself that takes that long, then you need to find a better way to exclude these files. Is there a way you can move the inactive files into a different directory tree? If not: think about creating a completely separate directory for current files. Create links (hard or soft - hard links are probably better here) from that directory to the original current files. Exclude the full original data directory from the backup, and back up only this "shadow". > I've been trying to create a smart ruby-script that would build the optimal > list of all the old files/folders to be excluded, but it turned out to be > much > more difficult I initially expected. > > Is anyone else doing smth like that? > -- Kevin Keane Owner The NetTech Find the Uncommon: Expert Solutions for a Network You Never Have to Think About Office: 866-642-7116 http://www.4nettech.com This e-mail and attachments, if any, may contain confidential and/or proprietary information. Please be advised that the unauthorized use or disclosure of the information is strictly prohibited. The information herein is intended only for use by the intended recipient(s) named above. If you have received this transmission in error, please notify the sender immediately and permanently delete the e-mail and any copies, printouts or attachments thereof. ------------------------------------------------------------------------------ Register Now & Save for Velocity, the Web Performance & Operations Conference from O'Reilly Media. Velocity features a full day of expert-led, hands-on workshops and two days of sessions from industry leaders in dedicated Performance & Operations tracks. Use code vel09scf and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users