Your rsync script may actually be appropriate for your job, after all. The trick is to use hard links. I don't remember the exact options off the top of my head, but here is approximately what I did in a somewhat similar situation. For this to work, your full and incremental backups must be on the same partition.
FULLBACKUPLOCATION=/mnt/backup INCREMENTALBACKUPLOCATION=/mnt/incremental # make a copy of the full backup, but have cp create hard links instead of physically copying the data cp -R ... $FULLBACKUPLOCATION $INCREMENTALBACKUPLOCATION # Now rsync only those files that have changed. Be sure to also use the option that deletes files that no longer exist rsync ... /home $INCREMENTALBACKUPLOCATION With this scheme, you only need 13TB for the full backup, and 500 GB per day for the hard links and the data that actually changed. As far as bacula goes, I LOVE it, it beats any script hands down. But you will need to rework your requirements a bit to make it work. For that matter, rework your whole backup strategy. Backing up 13 TB will take a lot of time no matter what you do. I'm assuming that most of the data is not going to change much, maybe from some older projects? In that case, archive the old data and never back it up again (or maybe once a year or so). Stay away from USB hard disks! For one, it's FAR too slow. Just the physical data transfer alone will kill you. 13 GB will likely take a week or more. For another, I have had two cases where a USB drive gone bad had prevented a computer from even booting properly. At the very least, use eSATA, and make sure your configuration is hot-pluggable. Also, rethink the tape if you can at all afford the budget. Bacula's support for backing up to disk is kind of an afterthought, and it basically assumes that the disk is fixed and will never be swapped. You can change that, but have to jump through some substantial hoops. On my own system, I do back up to disk (but it's only about 60 GB), and then copy these files to an external drive that I can then take off site. Works very well for me, but I wouldn't want to do that with 13 TB of data. I've heard of others who use rsync to copy the backup files offsite. i...@panterra.nl wrote: > Dear Bacula users, > > I am looking for a backup solution for our company and found bacula on the > net. > We use a linux (centos 4.4) server running samba to serve our domain and > windows clients. > At the moment I have an Iscsi network storage of 4 TB and use the rsync > commands (in a neat script) to create a backup of the drive. > This script excludes the samba Recycle bins. > since we are growing out of our current data store :-o I would like to buy an > 13 TB (raid 6 + hotspare) sata das unit. However using my current script > would need me to have 8 x 13 x 1TB = 104 backup disks :-o, this ofcourse is > not an option. my idea would be a full backup on monday and a incremental > every day to a single 1TB or 2TB drive. > > I would like to have a backup scheme of -Monday -Tuesday -Wednesday -Thursday > Friday1 and Friday2 or so, with minimal amount of external disk to swap. > It would also be important that the data can be stored in a fire safe. > > Can bacula provide me this system, and would this be a good solution ? > Or does bacula provides another solution better for this problem? > > key features of system: > maximum storage of 13 TB. > maximum of 500 Gb changing on a day (exept of some new projects rarely and > not more than 1 TB) > 1 weekly full backup other incremental on smaller disks > external (firesafe) copy > prefferably on a harddisk(usb) (due to the size/prize of tape and/or tape > robot) > expandable over couple of years. > > Some good advise wanted > > Regards Daniel > > The information transmitted is intended only for the person or entity to > which it is addressed and may contain confidential and/or privileged > material. Any review, retransmission, dissemination or other use of, or > taking of any action in reliance upon, this information by persons or > entities other than the intended recipient is prohibited. If you received > this in error, please contact the sender and delete the material from any > computer. > > PanTerra Geoconsultants B.V. > Weversbaan 1-3, Leiderdorp > The Netherlands > > Phone: +31 (0) 71 581 3505 > Fax: +31 (0) 71 301 0802 > Website: <http://www.panterra.nl/> > eMail: d.sie...@panterra.nl i...@panterra.nl > > > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > ------------------------------------------------------------------------ > > _______________________________________________ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- Kevin Keane Owner The NetTech Find the Uncommon: Expert Solutions for a Network You Never Have to Think About Office: 866-642-7116 http://www.4nettech.com This e-mail and attachments, if any, may contain confidential and/or proprietary information. Please be advised that the unauthorized use or disclosure of the information is strictly prohibited. The information herein is intended only for use by the intended recipient(s) named above. If you have received this transmission in error, please notify the sender immediately and permanently delete the e-mail and any copies, printouts or attachments thereof. ------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
