Thanks for the reply,
I also use the script you describe (hard links) for a daily (quick retrieval)
backup, but in this case I can`t put my entire backup in the safe.
maybe I should look at a tape robot, (my tought was they were slow ????)
Any ideas of the do`s and dont`s with these tape robots ?
thanks in advance.
Daniel
The information transmitted is intended only for the person or entity to which
it is addressed and may contain confidential and/or privileged material. Any
review, retransmission, dissemination or other use of, or taking of any action
in reliance upon, this information by persons or entities other than the
intended recipient is prohibited. If you received this in error, please contact
the sender and delete the material from any computer.
PanTerra Geoconsultants B.V.
Weversbaan 1-3, Leiderdorp
The Netherlands
Phone: +31 (0) 71 581 3505
Fax: +31 (0) 71 301 0802
Website:
eMail: d.sie...@panterra.nl i...@panterra.nl
-----Original Message-----
From: Kevin Keane [mailto:subscript...@kkeane.com]
Sent: Tuesday, September 01, 2009 11:04 PM
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Backup challenge :-)
Your rsync script may actually be appropriate for your job, after all.
The trick is to use hard links. I don't remember the exact options off
the top of my head, but here is approximately what I did in a somewhat
similar situation. For this to work, your full and incremental backups
must be on the same partition.
FULLBACKUPLOCATION=/mnt/backup
INCREMENTALBACKUPLOCATION=/mnt/incremental
# make a copy of the full backup, but have cp create hard links instead
of physically copying the data
cp -R ... $FULLBACKUPLOCATION $INCREMENTALBACKUPLOCATION
# Now rsync only those files that have changed. Be sure to also use the
option that deletes files that no longer exist
rsync ... /home $INCREMENTALBACKUPLOCATION
With this scheme, you only need 13TB for the full backup, and 500 GB per
day for the hard links and the data that actually changed.
As far as bacula goes, I LOVE it, it beats any script hands down. But
you will need to rework your requirements a bit to make it work. For
that matter, rework your whole backup strategy. Backing up 13 TB will
take a lot of time no matter what you do. I'm assuming that most of the
data is not going to change much, maybe from some older projects? In
that case, archive the old data and never back it up again (or maybe
once a year or so).
Stay away from USB hard disks! For one, it's FAR too slow. Just the
physical data transfer alone will kill you. 13 GB will likely take a
week or more. For another, I have had two cases where a USB drive gone
bad had prevented a computer from even booting properly.
At the very least, use eSATA, and make sure your configuration is
hot-pluggable.
Also, rethink the tape if you can at all afford the budget. Bacula's
support for backing up to disk is kind of an afterthought, and it
basically assumes that the disk is fixed and will never be swapped. You
can change that, but have to jump through some substantial hoops.
On my own system, I do back up to disk (but it's only about 60 GB), and
then copy these files to an external drive that I can then take off
site. Works very well for me, but I wouldn't want to do that with 13 TB
of data. I've heard of others who use rsync to copy the backup files
offsite.
i...@panterra.nl wrote:
Dear Bacula users,
I am looking for a backup solution for our company and found bacula on the net.
We use a linux (centos 4.4) server running samba to serve our domain and
windows clients.
At the moment I have an Iscsi network storage of 4 TB and use the rsync
commands (in a neat script) to create a backup of the drive.
This script excludes the samba Recycle bins.
since we are growing out of our current data store :-o I would like to buy an
13 TB (raid 6 + hotspare) sata das unit. However using my current script would
need me to have 8 x 13 x 1TB = 104 backup disks :-o, this ofcourse is not an
option. my idea would be a full backup on monday and a incremental every day to
a single 1TB or 2TB drive.
I would like to have a backup scheme of -Monday -Tuesday -Wednesday -Thursday
Friday1 and Friday2 or so, with minimal amount of external disk to swap.
It would also be important that the data can be stored in a fire safe.
Can bacula provide me this system, and would this be a good solution ?
Or does bacula provides another solution better for this problem?
key features of system:
maximum storage of 13 TB.
maximum of 500 Gb changing on a day (exept of some new projects rarely and not
more than 1 TB)
1 weekly full backup other incremental on smaller disks
external (firesafe) copy
prefferably on a harddisk(usb) (due to the size/prize of tape and/or tape
robot)
expandable over couple of years.
Some good advise wanted
Regards Daniel
The information transmitted is intended only for the person or entity to which
it is addressed and may contain confidential and/or privileged material. Any
review, retransmission, dissemination or other use of, or taking of any action
in reliance upon, this information by persons or entities other than the
intended recipient is prohibited. If you received this in error, please contact
the sender and delete the material from any computer.
PanTerra Geoconsultants B.V.
Weversbaan 1-3, Leiderdorp
The Netherlands
Phone: +31 (0) 71 581 3505
Fax: +31 (0) 71 301 0802
Website:
eMail: d.sie...@panterra.nl i...@panterra.nl
------------------------------------------------------------------------
------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july
------------------------------------------------------------------------
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Kevin Keane
Owner
The NetTech
Find the Uncommon: Expert Solutions for a Network You Never Have to Think About
Office: 866-642-7116
http://www.4nettech.com
This e-mail and attachments, if any, may contain confidential and/or
proprietary information. Please be advised that the unauthorized use or
disclosure of the information is strictly prohibited. The information herein is
intended only for use by the intended recipient(s) named above. If you have
received this transmission in error, please notify the sender immediately and
permanently delete the e-mail and any copies, printouts or attachments thereof.
------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
