Hi,
27.08.2007 12:06,, Tom Sommer wrote::
> Hi,
>
> I was hoping someone had some expert advice regarding a possible Bacula
> setup, in a fairly large scale - I would say Enterprise.
>
> I have around 250+ clients with an average of 20GB per client I need to
> backup. Some clients, such as mailservers, have ~110GB data in small files
> and some webservers have ~30GB of various types of files, not a lot of
> changes in these though.
>
> I have to setup an optimal backup solution, with the goal to have a 7 day
> retention period.
Not the way I would proceed, but I don't know your requirements...
> I have a 10TB storage device (Raw File Storage) (ignore the inconsistency
> between the number of clients and the size of the storage), and have tried
> several ways to optimize the Schedule to prune volumes effectively, but
> I'm not that confident it's optimal.
>
> Basically I am currently using the following settings:
>
> Pool {
> Name = Default
> Pool Type = Backup
> Recycle = yes
> AutoPrune = yes
> Volume Retention = 14 days
> Label Format = File-
> Maximum Volume Bytes = 10g
> # Volume Use Duration = 24h
> # Maximum Volume Jobs = 2
> # Use Volume Once = yes
> }
>
> Schedule {
> Name = "WeeklyCycle"
> Run = Full 1st sun at 23:05
> Run = Differential 2nd-5th sun at 23:05
> Run = Incremental mon-sat at 23:05
> }
>
> Client {
> Name = backupserver-fd
> Address = backupserver
> FDPort = 9102
> Catalog = MyCatalog
> Password = [MASKED]
> File Retention = 7 days
> Job Retention = 1 months
> AutoPrune = yes
> }
>
> My primary concern is after 7 days, I will still have more data stored
> than I actually need to recover files 7 days back.
This can be achieved. You've only got to make sure volumes are
actually purged after they run out of retention.
In your above setup, you've got to limit the number of volumes in the
pool - if it's not limited, Bacula will create new volumes instead of
reusing existing ones (this is by design - the main goal is to have as
much backup data available as possible).
For this to work, you need a reasonable estimate of the actual amount
of data that will need to be stored; after some cycles of prging /
reusing, you can fine-tune your settings.
Typically, I run with automatic volume creation for a while, but after
the retention period has passed for the first volumes, I disable that.
Only when your backup volume increases you'll get messages to create
new volumes for your jobs to commence, which requires minimal manual
intervention.
> I am also worried about running too many FULL backups, because it takes a
> long time to backup 110+GB in ~3 mill. files, sometimes more than 24
> hours, which leads Bacula to spin a full backup twice (since it tries to
> run an incremental without it being able to see a full backup is in
> progress, bug?).
Not exactly, though a known (possible) problem. The easiest
work-around is to run your full backups at the beginning of the
weekend, and not run backups on Sunday and possibly Saturday. This
assumes that this is compliant to your needs, of course.
Otherwise, unfortunately, there's no perfect - i.e. automatic -
solution to the underlying problem.
> Lots of text, hope someone will share their advice.
We've seen longer mails :-) and I'm sure others will have useful
suggestions, too.
Arno
> Thanks a lot.
>
> --
> Tom Sommer
>
>
> -------------------------------------------------------------------------
> This SF.net email is sponsored by: Splunk Inc.
> Still grepping through log files to find problems? Stop.
> Now Search log events and configuration files using AJAX and a browser.
> Download your FREE copy of Splunk now >> http://get.splunk.com/
> _______________________________________________
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Arno Lehmann
IT-Service Lehmann
www.its-lehmann.de
-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
