Hi !
My bacula 2.0.1 installation is running quite nicely except for some
servers. I`ll use only one of these as an example as the others have the
same problem.
This one server has to backup more than 5 million files that are very
small (usually less than 2KB). The problem is that the performance
impact backing up these files is enormous.
Here is a little sniplet from the last (unfinished) backup.
Elapsed time: 23 hours 51 mins 42 secs
Priority: 10
FD Files Written: 3,562,070
SD Files Written: 3,561,858
FD Bytes Written: 2,507,509,039 (2.507 GB)
SD Bytes Written: 3,088,552,545 (3.088 GB)
Rate: 29.2 KB/s
At that time the backup ran for almost a complete day and it still has
to backup 2+ million files that make up for about 3 GB of data. As you
can see the rate is VERY slow. I have of course enabled attribute
spooling to take the database out of the equation. Also the backup goes
to diskbased-volumes. It only gets this slow when it gets to the loads
of small files - prior to that the backup rate is perfectly acceptable
with 2MB/s.
The fileset for this server is this:
FileSet {
Name = "X400mta"
Include {
Options {
exclude = yes
wilddir = "/var/tmp"
regexdir = "/var/[cache/man|catman]/[cat?|X11R6/cat?|local/cat?]"
compression=GZIP
signature=SHA1
}
File = /
File = /opt
File = /usr
File = /var
File = /export/home
}
Include {
Options {
regexdir = "/var/[cache/man|catman]/[cat?|X11R6/cat?|local/cat?]"
keepatime=yes
mtimeonly=yes
compression=GZIP
signature=SHA1
}
File = /var/tmp
}
Exclude {
File = .autofsck
File = /proc
File = /tmp
File = .journal
File = /opt/rsi/archive
File = /opt/rsi/spool
File = /opt/x400/mtadata/logfiles
}
}
Any ideas on how to improve performance here ? Can the excludes be a
problem ? Or the Regex ?
Also what influences the performance on migrating data ?
I`ve had migration processes running nicely at 15MB/s (max for
tapedrive) and some go at a measily 1 MB/s - from the same disk-array to
the same tapedrive of course.
Best regards,
Daniel Holtkamp
--
.............................................................
Riege Software International GmbH Fon: +49 (2159) 9148 0
Mollsfeld 10 Fax: +49 (2159) 9148 11
40670 Meerbusch Web: www.riege.com
Germany E-Mail: [EMAIL PROTECTED]
--- ---
Handelsregister: Managing Directors:
Amtsgericht Neuss HRB-NR 4207 Johannes Riege &
USt-ID-Nr.: DE120585842 Gabriele Riege
.............................................................
YOU CARE FOR FREIGHT, WE CARE FOR YOU
transport logistic - june 12-15, 2007
messe muenchen - hall c4, stand 429
begin:vcard
fn:Daniel Holtkamp
n:Holtkamp;Daniel
org:Riege Software International GmbH;IT Infrastructure
adr:;;Mollsfeld 10;Meerbusch;;40670;Germany
email;internet:[EMAIL PROTECTED]
title:System Administrator
tel;work:+49-2159-9148-0
tel;fax:+49-2159-9148-11
url:http://www.riege.com
version:2.1
end:vcard
-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
