-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Tobias Bartel wrote:
> Hello,
>
>> Even with 800,000 files, that sounds very slow. How much data is
>> involved, how is it stored and how fast is your database server?
>
> It's about 70GB of data, stored on a Raid5 (3Ware controller).
>
> The database is a SQLite one, on the same machine but on a Software
> Raid 1.
>
> The backup device is an LTO3 connected via SCSI
>
> OS is a Debian stable.
>
>
> I already thought about moving the Database to MySQL but there is
> already a MySQL Server on the same box, it is a slave for our MySQL
> master and used for hourly Backups of our database (Stop the
> replication, do the backups and start the replication again).
> I don't really like the idea of adding a DB to the Slave that isn't on
> the master, nor do i like the idea of hacking up some custom MySQL
> install that runs parallel caus that will cost me with every future
> update.
>
> To be honest, i didn't expect that SQLite could be the bottle neck, it
> just can't be that slow. What made me think that its the number files,
> is that when i do an ls in that directory it takes ~15min before I see
> any output.
My understanding is that you cannot expect decent performance out of
SQLite for Bacula for any production level backup. I could be wrong
here, but I say forget about SQLite for anything other than a trial, and
definitely not using it for a backup that is extra demanding.
You could use PostgreSQL if you wanted to avoid messing with the slave
server (though something tells me that's not a major worry, but I am not
sure about it), or just run MySQL on a different port which I don't
think is all that hard (or, actually, use it in socket-only mode, which
is even easier and I think would suffice).
- --
---- _ _ _ _ ___ _ _ _
|Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Systems Programmer II
|$&| |__| | | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922)
\__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iD8DBQFJLtgHmb+gadEcsb4RApbKAJ4gTg9fF8susc4iS6e44D9s7uWTxwCg2T/n
hd0IuSIG6mg6J4FPrL/aRz8=
=M8R0
-----END PGP SIGNATURE-----
begin:vcard
fn:Ryan Novosielski
n:Novosielski;Ryan
org:UMDNJ;IST/AST
adr;dom:MSB C630;;185 South Orange Avenue;Newark;NJ;07103
email;internet:[EMAIL PROTECTED]
title:Systems Programmer II
tel;work:(973) 972-0922
tel;fax:(973) 972-7412
tel;pager:(866) 20-UMDNJ
x-mozilla-html:FALSE
version:2.1
end:vcard
-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
