Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-12-03 Thread Jose Ildefonso Camargo Tolosa
Hi! On Wed, Dec 3, 2008 at 10:46 AM, Tobias Bartel <[EMAIL PROTECTED]> wrote: > Hello, > > sorry for my late response. > > I just finished migrating the catalog to a Postgre 8.1 Server and > enabled spooling. Spooling space is 100GB, the horror directory only > 70GB. I hope that both changes will

Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-12-02 Thread Tobias Bartel
Hello, sorry for my late response. I just finished migrating the catalog to a Postgre 8.1 Server and enabled spooling. Spooling space is 100GB, the horror directory only 70GB. I hope that both changes will give us a speed bump, well the Postgre should increase the performance and the spool dir sh

Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-12-02 Thread Tobias Bartel
Hello, thx for the suggestion, its defnitly worth a shot. Sooner or later we will need a script to sort the files anyway ;) cya tobi Am Freitag, den 28.11.2008, 04:50 -0800 schrieb Kevin Keane: > This might be a totally off-the-wall idea, might not even work - or > if > it does, it may not he

Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-11-28 Thread Alan Brown
On Thu, 27 Nov 2008, Tobias Bartel wrote: > The database is a SQLite one, on the same machine but on a Software > Raid 1. SQLite is really oinly intended for testing, not production systems. Switch to postgres or mysql, things should improve. --

Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-11-28 Thread Kevin Keane
Tobias Bartel wrote: > Hello, > > >> Even with 800,000 files, that sounds very slow. How much data is >> involved, how is it stored and how fast is your database server? >> > > It's about 70GB of data, stored on a Raid5 (3Ware controller). > > The database is a SQLite one, on the same mach

Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-11-28 Thread Kevin Keane
This might be a totally off-the-wall idea, might not even work - or if it does, it may not help in the end. But how about doing your own "subdirectorying". Leave all 800,000 files in the directory where they are - and create your own parallel directory structure with subdirectories as you like.

Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-11-27 Thread Jesper Krogh
Tobias Bartel wrote: >> Even with 800,000 files, that sounds very slow. How much data is >> involved, how is it stored and how fast is your database server? > > It's about 70GB of data, stored on a Raid5 (3Ware controller). > > The database is a SQLite one, on the same machine but on a Software

Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-11-27 Thread Ryan Novosielski
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Tobias Bartel wrote: > Hello, > >> Even with 800,000 files, that sounds very slow. How much data is >> involved, how is it stored and how fast is your database server? > > It's about 70GB of data, stored on a Raid5 (3Ware controller). > > The datab

Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-11-27 Thread Jesper Krogh
Tobias Bartel wrote: > Hello, > > i am tasked to set up daily full backups of our entire fax communication > and they are all stored in one single director ;). There are about > 800.000 files in that directory what makes accessing that directory > extremely slow. The target device is a LTO3 tape d

Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-11-27 Thread Tobias Bartel
Hello, > Even with 800,000 files, that sounds very slow. How much data is > involved, how is it stored and how fast is your database server? It's about 70GB of data, stored on a Raid5 (3Ware controller). The database is a SQLite one, on the same machine but on a Software Raid 1. The backup de

Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-11-27 Thread Arno Lehmann
Hi, 27.11.2008 17:10, Tobias Bartel wrote: > Hello, > > i am tasked to set up daily full backups of our entire fax communication > and they are all stored in one single director ;). There are about > 800.000 files in that directory what makes accessing that directory > extremely slow. The target

Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-11-27 Thread James Cort
Tobias Bartel wrote: > Hello, > > i am tasked to set up daily full backups of our entire fax communication > and they are all stored in one single director ;). There are about > 800.000 files in that directory what makes accessing that directory > extremely slow. The target device is a LTO3 tape d

[Bacula-users] Backup of in one directory with 800.000 files

2008-11-27 Thread Tobias Bartel
Hello, i am tasked to set up daily full backups of our entire fax communication and they are all stored in one single director ;). There are about 800.000 files in that directory what makes accessing that directory extremely slow. The target device is a LTO3 tape drive with an 8 slots changer. Wi