Re: [Bacula-users] Slow Attribute spooling

2015-06-13 Thread Denis Witt
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Hi List, thanks to your answers the problem seems to be solved. Attribute despooling of 350MB is done after less than 5 Minutes instead of several hours. I think the following settings did the trick: innodb_flush_log_at_trx_commit = 0 innodb_flus

Re: [Bacula-users] Slow Attribute spooling

2015-06-09 Thread Bill Arlofski
Hi Denis, Did you build Bacula from source, or is this a distribution's official package? The reason I ask is that if you built it from source, and attribute despooling is s-l-o-w, it may be possible (not probable) that batch insertion has been disabled. The configure script has this option (one

Re: [Bacula-users] Slow Attribute spooling

2015-06-09 Thread Josh Fisher
On 6/9/2015 3:49 AM, Denis Witt wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On Mon, 08 Jun 2015 19:13:29 +0100 > Alan Brown wrote: > >> The problem with adding more concurrent jobs (up from one) is that >> the increased seek load will badly affect despooling time. > Well, at lea

Re: [Bacula-users] Slow Attribute spooling

2015-06-09 Thread Alan Brown
On 08/06/15 20:52, Denis Witt wrote: >> You should consider converting to Postgresql if MySQL has grown >> past about 6-10Gb footprint. > > Database is about 2.5Gb. Is there an easy way to convert my Catalog to > use Postgres? mysqldump in compatible mode and then import into postgresql. --

Re: [Bacula-users] Slow Attribute spooling

2015-06-09 Thread Alan Brown
On 08/06/15 21:17, Dimitri Maziuk wrote: > On 06/08/2015 02:52 PM, Denis Witt wrote: > >> Database is about 2.5Gb. Is there an easy way to convert my Catalog to >> use Postgres? > > If you comment out RunAfterJob in BackupCatalog job def you'll get > /var/spool/bacula/bacula.sql. That should be dir

Re: [Bacula-users] Slow Attribute spooling

2015-06-09 Thread Jordi Clariana
If you have InnoDB as default storage engine, can you try to change it to MyISAM? It worked for me: http://bugs.bacula.org/view.php?id=2034 (need registration) Jordi 2015-06-08 12:25 GMT+02:00 Denis Witt : > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On Mon, 08 Jun 2015 11:10:11 +0100 >

Re: [Bacula-users] Slow Attribute spooling

2015-06-09 Thread Denis Witt
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Mon, 08 Jun 2015 19:13:29 +0100 Alan Brown wrote: > The problem with adding more concurrent jobs (up from one) is that > the increased seek load will badly affect despooling time. Well, at least at the moment this isn't a problem. If I understand

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Dimitri Maziuk
On 06/08/2015 02:52 PM, Denis Witt wrote: > Database is about 2.5Gb. Is there an easy way to convert my Catalog to > use Postgres? If you comment out RunAfterJob in BackupCatalog job def you'll get /var/spool/bacula/bacula.sql. That should be directly loadable into postgres bacula db unless mysql

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Denis Witt
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Am 08.06.2015 um 15:44 schrieb Alan Brown: >>> The MySQL-Machine writes more or less constant 450KB/sec. to >>> disk (mysql process). top shows about 20% wait and 76% idle. > That looks like an out-of-memory condition (waits are bad news). > Eithe

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Dimitri Maziuk
On 06/08/2015 01:42 PM, Dimitri Maziuk wrote: > And we ditched tape when sony ditched lto. We decided that crates of > dlts and boxes of ltos and a few scattered dds/dats are quite enough. Sorry, brane fart. AIT. When sony ditched AIT. Boxes of AITs. D'uh. -- Dimitri Maziuk Programmer/sysadmin

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Dimitri Maziuk
On 06/08/2015 01:13 PM, Alan Brown wrote: > On 08/06/15 15:58, Dimitri Maziuk wrote: >> On 2015-06-08 05:25, Denis Witt wrote: >> >>> I'm using normal (7.200 RPM) HDDs. But, as pointed out in >>> my mail, there is only one job running ("despooling Attributes") at the >>> moment. All other jobs are

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Alan Brown
On 08/06/15 15:58, Dimitri Maziuk wrote: > On 2015-06-08 05:25, Denis Witt wrote: > >> I'm using normal (7.200 RPM) HDDs. But, as pointed out in >> my mail, there is only one job running ("despooling Attributes") at the >> moment. All other jobs are still waiting for execution ("waiting on >> max s

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Dimitri Maziuk
On 2015-06-08 05:25, Denis Witt wrote: > I'm using normal (7.200 RPM) HDDs. But, as pointed out in > my mail, there is only one job running ("despooling Attributes") at the > moment. All other jobs are still waiting for execution ("waiting on > max storage jobs"). Did you see my "Fixed: Re: concu

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Bryn Hughes
On 2015-06-08 03:25 AM, Denis Witt wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On Mon, 08 Jun 2015 11:10:11 +0100 > Alan Brown wrote: > >> What are you using for spool disk? > >> If it's not fast SSD then you can't run more than a couple of >> simultaneous backups (you are seek

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Alan Brown
On 08/06/15 11:25, Denis Witt wrote: > On the SD there are about no IO-Operations. iotop shows some 100KB > once in a while. CPU is 100% idle, same on the Director. OK, I missed you were despooling attributes. > The MySQL-Machine writes more or less constant 450KB/sec. to disk > (mysql process).

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Heitor Faria
faria === - Mensagem original - > De: "Denis Witt" > Para: "Alan Brown" > Cc: bacula-users@lists.sourceforge.net > Enviadas: Segunda-feira, 8 de junho de 2015 7:25:58 > Assunto: Re: [Bacula-users] Slow Attribute s

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Denis Witt
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Mon, 08 Jun 2015 11:10:11 +0100 Alan Brown wrote: > What are you using for spool disk? > If it's not fast SSD then you can't run more than a couple of > simultaneous backups (you are seek limited with mechanical drives) Hi Alan, I'm using nor

Re: [Bacula-users] Slow Attribute spooling

2015-06-08 Thread Alan Brown
On 08/06/15 10:39, Denis Witt wrote: > Not only that I wasn't able, yet, to get multiple FDs writing Spool-Data > at the same time, my Backup take several hours longer than before, as > Attribute Spooling is very slow. What are you using for spool disk? If it's not fast SSD then you can't run mo

[Bacula-users] Slow Attribute spooling

2015-06-08 Thread Denis Witt
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi List, recently I turned on "Spool Data" as I was hoping to speed up my Backups using Concurrent Jobs and be nice to my tapes (shoe shinning). Not only that I wasn't able, yet, to get multiple FDs writing Spool-Data at the same time, my Backup take