On 14/12/15 22:19, Lewis, Dave wrote:
> We are running MySQL, and the database is on the same server as the director.
> The disk that the database is on is a 7200 RPM, 3 Gb/s SATA disk.
What size is your database? ("select count(*) from File;")
What write speeds are you actually achieving to the database drive?
(MB/s and iops - "iostat -kxt 2" will tell you this)
How much ram does the server have?
How much swap?
how much Swap activity is there?
How much swap is in use?
Have you tuned your MySQL?
is MySQL writing lots of temp files?
Are you using MyISAM or InnoDB?
If the MySQL is larger than 8-10 million entries, why aren't you using
Postgresql?
What is the network environment? (speeds? switches? hubs? subnets? Routers?)
700kB/sec is an abysmal rate for backup to disk unless you're running on
10Mb/s thinnet.
Why is it so awful?
Solve that first, THEN look at the attribute despooling issue.
> Thanks,
> Dave
>
>
> -----Original Message-----
> From: Bryn Hughes [mailto:li...@nashira.ca]
> Sent: Monday, December 14, 2015 4:37 PM
> To:bacula-users@lists.sourceforge.net
> Subject: Re: [Bacula-users] Bacula backup speed
>
> Sounds pretty clear that you have some performance issues on your database.
>
> What are you running (MySQL/Postgresql/Sqlite/etc) for your DB? Is it running
> on the same server as your director? What kind of disk storage do you have
> under your database?
>
> Bryn
>
> On 2015-12-14 01:12 PM, Lewis, Dave wrote:
>> Hi,
>>
>> Thanks. I ran it again with attribute spooling. That sped up the backup of
>> data to the disk pool - instead of 6 hours it took less than 2 - but writing
>> the file metadata afterwards took nearly 6 hours.
>>
>> 12-Dec 18:24 jubjub-sd JobId 583: Job write elapsed time = 01:51:55,
>> Transfer rate = 703.0 K Bytes/second 12-Dec 18:24 jubjub-sd JobId 583:
>> Sending spooled attrs to the Director. Despooling 120,266,153 bytes ...
>> 13-Dec 00:11 jubjub-dir JobId 583: Bacula jubjub-dir 5.2.6 (21Feb12):
>> Elapsed time: 7 hours 39 mins 13 secs
>> FD Files Written: 391,552
>> SD Files Written: 391,552
>> FD Bytes Written: 4,486,007,552 (4.486 GB)
>> SD Bytes Written: 4,720,742,979 (4.720 GB)
>> Rate: 162.8 KB/s
>> Software Compression: None
>> Encryption: yes
>> Accurate: no
>>
>> So the transfer rate increased from about 200 KB/s to about 700 KB/s, but
>> the total elapsed time increased.
>>
>> Thanks,
>> Dave
>>
>>
>> -----Original Message-----
>> From: Christian Manal [mailto:moen...@informatik.uni-bremen.de]
>> Sent: Thursday, December 10, 2015 6:14 AM
>> To:bacula-users@lists.sourceforge.net
>> Subject: Re: [Bacula-users] Bacula backup speed
>>
>> On 10.12.2015 01:06, Lewis, Dave wrote:
>>> Does anyone know what's causing the OS backups to be so slow and what
>>> I can do to speed them up?
>> Hi,
>>
>> the problem might be number of files, as in, writing all the file metadata
>> to the catalog could very well be your bottle neck.
>>
>> Try enabling attribute spooling, so all the metadata is collected and
>> commited to the DB in one go instead of file by file.
>>
>>
>> Regards,
>> Christian Manal
>>
>> ----------------------------------------------------------------------
>> -------- _______________________________________________
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>> IMPORTANT NOTICE: This e-mail is meant only for the use of the intended
>> recipient. It may contain confidential information which is legally
>> privileged or otherwise protected by law. If you received this e-mail in
>> error or from someone who is not authorized to send it to you, you are
>> strictly prohibited from reviewing, using, disseminating, distributing or
>> copying the e-mail. PLEASE NOTIFY US IMMEDIATELY OF THE ERROR BY RETURN
>> E-MAIL AND DELETE THIS MESSAGE FROM YOUR SYSTEM. Thank you for your
>> cooperation.
>>
>> ----------------------------------------------------------------------
>> -------- _______________________________________________
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
> ------------------------------------------------------------------------------
> _______________________________________________
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
> IMPORTANT NOTICE: This e-mail is meant only for the use of the intended
> recipient. It may contain confidential information which is legally
> privileged or otherwise protected by law. If you received this e-mail in
> error or from someone who is not authorized to send it to you, you are
> strictly prohibited from reviewing, using, disseminating, distributing or
> copying the e-mail. PLEASE NOTIFY US IMMEDIATELY OF THE ERROR BY RETURN
> E-MAIL AND DELETE THIS MESSAGE FROM YOUR SYSTEM. Thank you for your
> cooperation.
>
> ------------------------------------------------------------------------------
> _______________________________________________
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
------------------------------------------------------------------------------
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
