On Friday 09 September 2005 11:07, Kern Sibbald wrote: > On Thursday 08 September 2005 22:33, Arunav Mandal wrote: > > The director is running on xeon 2.8Ghz having 4GB of RAM on Hardware > > Raid0 and the storage demaon is on dual P4 3Ghz having 1GB ram and 1TB > > disk spool(xfs) also on Hardware Raid0. Most of clients are on P4 3gig > > machine with 1Gb ram running linux and windows.At peak there were atleast > > 40Jobs running at the same time. I will give a example of slowness below. > > As you can see the Rate is only at 568.2 KB/s before spooling it was > > around 8000KB/S. At the time of this client backup there were around 10 > > jobs running. > > Can you show us the output for the same job before the spooling was turned > on? If not, can you turn spooling off and run the job again?
Don't have the output now and there were always backups going on so can't really change the config. This remembers what I want to have in the new version of bacula. 1. When jobs are running and bacula for some reason crashes or if I do a restart it remembers and jobs it was running before it crashed or restarted as of now I loose all jobs if I restart it. 2. When spooling and in the midway if client is disconnected for instance a laptop bacula completely discard the spool. It will be nice if it can write that spool to tape so there will be some backups for that client if not all. 3. We have around 150 clients machines it will be nice to have a option to upgrade all the client machines bacula version automatically. 4. Atleast one connection should be reserved for the bconsole so at heavy load I should connect to the director via bconsole which at sometimes I can't 5. Another most important feature that is missing, say at 10am I manually started backup of client abc and it was a full backup since client abc has no backup history and at 10.30am bacula again automatically started backup of client abc as that was in the schedule. So now we have 2 multiple Full backups of the same client and if we again try to start a full backup of client backup abc bacula won't complain. That should be fixed. > > > As you can see this backup took around 7hrs. So my question is > > having latest hardware and enough memory why this is slow and what could > > be done to improve it. > > > > > > 08-Sep 15:47 No prior Full backup Job record found. > > 08-Sep 15:47 No prior or suitable Full backup found. Doing FULL backup. > > 08-Sep 15:47 : Start Backup JobId 1012, > > Job=backup-abc.2005-09-08_15.47.00 07-Sep 15:48 Spooling data ... > > 07-Sep 21:41 Committing spooled data to Volume. Despooling > > 13,235,326,697 bytes ... > > 07-Sep 21:56 Sending spooled attrs to the Director. Despooling > > 122,253,435 bytes ... > > 08-Sep 22:12 Bacula 1.36.3 (22Apr05): 08-Sep-2005 22:12:50 > > JobId: 1012 > > Job: backup-abc.2005-09-08_15.47.00 > > Backup Level: Full (upgraded from Incremental) > > Client: abc-fd > > FileSet: "linux-default" 2005-09-08 00:20:01 > > Pool: "daily" > > Storage: "SDLT6K-1" > > Start time: 08-Sep-2005 15:47:02 > > End time: 08-Sep-2005 22:12:50 > > FD Files Written: 396,170 > > SD Files Written: 396,170 > > FD Bytes Written: 13,151,694,548 > > SD Bytes Written: 13,208,137,447 > > Rate: 568.2 KB/s > > Software Compression: None > > Volume name(s): SDLT005 > > Volume Session Id: 21 > > Volume Session Time: 1126100490 > > Last Volume Bytes: 154,989,306,412 > > Non-fatal FD errors: 0 > > SD Errors: 0 > > FD termination status: OK > > SD termination status: OK > > Termination: Backup OK > > > > > > > > > > ----- Original Message ----- > > From: "Arno Lehmann" <[EMAIL PROTECTED]> > > To: "Arunav Mandal" <[EMAIL PROTECTED]> > > Cc: <bacula-users@lists.sourceforge.net> > > Sent: Thursday, September 08, 2005 9:09 PM > > Subject: Re: [Bacula-users] Slow backups > > > > > Hi, > > > > > > Arunav Mandal wrote: > > >> I am running 1.36.3 on both director and storage deamon and diff. > > >> versions on 150 clients. Recently I started spooling to disk first > > >> then to tape with around 100 concurrent connections for director and > > >> storage deamons. Now the backups seems to take time Rate seems to be > > >> around 700KB/s before spooling and concurrent connections it was > > >> around 8000KB/s. I know too many clients are backing at the same time > > >> is that the reason? > > > > > > I can't follow you here, but yes, having too many clients working > > > concurrently can reduce the overall performance. You've got to find > > > your personal optimal number of concurrent jobs depending on overall > > > network throughput, server power, storage and spool speed - I don't > > > think that it's possible to tell you what the perfect setup is for you. > > > > > >> Also when all the clients start backing up at the same time I can't > > >> log onto the console since there is no free connections left is there > > >> any way I can atleast reserve one connection for the console? > > > > > > Two possible reasons: > > > Not enough connections allowed - change the numer in the config. > > > Server load too high - wait, or, better, have less clients run > > > simultaneously. Remember that each job means a fork and a process, > > > takes memory, cpu time, and loads the catalog database. That's all > > > stuff you need to work on the console, too. > > > > > >> Thx, > > >> > > >> Arunav. > > > > > > Arno > > > > > > > > > -- > > > IT-Service Lehmann [EMAIL PROTECTED] > > > Arno Lehmann http://www.its-lehmann.de > > > > ------------------------------------------------------- > > SF.Net email is Sponsored by the Better Software Conference & EXPO > > September 19-22, 2005 * San Francisco, CA * Development Lifecycle > > Practices Agile & Plan-Driven Development * Managing Projects & Teams * > > Testing & QA Security * Process Improvement & Measurement * > > http://www.sqe.com/bsce5sf > > _______________________________________________ > > Bacula-users mailing list > > Bacula-users@lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/bacula-users -- Arunav Mandal - amandal at trolltech.com Trolltech AS - Waldemar Thranes gt. 98, NO-0175 Oslo, Norway Phone: +47 21 60 27 22, Fax: +47 21 60 48 02 ------------------------------------------------------- SF.Net email is Sponsored by the Better Software Conference & EXPO September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
