I get about ~20 MB/s from my fastest storage, so that's 1200 MB/min, or 1.2 GB/min. You're pulling 300MB/min, or 5 MB/s.
So you might be a touch slow. I have a maximum of 4 jobs running on any given storage device, however, and usually during fulls on the weekend I've got no more than 4 jobs running at any given time anyway. Here's my setup: bacula-dir: Sun v20z (dual Opt, 4g ram) running CentOS 4.1 (RHEL clone). Tape Storage: Either Quantum SDLT/160 Autoloader or Overland LXB SDLT/110 changer for large jobs, hanging off an U320 MPT SCSI PCI-X controller. My spool device is a set of random SCSI disks, mostly old 50 giggers, in a striped software raid. About 400G. They're on a PCI 33mhz controller, a Symbios something-or-other. Nothing special. All gigabit to major servers. All in all I've got about 80 clients, Windows, Solaris, and Linux. A few OSF/1 also. I've ran about 3500 jobs, and have totalled about 17 TB over the past... 2 1/2 months I've been production with Bacula. (I secretly hope that wins me some sort of "Biggest Bacula" award) Suggestions: 1) Solaris storage-d was *very slow*. It's Solaris's fault. Try a linux storage-d, see what happens. My Linux clients always outpace everything else, even given the same hardware. Go ahead and shoot for 1.37.40 as well. 2) It's Virtuozzo, also. I've got a set of VMWare ESX servers, same hardware as the director. They go about 5 MB/s to disk, which GZIP compression on, when I'd expect 20 MB/s from a plain Linux install without GZIP. Not much can be done about that, really. (this is the VMWare itself - the linux underpinnings, not the virtual machines, backing up). If those 65 virtual machines all have load on each server, I'm amazed they're that fast at all. If you're backing up to disk, drop GZIP once and see how it goes. If you're going straight to tape, you're pretty much at the limit then. That's a lot of virtualization. Mark On Thu, Oct 13, 2005 at 03:56:57PM -0700, Lyle Vogtmann wrote: > Hello fellow Bacula users! > > I've only been lurking on this list for a little while, please excuse > me if this topic has been covered previously. > > I've got what I would consider a large network of machines each > hosting many virtual private servers with Virtuozzo. > http://www.swsoft.com/en/products/virtuozzo/ (19 servers, each > hosting an average of 65 virtual environments, average 160GB data per > server. Total data to back up ~ 3TB. Generous estimate to allow for > growth.) > > I've been tasked with replacing an aging Amanda install that has been > backing them up to disk daily. > > I've done some testing already with a couple of the servers, and have > recently started a backup of all systems. Ran into a small problem > with the catalog where the File table grew to 4GB and claimed to be > full, easily fixed by switching from MyISAM to the InnoDB engine. It > got me thinking though, are there any other "gotchas" or caveats > anyone else has overcome in backing up such a large quantity of data? > > We have a gigabit Ethernet network over which the backups are run, but > it still seems to take an inordinate amount of time to complete a full > backup. Currently filling a two gigabyte volume every 6 minutes on > average. At that rate, it will take 6 days to finish a full backup?! > Maybe I'm doing the math wrong (I already know I haven't taken > compression into account), but I think I'm missing something. > > Comments and suggestions welcome! Thanks for such a great project! > (It's backing up my home network of 3 Macs handily!) > > Oh yeah: > Director is running on a FreeBSD 5.4 box, all other clients are Linux. > Bacula version 1.36.3 compiled from source (ports tree on director). > > Thanks in advance, > Lyle Vogtmann > > > ------------------------------------------------------- > This SF.Net email is sponsored by: > Power Architecture Resource Center: Free content, downloads, discussions, > and more. http://solutions.newsforge.com/ibmarch.tmpl > _______________________________________________ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users ------------------------------------------------------- This SF.Net email is sponsored by: Power Architecture Resource Center: Free content, downloads, discussions, and more. http://solutions.newsforge.com/ibmarch.tmpl _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
