>>>>> On Thu, 22 Nov 2007 09:28:34 +0100, Christian Schneider said: > > > > I there a chance, that this problem went away with an update to the > > > latest 2.2.x version of bacula? > > > > > > A little kick in the right direction would be very appreciated! > > > > What indexes does your catalog have? Maybe it is missing one that > > would make the tree building run faster? > > I have checked that months ago but let's have a look... The attached > indexes.txt contains the actual configuration. Did I miss something? > The catalog contains one year of weekly backkups - every single backup > contains about 800-1000GB of data and about 10 million files.
It looks OK. Even with 10 million files, I would not expect it to take a whole day to build the tree. With PostgreSQL, a tree of 700000 takes about 2 minutes for me. Can you find out what the director/catalog machines are doing? E.g. by running top, vmstat, iostat etc to see if anything is burning CPU, paging or waiting for IO? Is the worst delay before or after it starts printing '+' signs? The time before the '+' signs is while the SQL query is running. It prints '+' signs while reading the results of the query and creating the tree in memory. Is there anything unusual about the files that would make it different from a typical file system backup? E.g. lots of hard links, lots of files with similar names, lots of files in a single directory? > > Have you considered splitting the fileset into several smaller > > filesets? If you have lots of data that never changes much, then > > that could be backed up less often. > > Hmm, not really. There is only one client who is collects the data from > our whole network and does every sunday an export to a seperate > directory. This directory (containing subdirectories of servergroups) > is weekly backed up to tape using bacula. Splitting this directory tree > isn't impossible, but it's also not so simple... Also this could give > us a performancy gain during spooling the small files over gigabit > ethernet... I will think about it. Ah, it sounds tricky. __Martin ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
