Dan Langille wrote: > Pascal Clermont wrote: >> Dan Langille wrote: >>> Pascal Clermont wrote: >>>> Hi, >>>> I was reading the archives and stumbled upon "[Bacula-users] >>>> Improving Backup speed" thread which caught my eye since I am having >>>> issues. >>>> we backup over 6TB of small files during a full usually started on >>>> Friday night these are far from being finished on Mondays. the >>>> transfer on the wire is usually finished within 24 hours. >>>> My bottleneck being "Dir inserting Attributes" in my database. I only >>>> have 2.5 Gb of ram on that machine and intend to upgrade by the end >>>> of the month. (so far we intend to upgrade to 8gb of ram) >>>> >>>> Something in the thread caught my eye : >>>> >>>> " >>>> On Thu, 15 Jan 2009 13:31:54 +0100, Bruno Friedmann <br...@ioda-net.ch> >>>> wrote: >>>> I added the following indexes: >>>> >>>> CREATE INDEX File_JobId_idx ON File(JobId); >>>> CREATE INDEX File_PathId_idx ON File(PathId); >>>> CREATE INDEX File_FilenameId_idx ON File(FilenameId); >>>> CREATE INDEX Path_PathId_idx ON Path(PathId); >>>> CREATE INDEX Job_FileSetId_idx ON Job(FileSetId); >>>> CREATE INDEX Job_ClientId_idx ON Job(ClientId); >>>> CREATE INDEX File_FilenameId-PathId_idx ON File(FilenameId,PathId); >>>> .... >>>> .... >>>> It remains to be seen whether the added indexing will impact >>>> insert/update >>>> performance, but I'll take a small performance hit if it means faster >>>> restores and sanity checks. " >>>> >>>> As I am no database expert, Would I benefit from creating these >>>> indexes in order to speed up attributes inserting? >>>> My database is already at 137G in size with only about 3 months of >>>> jobs. I've ran the dbcheck a few times ( which takes ~48 hours to >>>> complete ) but do not feel an improvement once that is done. >>>> >>>> >>>> Any tips/comments concerning improving database insertion would be >>>> greatly appreciated. >>> I don't see any mention of MySQL or PostgreSQL. Which are you using? >> I am using postgresql 8 > > 8.1? 8.3? There are significant differences in performance there IIRC. > > The following query will tell: "select version()" > PostgreSQL 8.3.6 on i686-redhat-linux-gnu, compiled by GCC gcc (GCC) 4.1.2 20071124 (Red Hat 4.1.2-42) This was an RPM install, these are the only default settings changed in postgresql.conf : shared_buffers = 140MB work_mem = 132MB maintenance_work_mem = 240MB max_fsm_pages = 204800
This is with Bacula Version: 2.4.3 (10 October 2008) Pascal S. Clermont ------------------------------------------------------------------------------ This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
