Thats amazing, because I searched for reasons of bad performance in the last days both for backup (18 hours for a full of 300 GB with 5 million files) and in restores (building the corresponding file tree from my postgres database take more than 10 minutes). One of the first hint I found was to create these indicies you just remove. So I create them, but without any influence corresponding to the performance.
Can anyone tell me: Should these indicies (PathID, FilenameID) be advantageous for the database accesses or not? Or is this depending from database package (mysql, postgres)? Annette Am 01.08.2011 um 17:36 schrieb Gavin McCullagh: > Hi, > > On Mon, 01 Aug 2011, Gavin McCullagh wrote: > >> It looks to me like I should remove the indexes "PathId" and "FilenameID", >> leaving the PRIMARY, JobId and jobid_index. Does that seem correct? > > Oooh. I think I'm close to shouting Eureka. Having dropped those indexes > (indices?), the same restore now takes about 6-7 minutes to build a tree of > 6 million files instead of 25 minutes and more. A 1 million file tree > takes under 2 minutes. This leaves me a little slower than the graph on > the wiki page, but it's manageable nonetheless and is in the same ball park. > > The MYI file for that database has dropped from 4.1GB to 2.8GB. > > gavinmc@cuimhne:~$ sudo ls -lh /var/lib/mysql/bacula/File.MYI > /var/lib/mysql/bacula/File.MYD > -rw-rw---- 1 mysql mysql 6.7G 2011-08-01 15:50 /var/lib/mysql/bacula/File.MYD > -rw-rw---- 1 mysql mysql 2.8G 2011-08-01 15:59 /var/lib/mysql/bacula/File.MYI > > http://wiki.bacula.org/doku.php?id=faq#restore_takes_a_long_time_to_retrieve_sql_results_from_catalog > > It looks like my day is made. Sincere thanks to mnalis who appears to have > put > that entry into the FAQ and to Eric and the others who worked on researching > this :-) > > Gavin > > > ------------------------------------------------------------------------------ > Got Input? Slashdot Needs You. > Take our quick survey online. Come on, we don't ask for help often. > Plus, you'll get a chance to win $100 to spend on ThinkGeek. > http://p.sf.net/sfu/slashdot-survey > _______________________________________________ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users ------------------------------------------------------------------------------ BlackBerry® DevCon Americas, Oct. 18-20, San Francisco, CA The must-attend event for mobile developers. Connect with experts. Get tools for creating Super Apps. See the latest technologies. Sessions, hands-on labs, demos & much more. Register early & save! http://p.sf.net/sfu/rim-blackberry-1 _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
