On Wed, Apr 07, 2010 at 09:58:51AM -0700, ebollengier wrote: > > > ebollengier wrote: > > > > > > Graham Keeling wrote: > >> > >> On Wed, Apr 07, 2010 at 08:22:09AM -0700, ebollengier wrote: > >>> I tweaked my test to compare both queries, and it shows no difference > >>> with > >>> and without base job part... If you want to test queries on your side > >>> with > >>> your data, you can download my tool (accurate-test.pl) on > >>> http://bacula.git.sourceforge.net/git/gitweb.cgi?p=bacula/docs;a=tree;f=docs/techlogs;hb=HEAD > >>> > >>> If you can tweak my script to reproduce your problem, i would be able to > >>> fix > >>> things. > >>> > >>> http://old.nabble.com/file/p28166612/diff-with-without-basejob.png > >> > >> I'm currently running your script to generate the test database. I think > >> that is going to take a long time, so I'll leave it overnight. > >> > >> > > > > This is your first problem, on my server (just a workstation), it takes > > less > > than 10s to add 200,000 records... > > > > > > In fact, it's 4seconds, here... > > JobId=15 files=20000 > Insert takes 4secs for 200000 records > JobId=16 files=50000 > Insert takes 11secs for 500000 records > JobId=20 files=200000 > Insert takes 43secs for 2000000 records
I was running these three simultaneously, as described in the script. I assume that fill_table.pl is the same as docs_techlogs_accurate-test.pl. # filename=1 ./fill_table.pl & # path=1 ./fill_table.pl & # file=1 ./fill_table.pl & However, I was also not running it on the machine that I did my original tests on because it didn't have pwgen and the perl DBD-mysql thing installed. But I have installed them now, so I will switch back to that machine. Running one instance looks comparable with yours: tserv tmp # file=1 docs_techlogs_accurate-test.pl JobId=1 files=20000 Insert takes 9secs for 200000 records JobId=2 files=20000 Insert takes 6secs for 200000 records JobId=3 files=20000 Insert takes 8secs for 200000 records JobId=4 files=20000 (but I think it is still going to take some time) ------------------------------------------------------------------------------ Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
