Re: [Koha-devel] search speed

Dear Fridolin, I see C4/Context.pm dbh no mysql_use_result options, We can try it. but it maybe modify koha SQL statement. http://search.cpan.org/~capttofu/DBD-mysql-4.011/lib/DBD/mysql.pm This attribute forces the driver to use mysql_use_result rather than mysql_store_result. The former is f

Re: [Koha-devel] search speed

Le 28/05/2015 12:52, Tomas Cohen Arazi a écrit : El 28/5/2015 4:43 a. m., "Fridolin SOMERS" escribió: Could this mean one should not get records from Zebra but directly from database ? If getting the id of search results without getting the full record is possible. It is possible. But we s

Re: [Koha-devel] search speed

At 07:52 AM 5/28/2015 -0300, Tomas Cohen Arazi wrote: El 28/5/2015 4:43 a. m., "Fridolin SOMERS" escribió: > > Could this mean one should not get records from Zebra but directly from database ? If getting the id of search results without getting the full record is possible. It is possibl

Re: [Koha-devel] search speed

El 28/5/2015 4:43 a. m., "Fridolin SOMERS" escribió: > > Could this mean one should not get records from Zebra but directly from database ? If getting the id of search results without getting the full record is possible. It is possible. But we should evaluate the trade-off from preparing the reco

Re: [Koha-devel] search speed

Could this mean one should not get records from Zebra but directly from database ? If getting the id of search results without getting the full record is possible. Le 27/05/2015 21:02, Paul A a écrit : At 08:29 PM 5/27/2015 +0200, Gaetan Boisson wrote: Well as i said, the time is not the same

Re: [Koha-devel] search speed

At 08:29 PM 5/27/2015 +0200, Gaetan Boisson wrote: Well as i said, the time is not the same depending on the number of results, but in both cases, the number of results is anyway much higher than the number of records taken into consideration for facets. Your investigation indicates that: In

Re: [Koha-devel] search speed

Well as i said, the time is not the same depending on the number of results, but in both cases, the number of results is anyway much higher than the number of records taken into consideration for facets. Your investigation indicates that: In ZOOM->record, the time is spent in my $_rec = Net:

Re: [Koha-devel] search speed

Gaetan, have a look at the metrics on bug 13665. 2015-05-27 11:45 GMT+01:00 Gaetan Boisson : > Hello again all, > > looking at speed issues there is one thing that i don't understand, and i > feel some well versed developpers might have a better idea of what is > happening. > > If you query zebra

[Koha-devel] search speed

Hello again all, looking at speed issues there is one thing that i don't understand, and i feel some well versed developpers might have a better idea of what is happening. If you query zebra directly on the server, it's blazingly fast, no matter how big your database and how many results yo

Re: [Koha-devel] Search speed

At 07:16 PM 2/4/2015 -0300, Tomas Cohen Arazi wrote: For a fair comparison you should set facetNumRecs = 20 in zebradb/zebra-biblios-dom.xml. Because otherwise use_zebra_facets=0 is only processing the first 20 records, against 1000 from use_zebra_facets=1. Thanks for the suggestion. All tests

Re: [Koha-devel] Search speed

At 10:03 AM 2/5/2015 +0100, Jonathan Druart wrote: I have filled bug 13665 yesterday http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=13665 Thanks. I had come to that same conclusion concerning resultset_record (see my email 9 Jan to this list.) For anyone wanting to start chasing this

Re: [Koha-devel] Search speed

I have filled bug 13665 yesterday http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=13665 2015-02-04 22:22 GMT+01:00 Paul A : > At 02:02 PM 2/2/2015 +, Tomas Cohen Arazi wrote: >> >> Paul, while you are running your tests, could you please compare this both >> scenarios: >> - 1 >> - 0 >

Re: [Koha-devel] Search speed

For a fair comparison you should set facetNumRecs = 20 in zebradb/zebra-biblios-dom.xml. Because otherwise use_zebra_facets=0 is only processing the first 20 records, against 1000 from use_zebra_facets=1. Regarding the amount of statements/function calls, I don't think they mean too much. Some thi

Re: [Koha-devel] Search speed

At 02:02 PM 2/2/2015 +, Tomas Cohen Arazi wrote: Paul, while you are running your tests, could you please compare this both scenarios: - 1 - 0 Thanks PS: I have found that searchResults is too slow too. I have posted notes, results and some NYTProf examples at

Re: [Koha-devel] Search speed

the numbers (a bit of a struggle, > NYTProf doesn't appear to like multi-threading.) > > Best -- Paul > > > >GPML, > >Mark Tompsett > > > >-Original Message- From: Paul A > >Sent: Friday, January 30, 2015 3:19 PM > >To: Fridolin SOME

Re: [Koha-devel] Search speed

Fridolin SOMERS schreef op vr 30-01-2015 om 17:40 [+0100]: > You can launch Zebra multi-threaded using : > zebrasrv -T From the documentation: -T Operate the server in threaded mode. The server creates a thread for each connection rather than a fork a process. Only available

Re: [Koha-devel] Search speed

7;ll do a bug/enhancement myself with all the numbers (a bit of a struggle, NYTProf doesn't appear to like multi-threading.) Best -- Paul GPML, Mark Tompsett -Original Message- From: Paul A Sent: Friday, January 30, 2015 3:19 PM To: Fridolin SOMERS ; koha-devel@lists.koha-communit

Re: [Koha-devel] Search speed

.koha-community.org Subject: Re: [Koha-devel] Search speed At 05:40 PM 1/30/2015 +0100, Fridolin SOMERS wrote: You can launch Zebra multi-threaded using : zebrasrv -T Fridolin - merci mille fois -- first impressions are most positive. I'll try and find time later today to quantify the results and p

Re: [Koha-devel] Search speed

At 05:40 PM 1/30/2015 +0100, Fridolin SOMERS wrote: You can launch Zebra multi-threaded using : zebrasrv -T Fridolin - merci mille fois -- first impressions are most positive. I'll try and find time later today to quantify the results and put them in context of my previous tests. [vi /usr/

Re: [Koha-devel] Search speed

You can launch Zebra multi-threaded using : zebrasrv -T Le 30/01/2015 02:59, Robin Sheat a écrit : Paul A schreef op do 29-01-2015 om 19:39 [-0500]: Facets appear to have a huge overhead in various components of Zebra, to the point where a single core of a multiple processor CPU gets overwhelme

Re: [Koha-devel] Search speed

Paul A schreef op do 29-01-2015 om 19:39 [-0500]: > Facets appear to have a huge overhead in various components of Zebra, > to > the point where a single core of a multiple processor CPU gets > overwhelmed, > but does not share the load with other totally idle cores. That's not how multiprocesso

[Koha-devel] Search speed

I have progressed a little further on this subject using multiple parallel tests for from 0 to ~25k biblios on a new, relatively fast server. In brief: 3.08 averages 0.88 secs per search 3.18 averages 5.06 secs for the same searches, but... 3.18 averages only 1.52 secs if I turn off facets. Fac