I see QTime values between 3 and 18. And the time it takes till the response is received by the client is around 30 higher. Does that mean that network adds about 30ms to the request?
Thanks in advance. Mihael Mihael Schmidt Software Engineering Bauformat Küchen GmbH & Co. KG Kattwinkel 1 | 32584 Löhne | Deutschland Fon: +495732 102-379 Fax: +495732 102-300 Mail: mschm...@bauformat.de<mailto:mschm...@bauformat.de> Internet: www.bauformat.de<http://www.bauformat.de> [cid:Logo_BAUFORMAT_sw_130px_61b65919-4a79-4edc-a81a-8b84d76dc540.png] Umsatzsteuer-Identifikationsnummer: DE 124323068 - Steuer-Nr.: 310/5705/0461 / Finanzamt Bünde - Handelsregister Bad Oeynhausen HRA 1801 Komplementärin: Bauformat Küchen Verwaltungs GmbH - Handelsregister Bad Oeynhausen HRB 1465 Geschäftsführer: Michael Assner, Matthias Berens, Sabine Brockschnieder [cid:Email_Banner_baumannacademy_dVKH_0c40224c-a938-4563-bfe5-320a024e6fa3.jpg]<https://www.baumannacademy.com/anmelden> Wir erfüllen unsere Informationspflichten zum Datenschutz gem. Artt. 13-14 DS-GVO durch Veröffentlichung auf unserer Internetseite unter: www.bauformat.de/datenschutz<http://www.bauformat.de/datenschutz> oder durch Zusendung auf Ihre formlose Anfrage. Von: Matthias Krüger <mkrue...@opensourceconnections.com> Gesendet: Mittwoch, 4. Dezember 2024 20:41 An: Schmidt, Mihael <mschm...@bauformat.de> Betreff: Re: Solr performance much worse in SolrCloud mode ?! Next things I would investigate: * Is this (at least partially) reproducible outside of this k6 tool, e.g. just sending a few requests using curl? * What does the response look like, is there a difference in Solr's reported QTime between the standalone vs. SolrCloud setup? Good luck Matthias On Tue, Dec 3, 2024 at 2:11 PM Schmidt, Mihael <mschm...@bauformat.de<mailto:mschm...@bauformat.de>> wrote: Hi Matthias, the tests were done with k6 (k6.io<http://k6.io>) from a server which is on the same LAN as all the targeted servers. I did tests with single and multiple virtual users. The results were all the same. Average response time around 50ms from the Solr cluster setup. Request looks like: https://server/solr-cluster/mdm/select?q=clazz%3Axyz%20AND%20businessId%3A320987 The businessId is randomly chosen from 10000 existing ids. So it is not always the same one queried. Each document in the returned JSON has about a dozen attributes and a total of about 400 characters. Hope it helps in analyzing it. Thanks in advance Mihael Mihael Schmidt Software Engineering Bauformat Küchen GmbH & Co. KG Kattwinkel 1 | 32584 Löhne | Deutschland Fon: +495732 102-379 Fax: +495732 102-300 Mail: mschm...@bauformat.de<mailto:mschm...@bauformat.de> Internet: www.bauformat.de<http://www.bauformat.de> Umsatzsteuer-Identifikationsnummer: DE 124323068 - Steuer-Nr.: 310/5705/0461 / Finanzamt Bünde - Handelsregister Bad Oeynhausen HRA 1801 Komplementärin: Bauformat Küchen Verwaltungs GmbH - Handelsregister Bad Oeynhausen HRB 1465 Geschäftsführer: Michael Assner, Matthias Berens, Sabine Brockschnieder Wir erfüllen unsere Informationspflichten zum Datenschutz gem. Artt. 13-14 DS-GVO durch Veröffentlichung auf unserer Internetseite unter: www.bauformat.de/datenschutz oder durch Zusendung auf Ihre formlose Anfrage.<https://www.baumannacademy.com/anmelden> Von: Matthias Krüger <mkrue...@opensourceconnections.com> Gesendet: Dienstag, 3. Dezember 2024 13:12 An: Schmidt, Mihael <mschm...@bauformat.de> Betreff: Re: Solr performance much worse in SolrCloud mode ?!<https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> Hi Mihael,<https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> How did you run these tests? What do your queries look like? A p95 of 2ms seems very low. Results probably come completely from cache and the difference might only be in network latency.<https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> Matthias<https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> On Tue, Dec 3, 2024 at 12:51 PM Schmidt, Mihael <mschm...@bauformat.de> wrote:<https://www.baumannacademy.com/anmelden> Hi all,<https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> We have a standalone Solr instance and want to move to a Solr cluster. We don’t have that many documents in our collection (about 80k) and are very happy with the performance of the standalone Solr instance. We have made some tests with the tool k6 and were surprised.<https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> Solr standalone (Solr 9.6.1) : <https://www.baumannacademy.com/anmelden> http_req_duration..............: avg=1.81ms min=1ms med=1.6ms max=238.55ms p(90)=2.27ms p(95)=2.69ms<https://www.baumannacademy.com/anmelden> http_reqs......................: 31108 1032.228932/s<https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> Solr cluster (Solr 9.7.0):<https://www.baumannacademy.com/anmelden> http_req_duration..............: avg=47.98ms min=7.93ms med=48.15ms max=85.51ms p(90)=51.95ms p(95)=53.09ms<https://www.baumannacademy.com/anmelden> http_reqs......................: 1414 41.417403/s<https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> Both setups have<https://www.baumannacademy.com/anmelden> * a collection with the same documents (about 80k).<https://www.baumannacademy.com/anmelden> * JWT auth configured with the same IDP<https://www.baumannacademy.com/anmelden> * 2GB memory (max heap)<https://www.baumannacademy.com/anmelden> * max file descriptors 1048576<https://www.baumannacademy.com/anmelden> * operating system (Debian Linux 11.5)<https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> The Solr cluster has 3 nodes. The used collection is defined with 1 shard and 3 replicas. On the system of each Solr node is also one Zookeeper node.<https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> Can anybody explain me why the performance is so much worse in SolrCloud mode and how to improve the performance or where to look at?<https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> Thanks in advance.<https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> Mihael<https://www.baumannacademy.com/anmelden> <https://www.baumannacademy.com/anmelden> Mihael Schmidt Software Engineering Bauformat Küchen GmbH & Co. KG Kattwinkel 1 | 32584 Löhne | Deutschland Fon: +495732 102-379 Fax: +495732 102-300 Mail: mschm...@bauformat.de Internet: www.bauformat.de Umsatzsteuer-Identifikationsnummer: DE 124323068 - Steuer-Nr.: 310/5705/0461 / Finanzamt Bünde - Handelsregister Bad Oeynhausen HRA 1801 Komplementärin: Bauformat Küchen Verwaltungs GmbH - Handelsregister Bad Oeynhausen HRB 1465 Geschäftsführer: Michael Assner, Matthias Berens, Sabine Brockschnieder Wir erfüllen unsere Informationspflichten zum Datenschutz gem. Artt. 13-14 DS-GVO durch Veröffentlichung auf unserer Internetseite unter: www.bauformat.de/datenschutz oder durch Zusendung auf Ihre formlose Anfrage.<https://www.baumannacademy.com/anmelden>
