Docker Image for Solr 8.10.1

2021-10-26 Thread Andreas Hubold
Hi, the docker image for the latest Solr release 8.10.1 is still missing. I'm waiting a bit here, so I tried to help and prepared a pull request: https://github.com/docker-solr/docker-solr/pull/391 I've followed the nicely written upgrade steps from the docker-solr repo, but the travis-ci in

Re: Solr / OpenNLP integrations

2021-10-26 Thread Alexandre Rafalovitch
I feel that it was a bit challenging to get the integration to work for somebody who understood Solr but not as much of OpenNLP. Like some files needed to be added to some directories from somewhere on OpenNLP website.. So clarifying and testing that would be an amazing help. Maybe find a good

Re: boosting specific number of Products

2021-10-26 Thread David Hastings
H, is this a newer thing from solr 8.X? On Tue, Oct 26, 2021 at 4:35 PM Joel Bernstein wrote: > This may be what you're looking for: > > https://solr.apache.org/guide/8_8/query-re-ranking.html > > > Joel Bernstein > http://joelsolr.blogspot.com/ > > > On Thu, Oct 21, 2021 at 2:39 PM sachin g

Re: boosting specific number of Products

2021-10-26 Thread Joel Bernstein
This may be what you're looking for: https://solr.apache.org/guide/8_8/query-re-ranking.html Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Oct 21, 2021 at 2:39 PM sachin gk wrote: > Thanks Dave, if I interpret correctly below expression will only boost top > 20 products which are alre

Re: SOLR Performance on RHEL 7

2021-10-26 Thread Shawn Heisey
On 10/26/21 10:58 AM, Paul Russell wrote: Currently we are averaging about 5.5k requests a minute for this collection that is supported by a 3 node SOLR cluster. RHEL6 (Current Servers) and RHEL 7 (New Servers) are both utilizing OpenJDK8. Older servers have an older version 8.131 new servers ha

Re: SOLR Performance on RHEL 7

2021-10-26 Thread Walter Underwood
How big are the indexes? Improving performance with a smaller heap could mean that the indexes were not fitting in the file buffers. You can verify this by looking at iostats with the different heap sizes. There should be almost no disk reads while Solr is handling queries. If there is disk IO,

Re: SOLR Performance on RHEL 7

2021-10-26 Thread Dave
I have always preferred completely turning off swap on solr dedicated machines, and especially if you can’t use an SSD. > On Oct 26, 2021, at 12:59 PM, Paul Russell wrote: > > Thanks for all the helpful information. > > Currently we are averaging about 5.5k requests a minute for this collect

Re: SOLR Performance on RHEL 7

2021-10-26 Thread Paul Russell
Thanks for all the helpful information. Currently we are averaging about 5.5k requests a minute for this collection that is supported by a 3 node SOLR cluster. RHEL6 (Current Servers) and RHEL 7 (New Servers) are both utilizing OpenJDK8. Older servers have an older version 8.131 new servers have

Solr / OpenNLP integrations

2021-10-26 Thread Jeff Zemerick
Hi all, I'm coming from the Apache OpenNLP project and I'm looking to learn more about the Solr community's use of Solr's OpenNLP integration (language detector, tokenizer, part-of-speech, chunker, lemmatizer, NER). I am especially interested in hearing any recommended improvements that can be mad

Re: SOLR Performance on RHEL 7

2021-10-26 Thread dmitri maziuk
On 2021-10-26 10:24 AM, Shawn Heisey wrote: ... I don't think swap is the problem.  Disabling swap entirely would be a good test to confirm.  For general server use cases, I would not recommend that action, but for dedicated systems with plenty of memory like what is described in this thread, r

Re: SOLR Performance on RHEL 7

2021-10-26 Thread matthew sporleder
On Tue, Oct 26, 2021 at 11:25 AM Shawn Heisey wrote: > > On 10/26/21 8:34 AM, Michael Gibney wrote: > > In my experience, running Solr on CentOS 7 (comparable to RHEL 7) -- on > > VMWare, but "ballooning" was _not_ the issue -- I found that setting > > vm.swappiness=0 or 1 did not actually prevent

Re: SOLR Performance on RHEL 7

2021-10-26 Thread Shawn Heisey
On 10/26/21 8:34 AM, Michael Gibney wrote: In my experience, running Solr on CentOS 7 (comparable to RHEL 7) -- on VMWare, but "ballooning" was _not_ the issue -- I found that setting vm.swappiness=0 or 1 did not actually prevent swapping. Notwithstanding Shawn's excellent suggestions above, if y

Re: SOLR Performance on RHEL 7

2021-10-26 Thread matthew sporleder
On Tue, Oct 26, 2021 at 8:11 AM Paul Russell wrote: > > I have a current SOLR cluster running SOLR 6.6 on RHEL 6 servers. All SOLR > instances use a 25G JVM on the RHEL 6 server configured with 64G of memory > managing a 900G collection. Measured response time to queries average about > 100ms. > >

Re: SOLR Performance on RHEL 7

2021-10-26 Thread Michael Gibney
In my experience, running Solr on CentOS 7 (comparable to RHEL 7) -- on VMWare, but "ballooning" was _not_ the issue -- I found that setting vm.swappiness=0 or 1 did not actually prevent swapping. Notwithstanding Shawn's excellent suggestions above, if you still suspect that swapping is the issue a

Re: Significant performance hit on replication compared to older version

2021-10-26 Thread Dominic Humphries
No problem, I've been trying to get my head around how it all works myself! As per https://solr.apache.org/guide/8_9/working-with-external-files-and-processes.html our schema defines a field type: which is then used to define a field: which pulls data from a file, external_boostvalue, li

Re: SOLR Performance on RHEL 7

2021-10-26 Thread Shawn Heisey
On 10/26/21 6:10 AM, Paul Russell wrote: I have a current SOLR cluster running SOLR 6.6 on RHEL 6 servers. All SOLR instances use a 25G JVM on the RHEL 6 server configured with 64G of memory managing a 900G collection. Measured response time to queries average about 100ms. Congrats on getting t

SOLR Performance on RHEL 7

2021-10-26 Thread Paul Russell
I have a current SOLR cluster running SOLR 6.6 on RHEL 6 servers. All SOLR instances use a 25G JVM on the RHEL 6 server configured with 64G of memory managing a 900G collection. Measured response time to queries average about 100ms. I am attempting to move the cluster to new RHEL 7 servers with th