On 3/17/2022 10:18 AM, Baptiste Delbary wrote:
I have a problem with my Solr database. I have a core with around 50 millions
documents (split in 4 shards) and it's extremely slow.
<snip>
<filterCache class="org.apache.solr.search.CaffeineCache" maxRamMB="1000"
autowarmCount="128" />
That right there (specifically the autoWarmCount) is likely the reason
for the slow commits. You've told Solr that anytime it makes a new
searcher (which is required in order to see changes to the index), it
should yank the top 128 entries in the old filterCache and re-execute
those queries against the newly committed index. Uncached filter
queries in general can be slow ... executing up to 128 of them is likely
to be VERY slow.
Normally an all docs query is very very fast. Yours is likely slow
because the system doesn't have enough unallocated memory for the OS to
do a good job of caching the important parts of the on-disk index(es).
You're probably going to need to add memory and/or reduce the heap size
so there is more unallocated memory available for caching purposes.
https://cwiki.apache.org/confluence/display/solr/SolrPerformanceProblems
(disclaimer -- I wrote that wiki page)
FYI - please do not cross-post to multiple lists. The dev list is the
wrong place for this question.
Thanks,
Shawn
