Now for the 20 questions: What OS do you have this running on? --> centos How much physical memory is in the machine? --> 370 GB Is it running anything other than Solr? --> Yes, we have 3 Wildfly applications (each has 50GB memory) and 2 microapps (each has 20GB memory). What is the Solr heap size? --> 100 GB memory assign to solr Are you running more than one Solr instance on a single machine? --> Yes, we are using two instances of Solr in one machine. We have 2 shard 2 replicas so one shard and the other shard replica are running on this server. How big are all the index cores on a single machine? --> 700 GB(solr instance one 303GB & second instance 379 GB) Looking for Max Doc, Num Docs, and on-disk size Max Doc --> 5913435 Num Docs --> 4330880 on-disk size --> 84.32 GB
On Sat, Oct 7, 2023 at 9:22 PM Shawn Heisey <apa...@elyograg.org.invalid> wrote: > On 10/5/23 23:02, John Jackson wrote: > > Hello, > > > > Kindly guide/help us on this. I already shared the requested files. > > There's nothing that jumps out at me in the config. > > You should configure caches ... it won't help with commit time but it is > likely to speed up queries unless every query your Solr receives is > entirely unique. Be careful that you don't set autowarmCount too high > ... that slows down commits. On a big install I managed, I set > autowarmCount on the filterCache to 4 ... and commits could still > sometimes take 15 seconds to complete. > > As I said before, 100 milliseconds is COMPLETELY unrealistic. I would > personally set autoSoftCommit maxTime to at LEAST 30000. Jan's > recommendation is at least 1000 ... I think that's also unrealistic. > > Depending on a bunch of things including how big your index is, 5 > seconds may not be all that bad for a commit time. > > Now for the 20 questions: > > What OS do you have this running on? How much physical memory is in the > machine? Is it running anything other than Solr? What is the Solr heap > size? Are you running more than one Solr instance on a single machine? > How big are all the index cores on a single machine? Looking for Max > Doc, Num Docs, and on-disk size ... all of these are found on the core > overview in the admin UI. > > There may be more questions depending on what the answers to those > questions reveal. > > I am working my way towards getting a screenshot of the process list. > See this URL: > > > https://cwiki.apache.org/confluence/display/solr/solrperformanceproblems#SolrPerformanceProblems-Askingforhelponamemory/performanceissue > > Thanks, > Shawn > >
