Soft commit takes 5 seconds in Solr 8.9.0

2025-06-10 Thread Vishal Patel
Hello We are using Solr 8.9.0. We have configured Solr cloud like 2 shards and each shard has one replica. We have used 5 zoo keepers for Solr cloud. We have used the below schema field in employee collection. Total no of record: 8562099 Size of instance: solrgnrls2r167GB solrgnr

Soft commit takes 5 seconds in Solr 8.9.0

2025-05-27 Thread niddhi199...@outlook.com
Hello We are using Solr 8.9.0. We have configured Solr cloud like 2 shards and each shard has one replica. We have used 5 zoo keepers for Solr cloud. We have used the below schema field in employee collection. Total no of record: 8562099 Size of instance: solrgnrls2r167GB solrgnr

Re: Soft commit takes 5 seconds in Solr 8.9.0

2023-10-10 Thread Shawn Heisey
On 10/10/23 05:05, John Jackson wrote: Now for the 20 questions: What OS do you have this running on? --> centos How much physical memory is in the machine? --> 370 GB Is it running anything other than Solr? --> Yes, we have 3 Wildfly applications (each has 50GB memory) and 2 microapps (each has

Re: Soft commit takes 5 seconds in Solr 8.9.0

2023-10-10 Thread John Jackson
Now for the 20 questions: What OS do you have this running on? --> centos How much physical memory is in the machine? --> 370 GB Is it running anything other than Solr? --> Yes, we have 3 Wildfly applications (each has 50GB memory) and 2 microapps (each has 20GB memory). What is the Solr heap size

Re: Soft commit takes 5 seconds in Solr 8.9.0

2023-10-07 Thread Shawn Heisey
On 10/5/23 23:02, John Jackson wrote: Hello, Kindly guide/help us on this. I already shared the requested files. There's nothing that jumps out at me in the config. You should configure caches ... it won't help with commit time but it is likely to speed up queries unless every query your Sol

Re: Soft commit takes 5 seconds in Solr 8.9.0

2023-10-05 Thread John Jackson
Hello, Kindly guide/help us on this. I already shared the requested files. On Tue, Oct 3, 2023 at 10:57 AM John Jackson wrote: > Here is our schema.xml and solarconfig.xml > > > https://drive.google.com/drive/folders/1yQszxxpQESIQN4OtjGbYyBM1WSll6yUP?usp=sharing > > Notes: autoSoftCommit is set

Re: Soft commit takes 5 seconds in Solr 8.9.0

2023-10-02 Thread John Jackson
Here is our schema.xml and solarconfig.xml https://drive.google.com/drive/folders/1yQszxxpQESIQN4OtjGbYyBM1WSll6yUP?usp=sharing Notes: autoSoftCommit is set to 100 ms On Fri, Sep 29, 2023 at 7:23 PM Shawn Heisey wrote: > On 9/29/23 02:57, John Jackson wrote: > >>> but our requirement NRT so w

Re: Soft commit takes 5 seconds in Solr 8.9.0

2023-09-29 Thread Shawn Heisey
On 9/29/23 02:57, John Jackson wrote: but our requirement NRT so we keep 100 milliseconds. 100 milliseconds is a completely unrealistic target for an automatic commit interval. On one Solr install I ran where each core had over 25 million documents, 10 seconds was a typical commit time, and

Re: Soft commit takes 5 seconds in Solr 8.9.0

2023-09-29 Thread John Jackson
There seems to be a typo here with the "}"? >> Yes It is unusual with 100ms commit time, you risk that commits pile up during rapid indexing and cause inefficiencies. I'd increase it to at least 1000ms. >> but our requirement NRT so we keep 100 milliseconds. Can you reproduce this in an IDLE sys

Re: Soft commit takes 5 seconds in Solr 8.9.0

2023-09-28 Thread Jan Høydahl
> 100} There seems to be a typo here with the "}"? It is unusual with 100ms commit time, you risk that commits pile up during rapid indexing and cause inefficiencies. I'd increase it to at least 1000ms. Can you reproduce this in an IDLE system by simply adding ONE document? What does your docu

Re: Soft commit takes 5 seconds in Solr 8.9.0

2023-09-28 Thread John Jackson
How many docs have you added before the softCommit? >> only one record EMP5487098118986160 added. Do you use any cache warming or other commit hooks? >> No we are not using any cache and our commit for solr config below 60 2 false 100} We are indexing via zoo keeper and do not comm

Re: Soft commit takes 5 seconds in Solr 8.9.0

2023-09-28 Thread Jan Høydahl
How many docs have you added before the softCommit? Do you use any cache warming or other commit hooks? Jan > 28. sep. 2023 kl. 13:28 skrev John Jackson : > > Hello > > We are using Solr 8.9.0. We have configured Solr cloud like 2 shards and > each shard has one replica. We have used 5 zoo keep

Soft commit takes 5 seconds in Solr 8.9.0

2023-09-28 Thread John Jackson
Hello We are using Solr 8.9.0. We have configured Solr cloud like 2 shards and each shard has one replica. We have used 5 zoo keepers for Solr cloud. We have used the below schema field in employee collection. *Total no of record*: 8562099 *Size of instance:* solrgnrls2r167GB solrgnrls1-