How many docs have you added before the softCommit?
Do you use any cache warming or other commit hooks?
Jan
> 28. sep. 2023 kl. 13:28 skrev John Jackson <john382...@gmail.com>:
>
> Hello
>
> We are using Solr 8.9.0. We have configured Solr cloud like 2 shards and
> each shard has one replica. We have used 5 zoo keepers for Solr cloud.
>
> We have used the below schema field in employee collection. <field
> name="id" type="string" indexed="true" stored="true" required="true"
> multiValued="false" docValues="true"/> <dynamicField name="/*" type="text"
> indexed="true" stored="true" multiValued="true"/>
>
>
>
> *Total no of record*: 8562099
> *Size of instance:* solrgnrls2r1----67GB solrgnrls1----66 GB
> solrgnrls1r1----66 GB solrgnrls2----68 GB
>
> *Solr logs:* 2023-09-14 10:04:30.705 DEBUG (qtp1984975621-8805766) [c:forms
> s:shard1 r:core_node3 x:forms_shard1_replica_n1]
> o.a.s.u.DirectUpdateHandler2
> updateDocuments(add{_version_=1777003156686766080,id=EMP5487098118986160})
> 2023-09-14 10:04:30.710 INFO (qtp1984975621-8805766) [c:forms s:shard1
> r:core_node3 x:forms_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory
> [forms_shard1_replica_n1] webapp=/solr path=/update
> params={wt=javabin&version=2}{add=[FORM5487098118986160
> (1777003156686766080)]} 0 5 2023-09-14 10:04:30.807 DEBUG
> (commitScheduler-930-thread-1) [c:employee s:shard1 r:core_node3
> x:employee_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start
> commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
> 2023-09-14 10:04:35.134 DEBUG (commitScheduler-930-thread-1) [c:employee
> s:shard1 r:core_node3 x:employee_shard1_replica_n1]
> o.a.s.s.SolrIndexSearcher Opening
> [Searcher@796ab9b9[employee_shard1_replica_n1]
> main] 2023-09-14 10:04:35.413 DEBUG (commitScheduler-930-thread-1)
> [c:employee s:shard1 r:core_node3 x:employee_shard1_replica_n1]
> o.a.s.u.DirectUpdateHandler2 end_commit_flush
>
>
> Why is the commitScheduler thread taking 5 seconds to complete? Due to
> this, we can not see the latest update for id EMP5487098118986160. We also
> have another collection with an index size of 120 GB and the number of
> documents is 744620373 but still, there is no slowness in the soft commit.
>
> When we checked Solr source code we found that time spent in
> ExitableDirectoryReader.wrap(UninvertingReader.wrap(reader,
> core.getLatestSchema().getUninversionMapper()),SolrQueryTimeoutImpl.getInstance());
> this.leafReader = SlowCompositeReaderWrapper.wrap(this.reader);
>
> How can we troubleshoot the issue?
