Thank you all for the suggestions.
I will try to profile and find the bottleneck.
I am getting the following exception which I understand may be due to the
multiterm field expansion for the wildcard query. Please correct me if I am
wrong.
*The request took too long to iterate over doc values.*
T
On 3/27/2022 5:30 AM, Modassar Ather wrote:
The wildcard queries are executed against the text data and yes there are a
huge number of possible expansions of the wildcard query.
All the 12 shards are on a single machine with 521 GB memory and each shard
is started with SOLR_JAVA_MEM="-Xmx30g". So
I agree with Shawn about ideally wanting more memory for the OS.
That said, the WordDelimiterFilter config you sent aligns with my suspicion
that "graph phrase" issues are likely to explain the difference between 6.5
and 8.11. At query-time, WordDelimiterFilter (and also equally
WordDelimiterGraph
Thanks for your replies.
Yes, adding more physical memory will help but in the current situation
even the GC settings which we have used may not be the optimal one. Can you
please provide some suggestions on GC settings?
We are also planning to add more shards and create smaller indexes per
shard
On 3/27/2022 1:20 PM, Modassar Ather wrote:
Just to add one point, even the queries without the wildcards e.g. a
boolean query or a query with 1 ids ORed has also become slow and it is
also taking more CPU and finally ending up taking more time.
I understand this is due to many GC pauses so i
