Re: maximum searchers registered per replica in solr cloud.

Shawn, After sometime mapped total capacity reached to 100 GB(probably after some commit). Young GC count doubled and server threw out of memory error. Any insights? What we can check to avoid this? On Fri, 7 Oct, 2022, 8:03 pm Satya Nand, wrote: > Shawn, > > Yes earlier I did not find out abo

Re: Node backup using replication

On 10/7/22 10:11, Joe Jones (DHCW - Software Development) wrote: We were on 5.4 "solr.allowPaths" has been configured, without that reference a different error is shown about relative paths. In that case, there does appear to be an actual permission problem.  Solr may not be running under th

Understanding LTR debug query output

Hi, I have implemented LTR (LambdaRank) functionality but there are some search cases where the relevancy is actually getting worse. I am trying to understand why some results are ranked over the others. Naturally, I am using a debug query to understand what is going on. e.g. here is the explain

RE: Node backup using replication

We were on 5.4 "solr.allowPaths" has been configured, without that reference a different error is shown about relative paths. -Original Message- From: Shawn Heisey Sent: 07 October 2022 17:07 To: users@solr.apache.org Subject: Re: Node backup using replication [You don't often get emai

Re: Node backup using replication

On 10/7/22 09:54, Joe Jones (DHCW - Software Development) wrote: We are in the process of migrating our data to a new installation of Solr 9 We see the error Error encountered while creating a snapshot: access denied ("java.io.FilePermission" "D:\Solr\backup\node1" "read") java.security.Acce

Node backup using replication

Hi, We are in the process of migrating our data to a new installation of Solr 9 Part of what we do involves making a daily backup of the node data. Using: localhost:18983/solr/wcrs/replication?command=backup&location=D:\Solr\backup\node1&name=bak

Re: Advice in order to optimise resource usage of a huge server

On 2022-10-07 9:34 AM, Dominique Bejean wrote: Hi Dima, About ZFS, I read this *"In an effort to maximize read/write performance, ZFS uses all available space in RAM to create a huge cache"*. How does it work with MMapDirectory ? No conflict ? ZFS uses half of the available RAM for L1 cache (c

Re: Advice in order to optimise resource usage of a huge server

The ideal jvm size will be influenced by the latency sensitivity of the application. Large VM's are mostly good if you need to hold large data objects in memory, otherwise they fill up with large numbers of small objects and that leads to long GC pauses (GC time relates to the number, not the size

Re: Advice in order to optimise resource usage of a huge server

Hi Dima, About ZFS, I read this *"In an effort to maximize read/write performance, ZFS uses all available space in RAM to create a huge cache"*. How does it work with MMapDirectory ? No conflict ? Regards Dominique Le jeu. 6 oct. 2022 à 17:44, dmitri maziuk a écrit : > On 2022-10-06 2:57 AM

Re: maximum searchers registered per replica in solr cloud.

Shawn, Yes earlier I did not find out about the multiple searchers. I reached to this after debugging a lot. And now i can confirm it was the same searcher when i posted the question first time. I reloaded the collection 15 minutes ago and now the stuck searcher is gone. So i won’t be able to te

Re: maximum searchers registered per replica in solr cloud.

On 10/7/22 07:55, Satya Nand wrote: I guess it is something related to mmap directory implementation of index directory though I could be wrong. That makes sense.  MMAP space is not a count of memory actually taken, just the amount of data that is accessible.  The OS manages how much of that

Re: maximum searchers registered per replica in solr cloud.

Shawn, I just observed that 2nd searcher is not getting closed. It was also there when I originally posted the question. On Fri, 7 Oct 2022 at 7:25 PM, Satya Nand wrote: > Hi Shawn, > > I dont think it was heap size. We have assigned only 8 GB heap size. This > was named as solr mapped total

Re: maximum searchers registered per replica in solr cloud.

Hi Shawn, I dont think it was heap size. We have assigned only 8 GB heap size. This was named as solr mapped total capacity in grafana dashboard . Heap size section was also there where i could see the heap usages based on 8 gb. But gc count and time for this server was high as well. I guess it

Re: Advice in order to optimise resource usage of a huge server

On 10/6/22 15:54, Dominique Bejean wrote: We are starting to investigate performance issues with a new customer. There are several bad practices (commit, sharding, replicas count and types, heap size, ...), that can explain these issues and we will work on it in the next few days. I agree we need

Re: maximum searchers registered per replica in solr cloud.

On 10/7/22 06:23, Satya Nand wrote: Upon checking in the Solr Graphna Dashboard it was found that *Mapped Total Capacity(Jvm Metrices->Buffer size section) *for this particular node was approx double of other servers 54GB vs 28 GB. Further checking in *CORE (Plugin/Stats) *for this particular se

maximum searchers registered per replica in solr cloud.

Hi, We have an 8-node cluster, Where each node contains only 1 replica of PULL time. For the last few hours suddenly we are facing high CPU usage and load on one of the servers (double of the other servers) Upon checking in the Solr Graphna Dashboard it was found that *Mapped Total Capacity(Jvm