Re: Solr eats up all the memory

2022-07-05 Thread Deepak Goel
Not a good software engineering practice to beef up the hardware blindly. Of Course when you have tuned the software to a point where you can't tune anymore, you can then turn your eyes to hardware. Deepak "The greatness of a nation can be judged by the way its animals are treated - Mahatma Gandhi

Re: Solr eats up all the memory

2022-07-05 Thread Charlie Hull
Equally it's not a good management practice to burn engineering hours trying to optimise performance to avoid spending (often much less) money on sufficient hardware to do the job. I've seen this happen many times, sadly. Charlie On 05/07/2022 10:33, Deepak Goel wrote: Not a good software en

Re: Solr eats up all the memory

2022-07-05 Thread Deepak Goel
If you are tearing your hair out on 'Number of Hours' required for tuning your software, it's time you switch to a better quality performance engineer. Deepak "The greatness of a nation can be judged by the way its animals are treated - Mahatma Gandhi" +91 73500 12833 deic...@gmail.com Facebook:

Re: Solr eats up all the memory

2022-07-05 Thread Charlie Hull
I think you're missing my point. Good engineers, even mediocre ones, are expensive, and the great ones are rare. It's a tedious task chasing tiny performance gains when you know you're limited by the hardware and a bored engineer might just go and look for another job. So if you fail to realis

Re: Solr eats up all the memory

2022-07-05 Thread Dave
Exactly. You could have the best engineer on your continent but the end result is the same, more metal. I could build a very fast search server for less than a week of my salary so what’s the point of wasting two weeks trying to solve a problem when the solution is literally just right there, a

Re: solr basic authentication

2022-07-05 Thread Eric Pugh
I submitted a request to add it to the http://solr.cool website, https://github.com/solr-cool/solr-cool.github.io/pull/44 and if you have some ideas on how to add it to the solr admin, let me know. A good discussion/question for the Solr-dev mailing list! > On Jul 4, 2022, at 2:33 PM, Clemen

Re: Solr eats up all the memory

2022-07-05 Thread Deepak Goel
I would also suggest you look at which GC mechanism you use. Increasing RAM and Heap-Size might result in the application freezed for a long time (during GC). Deepak "The greatness of a nation can be judged by the way its animals are treated - Mahatma Gandhi" +91 73500 12833 deic...@gmail.com Fa

Re: Solr eats up all the memory

2022-07-05 Thread Ritvik Sharma
Just Add java memory parameters in solr config which should not be more than 75% of total RAM. and use G1GC. On Tue, 5 Jul 2022 at 4:59 PM, Deepak Goel wrote: > I would also suggest you look at which GC mechanism you use. Increasing RAM > and Heap-Size might result in the application freezed fo

Re: Solr eats up all the memory

2022-07-05 Thread Dave
Also a good rule of thumb I found is set your xmx and xms, maximum and minimum memory for the heap to be exactly the same, you don’t want Java to try to figure it out, > On Jul 5, 2022, at 7:52 AM, Ritvik Sharma wrote: > > Just Add java memory parameters in solr config which should not be mo

Re: Solr eats up all the memory

2022-07-05 Thread Deepak Goel
Do you mind telling us which java version are you using? On Tue, 5 Jul 2022, 17:55 Dave, wrote: > Also a good rule of thumb I found is set your xmx and xms, maximum and > minimum memory for the heap to be exactly the same, you don’t want Java to > try to figure it out, > > > On Jul 5, 2022, at 7

Re: Currency field type with payloads

2022-07-05 Thread Geren White
Hey Jan, Thanks for the suggestion! That would work for us and actually solve some minor issues we've had with the currency field type. On Mon, Jul 4, 2022 at 2:00 PM Jan Høydahl wrote: > Can you let your backend modify the prices at query time through a > FunctionQuery, e.g. mul(price_field,0.

Re: SOLR TRA Collection Question on recovery

2022-07-05 Thread Nikhilesh Jannu
Hi Radu, The issue happened again today and I see huge logs getting created even with the config where we want smaller files and smaller intervals. This happens in a particular scenario where we are trying to index documents. That API call is timing out and there is a connection expectation. The

Re: SE - "EXCEPTION": "Unable to check eq(...) because a null value was found",

2022-07-05 Thread Kojo
I found this e-mail archive https://lists.apache.org/thread/vk3o0zz1w4grcj2chfqcwg8twg8t08gc that seems to be related to this issue, but I did not found any Jira ticket or any other comment. Can you give me some advice? Em seg., 4 de jul. de 2022 às 22:24, Kojo escreveu: > I cannot check equali

Re: Solr eats up all the memory

2022-07-05 Thread Christopher Schultz
Shawn, On 7/4/22 13:31, Shawn Heisey wrote: On 7/4/22 03:01, Mike wrote: My Solr index size is around 500GB and I have 64GB of RAM. Solr eats up all the memory and because of that PHP works very, very slowly. What can I do? Solr is a Java program.  A Java program will never directly use more

Re: SE - "EXCEPTION": "Unable to check eq(...) because a null value was found",

2022-07-05 Thread Joel Bernstein
Here are some null handling examples: https://solr.apache.org/guide/solr/latest/query-guide/transform.html#handling-nulls Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Jul 5, 2022 at 4:44 PM Kojo wrote: > I found this e-mail archive > https://lists.apache.org/thread/vk3o0zz1w4grcj2ch

Re: Solr eats up all the memory

2022-07-05 Thread Gus Heck
Search generally trades memory/disk to achieve speed. Thus it tends to use the available JVM memory, and it also benefits greatly from excess memory that the OS can dedicate to caching disk information. For this reason, while it is certainly *possible* to run solr on the same machine as your PHP se

Re: Solr eats up all the memory

2022-07-05 Thread Shawn Heisey
On 7/5/2022 3:11 PM, Christopher Schultz wrote: Well, if you need more than 32GiB, I think the recommendation is to go MUCH HIGHER than 32GiB. If you have a 48GiB machine, maybe restrict to 31GiB of heap, but if you have a TiB, go for it :) I remember reading somewhere, likely for a different