Solr memory issue- Solr version 8.11.2

2025-03-21 Thread Anuj Bhargava
Got the following message from my server people. Need help with the solr
memory issue. Solr version 8.11.2







*Solr is using the next highest CPU and is the highest memory user on the
server.Solr is using more than 3 times the memory of MySQL.Solr and MySQL
are the highest memory users by a wide margin. The Apache logs show
"scoreboard is full, not at MaxRequestWorkers.Increase ServerLimit."
Increasing the Apache Server limit is an option, but with the extremely
high memory usage, increasing it may cause more server issues.*
The solr.in.sh has the following settings.

SOLR_PID_DIR="/var/solr"
SOLR_HOME="/var/solr/data"
LOG4J_PROPS="/var/solr/log4j2.xml"
SOLR_LOGS_DIR="/var/solr/logs"
SOLR_PORT="8983"
SOLR_JAVA_MEM="-Xms24g -Xmx24g"
SOLR_HEAP="32g"
SOLR_OPTS="$SOLR_OPTS -Dsolr.disable.shardsWhitelist=true"
SOLR_TIMEZONE="UTC"

My server config is -

128GB DDR4 RAM
2x2TB Storage
Software RAID-1
NVMe SSD
Xeon® E-2388G*
8 Core / 16 Thread


Re: Solr memory issue- Solr version 8.11.2

2025-03-21 Thread Dmitri Maziuk

On 3/21/25 08:47, Anuj Bhargava wrote:

Got the following message from my server people. Need help with the solr
memory issue. Solr version 8.11.2

...

I doubt that means anything to anybody.

What are your -Xms and -Xms JVM options? Total Java memory will be a bit 
over -Xmx but not by much. What does Solr dashboard say? What does Solr 
log say?


Dima



Curious About the Spark-Solr Project

2025-03-21 Thread Vincenzo D'Amore
Hi all,

I’ve been looking into the Spark-Solr project (
https://github.com/lucidworks/spark-solr) and noticed that the last commit
was made almost two years ago. It seems like the project hasn’t been active
for a while, and I was wondering if anyone knows what’s going on.

Could it be that the developers have moved on to a new project that somehow
includes or builds upon Spark-Solr? Or has it officially been retired or
replaced with something else? Or maybe the focus has shifted to other
priorities? I’d love to hear about any updates or insights you might have.

Thanks so much for your time—looking forward to hearing from you!

Best,
Vincenzo

-- 
Vincenzo D'Amore


Re: Curious About the Spark-Solr Project

2025-03-21 Thread Robi Petersen
lucidworks has spark bundled into their fusion platform as part of a
proprietary solution, and it's prolly working good enough for them at this
point. ie new dev work only as required.

On Fri, Mar 21, 2025 at 9:08 AM Vincenzo D'Amore  wrote:

> Hi all,
>
> I’ve been looking into the Spark-Solr project (
> https://github.com/lucidworks/spark-solr) and noticed that the last commit
> was made almost two years ago. It seems like the project hasn’t been active
> for a while, and I was wondering if anyone knows what’s going on.
>
> Could it be that the developers have moved on to a new project that somehow
> includes or builds upon Spark-Solr? Or has it officially been retired or
> replaced with something else? Or maybe the focus has shifted to other
> priorities? I’d love to hear about any updates or insights you might have.
>
> Thanks so much for your time—looking forward to hearing from you!
>
> Best,
> Vincenzo
>
> --
> Vincenzo D'Amore
>