On 1/20/22 5:54 AM, 123456780sss wrote:
However, we've checked the nproc and nofile in our cluster and right now they
are set to 4096 each, unlike the 1024 that was theorized. We will probably try
to raise it to 8192 anyway, but we're not sure that the impact will be as great
as expected initially. Do you think it's still going to solve the issue?
To see what the actual effective limits are on Linux for a running
process, you can do the following command, where NNNNN is the pid of the
process you want to check:
cat /proc/NNNNN/limits
I do not know what options area available for other operating systems.
4096 is probably enough, I just like to allow something higher just in
case it it suddenly needs more to handle a momentary spike in load. I
think the highest thread count I ever saw for a Solr instance when
checking it with jconsole is somewhere in the neighborhood of 1300, on a
large install for the company I was working for at the time. Looking at
the tiny Solr instance I am running for mail server, right now it has 46
threads. I have the system-wide per-user limits for nproc and nofile
set to 8192, far more than I need. The entire system shows 618
threads/processes in use, which is a lot less than I expected to see.
Thanks,
Shawn