Hi Satya. This instance mostly idling, at that time it were coordinating one request and awaits shard request to complete see https://fastthread.io/same-state-threads.jsp?state=non-daemon&dumpId=1#panel111
https://fastthread.io/same-state-threads.jsp?state=non-daemon&dumpId=1#panel118 that another instance might have some clues in stacktrace. Also, if you have 500 errors there might be exceptions; slow query logging might be enabled and can give more clues for troubleshooting. AFAIK ParallelGC despite its name is quite old and not really performant. On Thu, Dec 8, 2022 at 2:28 PM Satya Nand <satya.n...@indiamart.com.invalid> wrote: > Hi, > > Greetings for the day, > > We are facing a strange problem in Solr cloud where a few requests are > taking hours to complete. Some requests return with a 0 status code and > some with a 500 status code. The recent request took more than 5 hours to > complete with only a 9k results count. > > > These queries create problems in closing old searchers, Some times there > are 3-4 searchers where one is a new searcher and the others are just stuck > because a few queries are tracking hours. Finally, the application slows > down horribly, and the load increases. > > I have downloaded the stack trace of the affected node and tried to analyze > this stack trace online. but I couldn't get many insights from it. > . > > Stack Trace: > > > https://fastthread.io/my-thread-report.jsp?p=c2hhcmVkLzIwMjIvMTIvOC9sb2dzLnR4dC0tMTAtNTUtMzA=&; > > JVM Settings: We are using Parallel GC, can this be causing this much log > pause? > > -XX:+UseParallelGC > -XX:-OmitStackTraceInFastThrow > -Xms12g > -Xmx12g > -Xss256k > > What more we can check here to find the root cause and prevent this from > happening again? > Thanks in advance > -- Sincerely yours Mikhail Khludnev
