Re: Search Request Strategy on Solr Cloud

2023-06-19 Thread Charlie Hubbard
There are several parameters to tweak on the lb that may have an impact on your liveness detection. 1. How frequently you poll the health check url. Polling every 15s vs 60s for example. 2. How many failures it takes to remove a node from the pool. 5 failures at 60s intervals means that node w

Re: Search Request Strategy on Solr Cloud

2023-06-19 Thread Saksham Gupta
Thanks Mikhail, will try these approaches. On Thu, Jun 15, 2023 at 5:40 PM Mikhail Khludnev wrote: > From the other POV, a node can be excluded from LB pool via balancer API > before restart and brought back then. > > On Wed, Jun 14, 2023 at 6:09 PM Saksham Gupta > wrote: > > > Have you configu

Re: Search Request Strategy on Solr Cloud

2023-06-15 Thread Mikhail Khludnev
>From the other POV, a node can be excluded from LB pool via balancer API before restart and brought back then. On Wed, Jun 14, 2023 at 6:09 PM Saksham Gupta wrote: > Have you configured an URL for health check? Which one? > The load balancer checks if the solr port is in use or not. If yes, the

Re: Search Request Strategy on Solr Cloud

2023-06-14 Thread Mikhail Khludnev
Right, If healthcheck url is configured to ping handler, one may turn it off from getting traffic before restart via http://.../ping?action=disable . see https://solr.apache.org/docs/9_2_1/core/org/apache/solr/handler/PingRequestHandler.html On Wed, Jun 14, 2023 at 6:09 PM Saksham Gupta wrote:

Re: Search Request Strategy on Solr Cloud

2023-06-14 Thread Saksham Gupta
Have you configured an URL for health check? Which one? The load balancer checks if the solr port is in use or not. If yes, then it continues sending the search requests. Or you have something like rolling restart/recycle scenarios executed? No, we don't have anything like that configured. @ufuk W

Re: Search Request Strategy on Solr Cloud

2023-06-14 Thread Mikhail Khludnev
Saksham, can you comment on > if a certain port is up or not and based on that send the request to that node. Have you configured an URL for health check? Which one? > the coordinator node goes down after a request is sent from lb. Do you mean nodes are failing more often than healthcheck occur?

Re: Search Request Strategy on Solr Cloud

2023-06-13 Thread ufuk yılmaz
Why are they down so often? Isn’t that another problem? — > On 14 Jun 2023, at 08:50, Saksham Gupta > wrote: > > @Ufuk We are using a load balancer to avoid a single point of failure i.e. > if all the requests have a single coordinator node then it would be a major > issue if this solr node go

Re: Search Request Strategy on Solr Cloud

2023-06-13 Thread Saksham Gupta
@Ufuk We are using a load balancer to avoid a single point of failure i.e. if all the requests have a single coordinator node then it would be a major issue if this solr node goes down. @Mikhail Khludnev We already have a health check configured on load balancer, but the requests will fail if the

Re: Search Request Strategy on Solr Cloud

2023-06-13 Thread Mikhail Khludnev
Well, probably it's what Solr Operator can provide on Kubernetes. On Tue, Jun 13, 2023 at 10:47 AM ufuk yılmaz wrote: > Just wondered, solr cloud itself can handle node failings and load > balancing. Why use an external cloud load balancer? > > —ufuk yilmaz > > — > > > On 13 Jun 2023, at 10:28,

Re: Search Request Strategy on Solr Cloud

2023-06-13 Thread ufuk yılmaz
Just wondered, solr cloud itself can handle node failings and load balancing. Why use an external cloud load balancer? —ufuk yilmaz — > On 13 Jun 2023, at 10:28, Mikhail Khludnev wrote: > > Hello > You can configure healthcheck > https://cloud.google.com/load-balancing/docs/health-check-conce

Re: Search Request Strategy on Solr Cloud

2023-06-13 Thread Mikhail Khludnev
Hello You can configure healthcheck https://cloud.google.com/load-balancing/docs/health-check-concepts#criteria-protocol-http with Solr's ping request handler https://solr.apache.org/guide/solr/latest/deployment-guide/ping.html. Also, Google cloud has sophisticated Traffic Director, which can also