[ 
https://issues.apache.org/jira/browse/SOLR-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17449074#comment-17449074
 ] 

Atri Sharma commented on SOLR-15715:
------------------------------------

{quote}An important benefit of isolating the cost of query aggregation is that 
while super expensive queries (queries of death) can still take down 
aggregation nodes, but data nodes still continue to function.
{quote}
That is true when the majority of workload is non aggregation. On the other 
hand, if the majority of the workload is aggregation heavy, we are essentially 
creating a skew in the cluster, keeping majority of nodes free and focusing the 
heavy lifting to a few nodes – which will lead to either a set of cascading 
failures or additional nodes, thus pushing up the cost and increasing cluster 
management complexity.

 

I am interested in seeing that kind of a benchmark to see how this solution 
behaves in that situation.

> Dedicated query aggregator nodes in the solr cluster. 
> ------------------------------------------------------
>
>                 Key: SOLR-15715
>                 URL: https://issues.apache.org/jira/browse/SOLR-15715
>             Project: Solr
>          Issue Type: New Feature
>          Components: SearchComponents - other
>    Affects Versions: 8.10.1
>            Reporter: Hitesh Khamesra
>            Priority: Major
>         Attachments: coordinator-poc.jpg, coordinator-poc.pdf, 
> regular-node.jpg, regular-node.pdf
>
>
> We have a large collection with 1000s of shards in the solr cluster. We have 
> observed that distributed solr query takes many resources(thread, memory, 
> etc.) on the solr data node(node which contains indexes). Thus we need 
> dedicated query nodes to execute distributed queries on large solr 
> collection. That would reduce the memory/cpu pressure from solr data nodes.
> Elastis search has similar functionality 
> [here|https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-node.html#coordinating-node]
>  
> [~noble.paul] [~ichattopadhyaya]



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org
For additional commands, e-mail: issues-h...@solr.apache.org

Reply via email to