mvolikas commented on issue #621: URL: https://github.com/apache/incubator-stormcrawler/issues/621#issuecomment-2561974553
My understanding is the following: - [ConcurrentUpdateHttp2SolrClient](https://solr.apache.org/docs/9_7_0/solrj/org/apache/solr/client/solrj/impl/ConcurrentUpdateHttp2SolrClient.html) is not experimental in version 9.7.0 and seems promising for the `StatusUpdater` and `Inderer` bolts where it can batch updates without changing the way we submit documents. - Regarding querying in the spouts we could use the [requestAsync](https://solr.apache.org/docs/9_7_0/solrj/org/apache/solr/client/solrj/impl/Http2SolrClient.html#requestAsync(org.apache.solr.client.solrj.SolrRequest,java.lang.String)) of the `Http2SolrClient` with futures. - I'm not sure about the benefits of the [CloudSolrClient](https://solr.apache.org/docs/9_7_0/solrj/org/apache/solr/client/solrj/impl/CloudSolrClient.html), to be honest. The API seems to be synchronous from the caller's perspective. Additionally, since we currently have a single node (with multiple shards for the status collection) we will not use any of the automatic routing (e.g. load balancing requests across nodes) and failover (e.g. a node goes down) features. Any thoughts? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@stormcrawler.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
