Hello All,
We have a collection in our cluster which gets a bulk update on a
regular basis.
Lately we are seeing a few cases were the cluster goes down right after
bulk import starts. This is the first exception message in the logs.
o.a.s.u.SolrCmdDistributor Unable to finish sending updates =>
java.io.IOException: Task queue processing has stalled for 20174 ms with 0
remaining elements to process.
at
org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient.blockUntilFinished(ConcurrentUpdateHttp2SolrClient.java:520)
java.io.IOException: Task queue processing has stalled for 20174 ms with 0
remaining elements to process.
at
org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient.blockUntilFinished(ConcurrentUpdateHttp2SolrClient.java:520)
~[?:?]
at
org.apache.solr.update.StreamingSolrClients.blockUntilFinished(StreamingSolrClients.java:91)
~[?:?]
at
org.apache.solr.update.SolrCmdDistributor.blockAndDoRetries(SolrCmdDistributor.java:282)
~[?:?]
at
org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:92)
~[?:?]
at
org.apache.solr.update.processor.DistributedZkUpdateProcessor.doDistribFinish(DistributedZkUpdateProcessor.java:1258)
~[?:?]
at
org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1253)
~[?:?]
at
org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:197)
~[?:?]
at
org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:77)
~[?:?]
at
org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:77)
~[?:?]
at
org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:77)
~[?:?]
at
org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:77)
~[?:?]
at
org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:77)
~[?:?]
at
org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:77)
~[?:?]
at
org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:77)
~[?:?]
at
org.apache.solr.update.processor.UpdateRequestProcessor.finish(UpdateRequestProcessor.java:77)
~[?:?]
at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:110)
~[?:?]
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:226)
~[?:?]
at
org.apache.solr.core.SolrCore.execute(SolrCore.java:2908) ~[?:?]
at
org.apache.solr.servlet.HttpSolrCall.executeCoreRequest(HttpSolrCall.java:875)
~[?:?]
]
Any suggestions on what I can do to fix it?
Thanks,
