[ 
https://issues.apache.org/jira/browse/SOLR-8251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115281#comment-15115281
 ] 

Stephan Lagraulet commented on SOLR-8251:
-----------------------------------------

When Solr5 is under heavy load yourkit reports some deadlocks, not sure if it 
is real deadlocks or if it is the monitoring overhead:
Frozen threads found (potential deadlock)
{code}
It seems that the following threads have not changed their stack for more than 
10 seconds.
These threads are possibly (but not necessarily!) in a deadlock or hung.
 
qtp1983747920-155 <--- Frozen for at least 2m 18 sec
org.apache.lucene.uninverting.FieldCacheImpl$Cache.get(LeafReader, 
FieldCacheImpl$CacheKey, boolean) FieldCacheImpl.java:187
org.apache.lucene.uninverting.FieldCacheImpl.getDocTermOrds(LeafReader, String, 
BytesRef) FieldCacheImpl.java:933
org.apache.lucene.uninverting.UninvertingReader.getSortedSetDocValues(String) 
UninvertingReader.java:275
org.apache.lucene.index.FilterLeafReader.getSortedSetDocValues(String) 
FilterLeafReader.java:454
org.apache.lucene.index.DocValues.getSortedSet(LeafReader, String) 
DocValues.java:302
org.apache.lucene.search.SortedSetSortField$1.getSortedDocValues(LeafReaderContext,
 String) SortedSetSortField.java:125
org.apache.lucene.search.FieldComparator$TermOrdValComparator.getLeafComparator(LeafReaderContext)
 FieldComparator.java:767
org.apache.lucene.search.FieldValueHitQueue.getComparators(LeafReaderContext) 
FieldValueHitQueue.java:183
org.apache.lucene.search.TopFieldCollector$SimpleFieldCollector.getLeafCollector(LeafReaderContext)
 TopFieldCollector.java:164
org.apache.lucene.search.MultiCollector.getLeafCollector(LeafReaderContext) 
MultiCollector.java:121
org.apache.lucene.search.IndexSearcher.search(List, Weight, Collector) 
IndexSearcher.java:812
org.apache.lucene.search.IndexSearcher.search(Query, Collector) 
IndexSearcher.java:535
org.apache.solr.search.SolrIndexSearcher.buildAndRunCollectorChain(SolrIndexSearcher$QueryResult,
 Query, Collector, SolrIndexSearcher$QueryCommand, DelegatingCollector) 
SolrIndexSearcher.java:202
org.apache.solr.search.SolrIndexSearcher.getDocListAndSetNC(SolrIndexSearcher$QueryResult,
 SolrIndexSearcher$QueryCommand) SolrIndexSearcher.java:1768
org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher$QueryResult,
 SolrIndexSearcher$QueryCommand) SolrIndexSearcher.java:1487
org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher$QueryResult, 
SolrIndexSearcher$QueryCommand) SolrIndexSearcher.java:557
org.apache.solr.handler.component.QueryComponent.process(ResponseBuilder) 
QueryComponent.java:525
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SolrQueryRequest,
 SolrQueryResponse) SearchHandler.java:273
org.apache.solr.handler.RequestHandlerBase.handleRequest(SolrQueryRequest, 
SolrQueryResponse) RequestHandlerBase.java:156
org.apache.solr.core.SolrCore.execute(SolrRequestHandler, SolrQueryRequest, 
SolrQueryResponse) SolrCore.java:2073
org.apache.solr.servlet.HttpSolrCall.execute(SolrQueryResponse) 
HttpSolrCall.java:658
org.apache.solr.servlet.HttpSolrCall.call() HttpSolrCall.java:457
org.apache.solr.servlet.SolrDispatchFilter.doFilter(ServletRequest, 
ServletResponse, FilterChain, boolean) SolrDispatchFilter.java:222
org.apache.solr.servlet.SolrDispatchFilter.doFilter(ServletRequest, 
ServletResponse, FilterChain) SolrDispatchFilter.java:181
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletRequest, 
ServletResponse) ServletHandler.java:1652
org.eclipse.jetty.servlet.ServletHandler.doHandle(String, Request, 
HttpServletRequest, HttpServletResponse) ServletHandler.java:585
org.eclipse.jetty.server.handler.ScopedHandler.handle(String, Request, 
HttpServletRequest, HttpServletResponse) ScopedHandler.java:143
org.eclipse.jetty.security.SecurityHandler.handle(String, Request, 
HttpServletRequest, HttpServletResponse) SecurityHandler.java:577
org.eclipse.jetty.server.session.SessionHandler.doHandle(String, Request, 
HttpServletRequest, HttpServletResponse) SessionHandler.java:223
org.eclipse.jetty.server.handler.ContextHandler.doHandle(String, Request, 
HttpServletRequest, HttpServletResponse) ContextHandler.java:1127
org.eclipse.jetty.servlet.ServletHandler.doScope(String, Request, 
HttpServletRequest, HttpServletResponse) ServletHandler.java:515
org.eclipse.jetty.server.session.SessionHandler.doScope(String, Request, 
HttpServletRequest, HttpServletResponse) SessionHandler.java:185
org.eclipse.jetty.server.handler.ContextHandler.doScope(String, Request, 
HttpServletRequest, HttpServletResponse) ContextHandler.java:1061
org.eclipse.jetty.server.handler.ScopedHandler.handle(String, Request, 
HttpServletRequest, HttpServletResponse) ScopedHandler.java:141
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(String, 
Request, HttpServletRequest, HttpServletResponse) 
ContextHandlerCollection.java:215
org.eclipse.jetty.server.handler.HandlerCollection.handle(String, Request, 
HttpServletRequest, HttpServletResponse) HandlerCollection.java:110
org.eclipse.jetty.server.handler.HandlerWrapper.handle(String, Request, 
HttpServletRequest, HttpServletResponse) HandlerWrapper.java:97
org.eclipse.jetty.server.Server.handle(HttpChannel) Server.java:499
org.eclipse.jetty.server.HttpChannel.handle() HttpChannel.java:310
org.eclipse.jetty.server.HttpConnection.onFillable() HttpConnection.java:257
org.eclipse.jetty.io.AbstractConnection$2.run() AbstractConnection.java:540
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(Runnable) 
QueuedThreadPool.java:635
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run() QueuedThreadPool.java:555
java.lang.Thread.run() Thread.java:745
{code}




> MatchAllDocsQuery is much slower in solr5.3.1 compare to solr4.7
> ----------------------------------------------------------------
>
>                 Key: SOLR-8251
>                 URL: https://issues.apache.org/jira/browse/SOLR-8251
>             Project: Solr
>          Issue Type: Bug
>          Components: search
>    Affects Versions: 5.3, 5.3.1
>            Reporter: wei shen
>             Fix For: 5.5
>
>         Attachments: Solr 4 vs Solr 5.png
>
>
> I am trying to upgrade our production solr instance from 4.7 to 5.3.1. 
> Unfortunately when I do load testing I find the MatchAllDocsQuery is much 
> slower in solr 5.3.1 compare to 4.7. (solr 5.3.1 is faster in load test with 
> queries other than MatchAllDocsQuery). I asked solr-user and discussed with 
> Yonik Seeley. He confirmed that he can see the problem too comparing solr 
> 5.3.1 and 4.10.
> here is the query I use:
> {code}
> q={!cache=false}*:*&fq=+categoryIdsPath:1001&fl=id&start=0&rows=2&debug=true
> {code}
> for me the query is consistently about 60-70% slower on solr5 than solr4.
> Yonik mentioned in his email "For me, 5.3.1
> is about 5x slower than 4.10 for this particular query."



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to