Re: Yokozuna queries slow

2015-04-22 Thread Jason Campbell
After some comparisons with tcpdump, I think the strange results are related to a too aggressive redirect rule. Please ignore. Sorry for the confusion. > On 22 Apr 2015, at 12:35, Jason Campbell wrote: > > Sorry, still running into issues. > > So I've disabled cache on all solr nodes, but th

Re: Yokozuna queries slow

2015-04-21 Thread Jason Campbell
Sorry, still running into issues. So I've disabled cache on all solr nodes, but the yokozuna query times are still high. Oddly, running queries against any one node completes in a few ms. So I injected nginx between riak and solr so I could log queries, and now I'm even more confused. There

Re: Yokozuna queries slow

2015-04-21 Thread Jason Campbell
That is really weird, I tried that before posting, yet it seems to fix things now. Oh well, I'll try rolling it out across the cluster, hopefully it works. Maybe someone with more Solr knowledge can enlighten me though, does disabling the filter cache change behaviour as well? For example, run

Re: Yokozuna queries slow

2015-04-21 Thread Zeeshan Lakhani
Hey Steve, Yep, that’s the specific reference point I was referring to in the link I shared. We’re working on cleaning-up some stuff to help perf for large indexes within the yz code itself. We’ve also discussed how to improve configuring specific solrconfig tunable items as a property of the

Re: Yokozuna queries slow

2015-04-21 Thread Steve Garon
Zeeshan, For that specific case, you guys should add *{!cache=false}* in front on your query plan. Therefore, queries on large index won't be slowed down. I'd really like to see some of the solrconfig.xml config to be exported to the riak bucket properties. The caching flag could be a property on

Re: Yokozuna queries slow

2015-04-21 Thread Zeeshan Lakhani
Nice Steve. Zeeshan Lakhani programmer | software engineer at @basho | org. member/founder of @papers_we_love | paperswelove.org twitter => @zeeshanlakhani > On Apr 21, 2015, at 3:57 PM, Steve Garon wrote: > > Jason, > > Comment the section in the bucket's solrconfig.xml and > restart ria

Re: Yokozuna queries slow

2015-04-21 Thread Steve Garon
Jason, Comment the section in the bucket's solrconfig.xml and restart riak. Now your queries will be fast again :-) Steve On 21 April 2015 at 04:24, Zeeshan Lakhani wrote: > No real workaround other than what you described or looking into > config/fq-no-cache settings as mentioned in > http:

Re: Yokozuna queries slow

2015-04-21 Thread Zeeshan Lakhani
No real workaround other than what you described or looking into config/fq-no-cache settings as mentioned in http://lucidworks.com/blog/advanced-filter-caching-in-solr/ and playing around with those. Riak is now at 2.1.0. I hope tha

Re: Yokozuna queries slow

2015-04-21 Thread Jason Campbell
Thanks Zeeshan for the info. Is there a workaround in the mean time, or is the only option to handle queries to the individual nodes ourselves? Is there a planned timeframe for the 2.0.1 release? Thanks, Jason > On 21 Apr 2015, at 16:13, Zeeshan Lakhani wrote: > > Hey Jason, > > We’re worki

Re: Yokozuna queries slow

2015-04-20 Thread Zeeshan Lakhani
Hey Jason, We’re working on performance issues with YZ filter queries, e.g. https://github.com/basho/yokozuna/issues/392 , and coverage plan generation/caching, and our CliServ team has started doing a ton of benchmarks as well. You can bypass YZ,

Yokozuna queries slow

2015-04-20 Thread Jason Campbell
Hello, I'm currently trying to debug slow YZ queries, and I've narrowed down the issue, but not sure how to solve it. First off, we have about 80 million records in Riak (and YZ), but the queries return relatively few (a thousand or so at most). Our query times are anywhere from 800ms to 1.5s