Peace, all! Problem: search is awfully slow. Consistently. And it shouldn't be: I've a smallish data set, nowhere near what others reported, and Matt's benchmarks. So, before I take everything apart, because I'm determined to crack this bug, I'd appreciate some hints and tips.
I'm following up on the work Hovav began a month ago. Using Whoosh 2.5.0, though I don't see Matt's patches (the diffs attached to that thread 2012-09-14, specifically file mtime stuff) there? * I did try (hard!) to post this to Whoosh's group <https://groups.google.com/forum/#!forum/whoosh>, but Google is being infuriatingly obnoxious, bouncing my emails with an absurdly useless error messsage. Nu... Also, I know it's a faux pas, but maybe this should be cross-posted to MoinMoin's list? They seem to be "important clients" of W/GAE, and maybe they have (negative) evidence? Thomas? I've gone over the code, but the problem isn't apparent. - What would you suggest I do to resolve this as quickly as possible? - Could Memcache be the problem? Could I (or Whoosh) be using it wrong? Locking? Misses? Timeouts? (I haven't yet tested with Appstats; still trying to guess around this.) - The schema isn't that complex, about 30 metadata fields. (We need a faceted search, not full text.) Many of the fields are wrapped by a MultiValueMetaModel to provide multilingual support, and searching does lots of loops and stringifications. Could this be inefficient enough to account for the slowness? How should I profile that? - Could it be GAE or NDB related? Datastore? BlobProperty? - Using instance memory as a cache has been suggested. What's your experience with this? Do you know of other (open source) codebases, besides Whoosh, that might use this approach to solve a similar problem? Help?! Thanks! ;o) -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/TGPyaj1sTw4J. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
