Re: Excluding partial match for query result

2007-01-12 Thread M A
use different analyzers to see how they behave when it comes to creating a query. Best Erick On 1/11/07, M A <[EMAIL PROTECTED]> wrote: > > Hi, > > We are having some trouble with the results that we get from certain > queries. > > Basically .. we have documents th

Excluding partial match for query result

2007-01-11 Thread M A
Hi, We are having some trouble with the results that we get from certain queries. Basically .. we have documents that we index, each document has a bunch of tags, the tags could be of the sort tags: A, B, C, D.P, E.A etc .. Each story will contain only a subset of the tags .. For example Sto

Re: Search Performance Problem 16 sec for 250K docs

2006-08-21 Thread M A
It is indeed alot faster ... Will use that one now .. hits = searcher.search(query, new Sort(new SortField(null,SortField.DOC,true))); That is completing in under a sec for pretty much all the queries .. On 8/22/06, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 8/21/06, M A &

Re: Search Performance Problem 16 sec for 250K docs

2006-08-21 Thread M A
() How do you get document number descending .. ?? for the sort that is On 8/21/06, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 8/21/06, M A <[EMAIL PROTECTED]> wrote: > Yeah I tried looking this up, > > If i wanted to do it by document id (highest docs first) , d

Re: Search Performance Problem 16 sec for 250K docs

2006-08-21 Thread M A
before .. On 8/21/06, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 8/20/06, M A <[EMAIL PROTECTED]> wrote: > The index is already built in date order i.e. the older documents appear > first in the index, what i am trying to achieve is however the latest > documents appearin

Re: Search Performance Problem 16 sec for 250K docs

2006-08-21 Thread M A
low scoring ones .. and i am set .. Thanx On 8/20/06, M A <[EMAIL PROTECTED]> wrote: The index is already built in date order i.e. the older documents appear first in the index, what i am trying to achieve is however the latest documents appearing first in the search results .. without the s

Re: Search Performance Problem 16 sec for 250K docs

2006-08-20 Thread M A
n mount the remote drive so you can see it, you can just use Luke to browse to it and open it up. You may have some latency though. See below... On 8/20/06, M A <[EMAIL PROTECTED]> wrote: > > Ok I get your point, this still however means the first search on the new > searcher will

Re: Search Performance Problem 16 sec for 250K docs

2006-08-20 Thread M A
IndexSearcher with searches/ sorts/filter creating/etc before it is swapped into use. Erik On Aug 20, 2006, at 5:35 AM, M A wrote: > Ok I get your point, this still however means the first search on > the new > searcher will take a huge amount of time .. given that this is >

Re: Search Performance Problem 16 sec for 250K docs

2006-08-20 Thread M A
Ok I get your point, this still however means the first search on the new searcher will take a huge amount of time .. given that this is happening now .. i.e. new search -> new query -> get hits ->20+ secs .. this happens every 5 mins or so .. although subsequent searches may be quicker .. Am

Re: Search Performance Problem 16 sec for 250K docs

2006-08-19 Thread M A
yes there is a new searcher opened each time a search is conducted, This is because the index is updated every 5 mins or so, due to the incoming feed of stories .. When you say iteration, i take it you mean, search request, well for each search that is conducted I create a new one .. search read

Re: Search Performance Problem 16 sec for 250K docs

2006-08-19 Thread M A
y is *actually* submitted and whether it's what you expect. Are you using wildcards? They also have an effect on query speed. If none of this applies, perhaps you could post the query and the how the index is constructed. If you haven't already gotten a copy of Luke, I heartily recommend

Search Performance Problem 16 sec for 250K docs

2006-08-19 Thread M A
Hi there, I have an index with about 250K document, to be indexed full text. there are 2 types of searches carried out, 1. using 1 field, the other using 4 .. for a query string ... given the nature of the queries required, all stop words are maintained in the index, thereby allowing for phrasa