Re: Why read past EOF

2012-02-16 Thread superruiye
Oh,I made a mistake.Our testing server's time is faster hours than it should be.I reminded workmate to modify it,and index maintain in a range size. Thank you all the same. -- View this message in context: http://lucene.472066.n3.nabble.com/Why-read-past-EOF-tp3639401p3752592.html Sent from the L

RE: Short circuit AND or subquerying in lucene for performance

2012-02-16 Thread Chris Hostetter
: Is there a way to run a subquery in Lucene, i.e. running a query only on : the result of a first query to avoid scanning the whole index ? : Is is worth forwarding this request to the developers, do you think it : is feasible to implement such a short circuit operator where the term is : "late"

Re: query for documents WITHOUT a field?

2012-02-16 Thread Uwe Schindler
I already mentioned that pseudo NULL term, but the user asked for another solution... -- Uwe Schindler H.-H.-Meier-Allee 63, 28213 Bremen http://www.thetaphi.de Jamie Johnson schrieb: Another possible solution is while indexing insert a custom token which is impossible to show up in the index

Re: query for documents WITHOUT a field?

2012-02-16 Thread Jamie Johnson
Another possible solution is while indexing insert a custom token which is impossible to show up in the index otherwise, then do the filter based on that token. On Thu, Feb 16, 2012 at 4:41 PM, Uwe Schindler wrote: > As the documentation states: > Lucene is an inverted index that does not have p

RE: query for documents WITHOUT a field?

2012-02-16 Thread Uwe Schindler
As the documentation states: Lucene is an inverted index that does not have per-document fields. It only knows terms pointing to documents. The query you are searching is a query that returns all documents which have no term. To execute this query, it will get the term index and iterate all terms o

RE: query for documents WITHOUT a field?

2012-02-16 Thread Tim Eck
Thanks for the fast response. I'll certainly have a look at the upcoming 3.6.x release. What is the expected performance for using a negated filter? In particular does it defeat the index in any way and require a full index scan? Is it different between regular fields and numeric fields? For 3.5 a

RE: query for documents WITHOUT a field?

2012-02-16 Thread Uwe Schindler
Lucene 3.6 will have a FieldValueFilter that can be negated: Query q = new ConstantScoreQuery(new FieldValueFilter("field", true)); (see http://goo.gl/wyjxn) Lucen 3.5 does not yet have it, you can download 3.6 snapshots from Jenkins: http://goo.gl/Ka0gr - Uwe Schindler H.-H.-Meier-Allee 63

query for documents WITHOUT a field?

2012-02-16 Thread Tim Eck
My apologies if this answer is readily available someplace, I've searched around and not found a definitive answer. I'd like to run a query for documents that _do not_ contain particular indexed fields to implement something like a SQL-like query where a column is null. I understand I cou

RE: Short circuit AND or subquerying in lucene for performance

2012-02-16 Thread Delalande, Thierry
Thanks Uwe for your explanation, Indeed that's what I understood that scanning will happen first. Is there a way to run a subquery in Lucene, i.e. running a query only on the result of a first query to avoid scanning the whole index ? Is is worth forwarding this request to the developers, do you t

Question about CustomScoreQuery

2012-02-16 Thread Dominika Puzio
Hello, I'm trying to understand the behavior of CustomScoreQuery. It seemed to me, that default CustomScoreQuery(Query subQuery, ValueSourceQuery valSrcQuery) should return a score that is a product of subQuery score and valSrcQuery score. So I wrote a simple test case given below: @Test

Re: Why read past EOF

2012-02-16 Thread Michael McCandless
Wait: I see your DP above calling .delete() -- can you verify that code is in fact invoked? EG print on each onCommit how many commits are deleted and how many are not? Mike McCandless http://blog.mikemccandless.com On Wed, Feb 15, 2012 at 9:21 PM, superruiye wrote: > My IndexWriter only creat

StandardAnalyzer and Email Addresses

2012-02-16 Thread Charlie Hubbard
This is a pretty simple question to answer, but I have customers asking me how this is suppose to work and I'm having trouble explaining it. I have an app that indexes emails so there are plenty of email addresses in there. Reading the StandardAnalyzer javadoc it says it "recognizes" email addres

Re: prefix query works, term query does not

2012-02-16 Thread Francisco A. Lozano
Use luke to see what terms are in your index and what your query looks like when parsed. Also, when I want to search the field with all the analysis stuff but also be able to search by exact keyword, I index it twice, with two fields with the same name: one of them is analyzed and the other not. I

Re: prefix query works, term query does not

2012-02-16 Thread Ian Lea
http://wiki.apache.org/lucene-java/LuceneFAQ#Why_am_I_getting_no_hits_.2BAC8_incorrect_hits.3F Different analyzers for indexing and searching would be my first guess. -- Ian. On Thu, Feb 16, 2012 at 8:34 AM, mete wrote: > Hello, > I have a noobie question. I am trying to implement a small poc

prefix query works, term query does not

2012-02-16 Thread mete
Hello, I have a noobie question. I am trying to implement a small poc app.I have lots of sharded indexes in a folder and i am trying to read them like this: MultiReader reader = new MultiReader(list.toArray(new IndexReader[list.size()])); IndexSearcher searcher = new IndexSearcher(r