RE: tf=0 while lucene is finding matches?

2005-05-24 Thread Chris Hostetter
: I believe I do use the index number for the explain(), here is the code: You are missing Erik's point, he's telling you "do NOT pass the index" ... passing the doc id is the correct way to use explain. try... System.out.println( searcher.explain(query, hits.id(i))); : for (int i = 0; i

RE: tf=0 while lucene is finding matches?

2005-05-24 Thread M. Mokotov
Hi Erik Thanks for the response. I believe I do use the index number for the explain(), here is the code: for (int i = 0; i < hits.length() && i<200; i++) { System.out.println(); System.out.println( i+": "+hits.score(i)+": "+hits.doc(i).get("Title")+ ": "+hits.doc(i).get("SubTitl

Re: Term offset support not in current release?

2005-05-24 Thread Erik Hatcher
On May 24, 2005, at 8:01 PM, Fred Toth wrote: Hi, Just checking, but it appears that the support for storing term offsets is available only in the current svn version, yes? Is there any reasonable way to patch this stuff into the current release? I suspect not, since the API for Field appears

Term offset support not in current release?

2005-05-24 Thread Fred Toth
Hi, Just checking, but it appears that the support for storing term offsets is available only in the current svn version, yes? Is there any reasonable way to patch this stuff into the current release? I suspect not, since the API for Field appears to have changed considerably to support this. Ju

Re: Using Highlighter to highlight entire HTML documents?

2005-05-24 Thread markharw00d
Fred Toth wrote: Hi, We have a need to present HTML documents with all search terms highlighted. Everything I've seen regarding the Highlighter code seems to point to the typical case of extracting relevant fragments from the text for presentation of hit lists. If you dont want to fragment yo

RE: Using Highlighter to highlight entire HTML documents?

2005-05-24 Thread Will Allen
The challenge with this is always not breaking the HTML page itself. -Original Message- From: Fred Toth [mailto:[EMAIL PROTECTED] Sent: Tuesday, May 24, 2005 3:47 PM To: java-user@lucene.apache.org Subject: Using Highlighter to highlight entire HTML documents? Hi, We have a need to pres

Using Highlighter to highlight entire HTML documents?

2005-05-24 Thread Fred Toth
Hi, We have a need to present HTML documents with all search terms highlighted. Everything I've seen regarding the Highlighter code seems to point to the typical case of extracting relevant fragments from the text for presentation of hit lists. Is it possible to use the core highlighting code to

Re: Query.toString(0 does not escape special characters

2005-05-24 Thread Chris Lamprecht
Hi Peter, See the method escape(String s) of QueryParser, it may do what you want. On 5/24/05, Peter Gelderbloem <[EMAIL PROTECTED]> wrote: > Hi, > I am building queries using the query api and when I use } in my fieldname > and then call toString on the query, QueryParser throws a ParseExceptio

Re: tf=0 while lucene is finding matches?

2005-05-24 Thread Erik Hatcher
My hunch is that you're not using the document id in your calls to IndexSearcher.explain(). You don't pass the hit index number. Erik On May 24, 2005, at 11:13 AM, M. Mokotov wrote: OK, I think I'm missing something big time... Can someone point me to the documentation of the explain?

RE: tf=0 while lucene is finding matches?

2005-05-24 Thread M. Mokotov
OK, I think I'm missing something big time... Can someone point me to the documentation of the explain? Thanks a lot, M -Original Message- From: M. Mokotov [mailto:[EMAIL PROTECTED] Sent: Tuesday, May 24, 2005 4:46 PM To: 'java-user@lucene.apache.org' Subject: tf=0 while lucene is findi

RE: tf=0 while lucene is finding matches?

2005-05-24 Thread M. Mokotov
Wrap the writing code in a try{ ... }finally{ ... } and on the finally close the writer (and maybe even optimize). -Original Message- From: Santanu Dutta [mailto:[EMAIL PROTECTED] Sent: Tuesday, May 24, 2005 4:08 PM To: java-user@lucene.apache.org Cc: [EMAIL PROTECTED] Subject: RE: tf

work on joins ?

2005-05-24 Thread Paul Libbrecht
Hi, from time to time it really looks like it would be useful to be searching for something that has, say, term-x, which is the same as the term matched in another part of the query...i.e. joins. Has there been work done on this in Lucene ? thanks paul ---

RE: tf=0 while lucene is finding matches?

2005-05-24 Thread Santanu Dutta
Hi All java.io.IOException: Lock obtain timed out: [EMAIL PROTECTED]:\WINNT\TEMP\lucene-4bf302dec76f27bff81fc3dd3118abbb-write.lock at org.apache.lucene.store.Lock.obtain(Lock.java:58) Sometimes it happens and it again start working if I remove the lock file from the temp directory. I did

tf=0 while lucene is finding matches?

2005-05-24 Thread M. Mokotov
Hi, Anyone knows what is exactly Similarity.tf()? I understood it's term frequency on a document. Still, when I'm searching for a string a document contains, and the Explain().toString() shows tf=0. search string: "SubTitle:(Without)" matching documents: 3 0: 1.0: "Dropping Out," Drifting O

Re: Search Theory Book

2005-05-24 Thread Ian Soboroff
<[EMAIL PROTECTED]> writes: > I would go with "Information Retrieval: Algorithms and Heuristics" by > Grossman (a bit expensive, but worth the money > http://www.fetchbook.info/compare.do?search=0134638379). The second edition is about $38 in paperback. http://www.springeronline.com/sgw/cda/fron

Query.toString(0 does not escape special characters

2005-05-24 Thread Peter Gelderbloem
Hi, I am building queries using the query api and when I use } in my fieldname and then call toString on the query, QueryParser throws a ParseException when trying to parse it. How do I fix this? Regards Peter Gelderbloem - To