Re: Sorting results by both score and date

2005-10-04 Thread Yonik Seeley
Another way to tackle this could be FunctionQuery. It can create a score based on the value of a field. http://issues.apache.org/jira/browse/LUCENE-446 -Yonik Now hiring -- http://tinyurl.com/7m67g On 9/16/05, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > What I really want to do is sort by "A

Re: QueryParser exception on escaped double quote character

2005-10-04 Thread Yonik Seeley
Unfortunately, the QueryParser doesn't handle any escaping inside a quoted string. http://www.mail-archive.com/java-user@lucene.apache.org/msg02354.html -Yonik Now hiring -- http://tinyurl.com/7m67g On 10/4/05, Matt Magoffin <[EMAIL PROTECTED]> wrote: > > I'm having a problem getting the QueryPar

Re: who could tell me the equation of the scoring in detail? i'm confused about two days

2005-10-04 Thread jian chen
Hi, Lucene uses a variant version of vector space model for ranking the documents. You can look at 1) http://lucene.apache.org/java/docs/api/org/apache/lucene/search/Similarity.htmlfor the fomula, 2) there is an article some one wrote about the Lucene's Ranking function vs. standard vsm. However

who could tell me the equation of the scoring in detail? i'm confused about two days

2005-10-04 Thread chai qiaozi
hello everyone, I'm a newer to lucence. I want to know the scoring algorithm in lucence. but there are many different explations aobut it, who may give me the scoring equation in detail please? thank you in advance! - To

QueryParser exception on escaped double quote character

2005-10-04 Thread Matt Magoffin
I'm having a problem getting the QueryParser to correctly parse a string like the following: addr:"Foo \"Bar\" Street" Should this work, or is there some other way to escape double quotes within a quoted query term? Here is a unit test that shows the problem: import junit.framework.TestCase; im

Re: Threads locking around getFSDirectory

2005-10-04 Thread Chris Hostetter
: How many IndexSearchers do people usually use in their applications? : - In previous lucene versions, we found we had better concurrency using : multiple IndexSearchers : - Our current app uses an separate IndexSearcher for each thread (as needed) : from a pool In my experience, one "live" sear

Threads locking around getFSDirectory

2005-10-04 Thread Archie Cowan
Lucene users, We run an EJB search application that has been experiencing some locking issues. By taking thread dumps when the jvm seems to be frozen, many threads in the application are locked around calls to getFSDirectory. "Thread-84" daemon prio=1 tid=0x053117b0 nid=0x2274 waiting for monitor

Re: Folksonomies

2005-10-04 Thread Steven J. Owens
On Tue, Oct 04, 2005 at 11:43:45AM -0400, Dan Funk wrote: > I've been reading about Folksonomies ( > http://en.wikipedia.org/wiki/Folksonomy), and I would like to incorporate > them into a project I'm developing with Lucene. > > The concept is pretty simple, a targeted community of users add label

Re: Folksonomies

2005-10-04 Thread Otis Gospodnetic
Hi Dan, You are describing Simpy :) - http://www.simpy.com/ If you look at Simpy's blog at http://blog.simpy.com/blojsom/blog/ , you will see I started a little series of posts about the analysis of tagging and bookmarking in Simpy. If I find time, I'll post the next part of the series tonight.

Re: Folksonomies

2005-10-04 Thread Dan Funk
Thanks Erik, seems Otis keeps a very nice blog about simply http://blog.simpy.com/blojsom/blog/ that's full of helpful advice on the topic. On 10/4/05, Erik Hatcher <[EMAIL PROTECTED]> wrote: > > > On Oct 4, 2005, at 11:52 AM, mark harwood wrote: > > >> Is anyone out there incorporating folksonom

Re: Folksonomies

2005-10-04 Thread Erik Hatcher
On Oct 4, 2005, at 11:52 AM, mark harwood wrote: Is anyone out there incorporating folksonomies into their lucene indexes, Technorati uses Lucene. So does Simpy - it's the social bookmarking / folksonomy system developed by our very own Otis Gospodnetic. I'm also building a collaborati

RE: Renewing IndexSearcher on index change.

2005-10-04 Thread Vanlerberghe, Luc
I've just posted the solution I use as a jira attachment. See http://issues.apache.org/jira/browse/LUCENE-445 It was designed to be used in a multithread environment (tomcat) It contains javadoc to explain the usage. It extends IndexSearcher since that is the object that searches are executed ag

Re: Renewing IndexSearcher on index change.

2005-10-04 Thread J.J. Larrea
Oops! Yes that's correct. Thanks for catching it... - J.J. At 10:33 AM -0700 10/4/05, Chris Hostetter wrote: >: // feebly try to prevent concurrent reentry problems >: IndexWriter w = writer; >: w = null; >: try { >: w.c

RE: live update of index used by Tomcat

2005-10-04 Thread Vanlerberghe, Luc
I've posted the code as a jira attachment. See http://issues.apache.org/jira/browse/LUCENE-445 Feedback would be much appreciated! Regards, Luc -Original Message- From: Carsten Burghardt [mailto:[EMAIL PROTECTED] Sent: donderdag 29 september 2005 13:24 To: java-user@lucene.apache.org

Re: Renewing IndexSearcher on index change.

2005-10-04 Thread Chris Hostetter
: // feebly try to prevent concurrent reentry problems : IndexWriter w = writer; : w = null; : try { : w.close(); Just to clarify for the folks at home, I'm pretty sure you ment... IndexWriter w = write

Re: Indexing-Searching Design

2005-10-04 Thread Chris Hostetter
: The primary indexer (daemon) recieves the documents to be indexed. It : dispatches the documents to one of the secondary indexer nodes (via load : balancing). These indexing nodes index the documents in the RAMDirectory, : periodically writing it to a local index in the filesystem. I'm not cert

Re: Renewing IndexSearcher on index change.

2005-10-04 Thread J.J. Larrea
At 6:39 PM +0200 10/4/05, Olivier Jaquemet wrote: >In every case I think I will use this to prevent any problem but why nobody >uses finalize methods? is it somehow bad to try to close things correctly that >way? Because they are not run under "brutal termination" conditions. For that you need

Indexing-Searching Design

2005-10-04 Thread Anand Kishore
Hi all, Having read the mail in the mailing list archive about Best Indexing-Searching Practices I have come up with the following architecture for my application. Kindly evaluate and comment regarding the same. Figure: http://www.flickr.com/photos/[EMAIL PROTECTED]/49301053/ Explanation: The

Re: Renewing IndexSearcher on index change.

2005-10-04 Thread Olivier Jaquemet
Volodymyr Bychkoviak wrote: I'm using following code during program startup [...] but this method should be used if you are running only one instance of such program (because one program can unlock index locked by another program for indexing for example) Okay this perfect for our applica

Re: Renewing IndexSearcher on index change.

2005-10-04 Thread Volodymyr Bychkoviak
Olivier Jaquemet wrote: Thank you very much Volodymyr! Exactly the perfect answer I needed. One last question: how do you manage brutal interruption of you program? Cause as far as I am concerned, if I don't use a finalize method in which I close opened searchers, if for some reason the jvm

Re: Performance Improvments?

2005-10-04 Thread Doug Cutting
Palmer, Andrew MMI Woking wrote: I am looking at changing the value BufferedIndexOutput.BUFFER_SIZE from 1024 to maybe 8192. Has anyone done anything similar and did they get any performance improvements. I doubt this will speed things much. Generally I am looking to reduce the time it ta

Re: Renewing IndexSearcher on index change.

2005-10-04 Thread Olivier Jaquemet
Thank you very much Volodymyr! Exactly the perfect answer I needed. One last question: how do you manage brutal interruption of you program? Cause as far as I am concerned, if I don't use a finalize method in which I close opened searchers, if for some reason the jvm terminates, on next run of

Re: Folksonomies

2005-10-04 Thread mark harwood
> Is anyone out there incorporating folksonomies into > their lucene indexes, Technorati uses Lucene. ___ Yahoo! Messenger - NEW crystal clear PC to PC calling worldwide with voicemail http://uk.messen

Folksonomies

2005-10-04 Thread Dan Funk
I've been reading about Folksonomies ( http://en.wikipedia.org/wiki/Folksonomy), and I would like to incorporate them into a project I'm developing with Lucene. The concept is pretty simple, a targeted community of users add labels of their choosing (just off the top of their head, not from a list

Re: Renewing IndexSearcher on index change.

2005-10-04 Thread Volodymyr Bychkoviak
Hi Olivier! In my code i'm using following IndexSearcher extention: public class IndexSearcherWrapper extends IndexSearcher { private int referenceCount; private final IndexReader indexReader; public IndexSearcherWrapper(IndexReader indexReader) { super(indexReader); this.indexReader

Re: Renewing IndexSearcher on index change.

2005-10-04 Thread Olivier Jaquemet
any thoughts on this subjects ? Olivier Jaquemet wrote: Hi all, As I read it on LIA, and as it has already been said on the mailing list multiple times, you only need one IndexSearcher for all your thread, and when your index change, you just need to create a new one to reflect changes. O

Performance Improvments?

2005-10-04 Thread Palmer, Andrew MMI Woking
Hi, I am looking at changing the value BufferedIndexOutput.BUFFER_SIZE from 1024 to maybe 8192. Has anyone done anything similar and did they get any performance improvements. Generally I am looking to reduce the time it takes to optimize the index, currently a 20GB index takes about an