open file descriptors for deleted index files

2007-09-04 Thread Tony Qian
All, I'm facing an issue in which the file descriptors are not closed for deleted index files. I searched mailing list and didn't find the solution. Here is some info: java 21488 wppd 139r REG8,7 152456865 571208 /data/index/_idx.cfs (deleted) java 21488 w

Re: Index sync up

2007-04-27 Thread Tony Qian
thousands of documents The "fetch twice as many documents as the one we're asked for" algorithm seems tailored for relatively small data sets, which shouldn't be any surprise.. Erick On 4/27/07, Tony Qian <[EMAIL PROTECTED]> wrote: All, After playing around with L

Index sync up

2007-04-27 Thread Tony Qian
All, After playing around with Lucene, we decided to replace old full-text search engine with Lucene. I got "Lucene in Action" a week ago and finished reading most of the book. I got several questions. 1) Since the book was written two years ago and Lucene has made a lot of changes, is there

Re: Index performance

2007-04-19 Thread Tony Qian
Doron and Erick, I found the problem which slowed down indexing. It is our NFS file system. Thanks for help. Tony From: "Tony Qian" <[EMAIL PROTECTED]> Reply-To: java-user@lucene.apache.org To: java-user@lucene.apache.org Subject: Re: Index performance Date: Mon, 16 Apr 200

Re: Index performance

2007-04-16 Thread Tony Qian
Doron, I'll try that and let you know the result. thanks for suggestions. Tony From: Doron Cohen <[EMAIL PROTECTED]> Reply-To: java-user@lucene.apache.org To: java-user@lucene.apache.org Subject: Re: Index performance Date: Thu, 12 Apr 2007 13:40:07 -0700 To cover all possible non-indexing o

Re: Index performance

2007-04-16 Thread Tony Qian
) go out to the DB to get info, and could that be where the time is spent? Erick On 4/12/07, Tony Qian <[EMAIL PROTECTED]> wrote: Otis, I timed just for indexing. thanks, Tony >From: Otis Gospodnetic <[EMAIL PROTECTED]> >Reply-To: java-user@lucene.apache.org >To: jav

Re: Index performance

2007-04-12 Thread Tony Qian
w.simpy.com/ - Tag - Search - Share - Original Message From: Tony Qian <[EMAIL PROTECTED]> To: [EMAIL PROTECTED] Sent: Thursday, April 12, 2007 11:23:36 AM Subject: Index performance All, Sorry for long email. I have two questions on indexing. My data consists of an id, s

Re: Index performance

2007-04-12 Thread Tony Qian
Eric, Thanks for the information. The id is generated by database and it is unique. So I only need to index it and don't need to store it, right Tony From: "Erick Erickson" <[EMAIL PROTECTED]> Reply-To: [EMAIL PROTECTED] To: [EMAIL PROTECTED] Subject: Re: Index performance Date: Thu, 12 Apr

Index performance

2007-04-12 Thread Tony Qian
All, Sorry for long email. I have two questions on indexing. My data consists of an id, short headline and story text. Story text has some html tags. Here is an example. In early 2005, it seemed that Shamita Shetty had finally arrived after a high profile debut in Mohabbatein [2000]. With 3

RE: How to update index dynamically

2007-04-12 Thread Tony Qian
You have to refresh your IndexSearcher periodically. Tony From: anson <[EMAIL PROTECTED]> Reply-To: [EMAIL PROTECTED] To: [EMAIL PROTECTED] Subject: How to update index dynamically Date: Mon, 09 Apr 2007 18:25:57 +0900 I have build a blog project under tomcat5.5 with Lucene2.0. And I want to

Re: Plural word search

2007-03-08 Thread Tony Qian
but ONLY you set a flag (see setAllowLeadingWildcard in QueryParser). Be aware of the TooManyClauses issue though (search the mail archive and you'll find many discussions of this issue). Erick On 3/8/07, Tony Qian <[EMAIL PROTECTED]> wrote: Sachin, Thanks for quick response. Is t

RE: Plural word search

2007-03-08 Thread Tony Qian
Mar 2007 17:14:02 - Hi Tony, Lucene certainly does support it. It just requires you to use a tokeniser that performs stemming such as any analyzer that uses PorterStemFilter. Sachin -Original Message- From: Tony Qian [mailto:[EMAIL PROTECTED] Sent: 08 March 2007 16:52 To: java-us

Plural word search

2007-03-08 Thread Tony Qian
All, I'm evaluating Lucene as a full-text search engine for a project. I got one of the requirements as following: 4) Plural Literal Search If you use the plural of a term such as bears the results will include matches to the plural term bears as well as the singular term bear. it seems to

Re: full text search using Lucene

2006-04-13 Thread Tony Qian
-- Full-Text Search on Any Databases http://www.dbsight.net Faster to setup than reading marketing materials. On 4/10/06, Tony Qian <[EMAIL PROTECTED]> wrote: > All, > > I'm working on a project which requires full text search on multiple tables >

full text search using Lucene

2006-04-10 Thread Tony Qian
All, I'm working on a project which requires full text search on multiple tables in MySql database. Although, MySql supports full text search, it only supports full text search on signle table. I'm wondering if Lucene can help me to do full text search against MySql database. (I noticed that D