Help - FileNotFoundException during IndexWriter.init()

2007-03-31 Thread Antony Bowesman
I got the following exception this morning when running one last test on a data set that has been indexed many times before over the past few months. java.io.FileNotFoundException: D:\72ed1\server\Java\Search\0008\index\0001\segments_gq9 (Access is denied) at java.io.RandomAcce

Re: Help - FileNotFoundException during IndexWriter.init()

2007-03-31 Thread Michael McCandless
"Antony Bowesman" <[EMAIL PROTECTED]> wrote: > I got the following exception this morning when running one last test on a > data > set that has been indexed many times before over the past few months. > > java.io.FileNotFoundException: > D:\72ed1\server\Java\Search\0008\index\0001\segment

Re: Help - FileNotFoundException during IndexWriter.init()

2007-03-31 Thread Antony Bowesman
Michael McCandless wrote: Hmmm. It seems like what's happening is the file in fact exists but Lucene gets "Access is denied" when trying to read it. Lucene takes a listing of the directory, first. So if it Lucene has permission to take a directory listing but then no permission to open the se

Re: Help - FileNotFoundException during IndexWriter.init()

2007-03-31 Thread Michael McCandless
"Antony Bowesman" <[EMAIL PROTECTED]> wrote: > Michael McCandless wrote: > > > > Hmmm. It seems like what's happening is the file in fact exists but > > Lucene gets "Access is denied" when trying to read it. Lucene takes a > > listing of the directory, first. So if it Lucene has permission to

Re: how to index a large database

2007-03-31 Thread Erick Erickson
Well, don't do it that way . I'm assuming that you have some SQL statement like "for each entry in table 1, find all the related info", and what you're failing to retrieve is the result. So, try something like creating a SQL statement that selects the ID for table 1 and write it to a file. A

Re: how to index a large database

2007-03-31 Thread Chris Lu
Mohammad, This is the main idea, but things can get quite complicated. In addition, do you need to do incremental indexing? Do you need to delete duplicates? How would you manage deleted documents in the database? Will taking down the server while indexing affect you? ... You are welcome to tak

Re: how to index a large database

2007-03-31 Thread Phil Myers
I've used the approach that Erick describes, and it works well. Another approach is to create a single new table in your database that holds all of the data you want to index. This allows you to copy the various fields from other tables using separate SQL statements before you index, rather than re

Re: how to index a large database

2007-03-31 Thread Chris Lu
BTW: DBSight uses the same approach that Erick describes. Like Phil said, this will incur multiple joins for each document. But this works well and efficient for incremental indexing. And this approach does not need to change any database schema. -- Chris Lu - Instant Scal

Lock files in a read-only application

2007-03-31 Thread Nilesh Bansal
Hi all, We have a web-based application that searches a large lucene index. This application only creates object of type IndexSearcher only (and no IndexWriters) for searching the index. After the application runs for some time (a few hours), I can see lock files in the temp directory of the form

Re: Lock files in a read-only application

2007-03-31 Thread Michael McCandless
"Nilesh Bansal" <[EMAIL PROTECTED]> wrote: > We have a web-based application that searches a large lucene index. > This application only creates object of type IndexSearcher only (and > no IndexWriters) for searching the index. After the application runs > for some time (a few hours), I can see loc

Re: Lock files in a read-only application

2007-03-31 Thread Nilesh Bansal
Thanks for your response. Is there a way that I can disable these read locks without upgrading to 2.1. Our application uses its own custom locking mechanism, so that lucene locking is actually redundant. We are currently using Lucene version 2.0. The application has multiple threads (different we

Re: setBoost on Field

2007-03-31 Thread Xiaocheng Luan
what fields did you search, the headlines field only? DECAFFMEYER MATHIEU <[EMAIL PROTECTED]> wrote: setBoost on Field Hi, I am parsing this file called Logistics.htm I have a field named "headlines" that contains word "clients" among others. When I don't put a boost on this field,

Re: Lock files in a read-only application

2007-03-31 Thread Chris Hostetter
: locks without upgrading to 2.1. Our application uses its own custom : locking mechanism, so that lucene locking is actually redundant. We : are currently using Lucene version 2.0. since before the 2.0.0 release there has been a static FSDirectory.setDisableLocks that can be called before openin

BEST GUI Fron tend for lucene

2007-03-31 Thread ashwin kumar
hi all this is ashwin i have done my indexing program and i am able to retrieve the matching documents in command line .now i want to create a GUI and want to display the matching documents in the gui. can anyone suggest me what would be the best gui for lucene when it comes to networked environm

Re: BEST GUI Fron tend for lucene

2007-03-31 Thread rkwagle
ashwin kumar-3 wrote: > > hi all > > this is ashwin i have done my indexing program and i am able to retrieve > the > matching documents in command line .now i want to create a GUI and want to > display the matching documents in the gui. can anyone suggest me what > would > be the best gui for

Emulating Pages Search

2007-03-31 Thread Mohsen Saboorian
Hi, Is there a way to do emulate paged search in Lucene? I can use the following peace of code for returning the first page (10 items in each page), but don't know how to navigate to the next page :-) IndexSearcher is = new ... ... TopFieldDocs tops = is.search(query, null

Re: Emulating Pages Search

2007-03-31 Thread Chris Hostetter
: I can see that tops.totalHits, returns all matched documents. So is this : really "paged search", or I'm just doing a complete search and put a window : on the returned result each time? that's all paginated searching is ... you have to know the first 10 results to show 1-10, but you also have