Re: Index Update

2009-12-12 Thread Weiwei Wang
What I'm doing now is to indexing all file paths in a bunch of ftp servers. For ftp server administrator, he can add, delete or rename the files. So as to keep pace with times, i need to do updating very often. the process should be: 1. delete the old documents 2. add the new crawled ones 3. if e

Re: Index Update

2009-12-12 Thread Erick Erickson
Quick addition. Even if you commit/close your indexwriter, you *still* won't see the changes in your search unless you repoen the indexreader. But you have to do both (in the order above) to see all the changes you've added via your indexwriter. but there's no reason to hold off on committing

Re: Recover special terms from StandardTokenizer

2009-12-12 Thread Weiwei Wang
I use Luke to check the result and find only c exists as a term, no cplusplus found in the index On Sun, Dec 13, 2009 at 10:34 AM, Weiwei Wang wrote: > Thanks, Koji, I followed your advice and change my analyzer as shown below: > NormalizeCharMap RECOVERY_MAP = new NormalizeCharMap(); > RECOVERY

Re: Recover special terms from StandardTokenizer

2009-12-12 Thread Weiwei Wang
Thanks, Koji, I followed your advice and change my analyzer as shown below: NormalizeCharMap RECOVERY_MAP = new NormalizeCharMap(); RECOVERY_MAP.add("c++","cplusplus$"); CharFilter filter = new LowercaseCharFilter(reader); filter = new MappingCharFilter(RECOVERY_MAP,filter); StandardTokenizer token

Re: Index Update

2009-12-12 Thread Weiwei Wang
Gotcha, tThanks, Uwe 2009/12/12 Uwe Schindler > No. As long as you not commit or close the IndexWriter and reopen the > IndexReader on the search side, nothing happens on the search side. > > Copying like you do is absolutely not needed. > > - > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213

RE: Index Update

2009-12-12 Thread Uwe Schindler
No. As long as you not commit or close the IndexWriter and reopen the IndexReader on the search side, nothing happens on the search side. Copying like you do is absolutely not needed. - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de > -O

Tell me the difference

2009-12-12 Thread Weiwei Wang
Hi, all, Suppose I want to index this string NashQ/c++.test and i used the following procedure to do the processing. NormalizeCharMap RECOVERY_MAP = new NormalizeCharMap(); RECOVERY_MAP.add("c++","cplusplus$"); CharFilter filter = new LowercaseCharFilter(reader);//LowercaseCharFilter, see the

Index Update

2009-12-12 Thread Weiwei Wang
Hi, all, I need to update my index everyday so as to keep pace with times. Current I have two copy of indexes, one is used to provide search service, the other is used to do updating. Once the updating process is done, I write all the updated documents to the index which provide search service

RE: Lucene 3.0.0 writer with a Lucene 2.3.1 index

2009-12-12 Thread Rob Staveley (Tom)
Thanks for picking up on this Anshum and Uwe. I used the following approach to convert by 2.3 index (which yes, was optimised already) to 3.0... Using 3.0 Lucene, I created a new empty index with my IndexWriter. I opened my 2.3 index with an IndexReader. I added the 2.3 index with writer.addI