Re: Implement a tokenizer

2007-05-21 Thread Chris Lu
Actually before you jump in, be warned that the "+" plus sign is also part of query parser. You can not really/easily pass the query with the "+" sign through query parser in order to get a match. -- Chris Lu - Instant Scalable Full-Text Search On Any Database/Application

RE: Implement a tokenizer

2007-05-21 Thread Mordo, Aviran (EXP N-NANNATEK)
What you need to do is to create your own tokenizer. Just copy the code from the StandardTokenizer to your XYZTokenizer and make your changes. Then you need to create your own Analyzer class (again copy the code from the StandardAnalyzer) and user your XYZTokenizer in the new XYZAnalyzer you create