Re: WhiteSpace Tokenizer question

2005-08-23 Thread Yonik Seeley
It's the QueryParser, not the Analyzer. When the query parser sees multiple tokens from what looks like a single word, it puts them in a phrase query. I think the only way to change that behavior would be to modify the QueryParser. -Yonik On 8/23/05, Dan Armbrust <[EMAIL PROTECTED]> wrote: > I w

RE: WhiteSpace Tokenizer question

2005-08-23 Thread Vanlerberghe, Luc
brust [mailto:[EMAIL PROTECTED] Sent: dinsdag 23 augustus 2005 17:32 To: java-user@lucene.apache.org Subject: WhiteSpace Tokenizer question I wrote a slightly modified version of the WhiteSpaceTokenizer that allows me to treat other characters as whitespace. My thought was that this would be an

WhiteSpace Tokenizer question

2005-08-23 Thread Dan Armbrust
I wrote a slightly modified version of the WhiteSpaceTokenizer that allows me to treat other characters as whitespace. My thought was that this would be an easy way to make it tokenize on characters such as "-". My tokenizer looks like this: public class CustomWhiteSpaceTokenizer extends Char