> okay, so it is recognized as a number?
Yes. You can see token type definitions in *.jflex file.
> Maybe I'll have to use another tokenizer.
MappingCharFilter with StandardTokenizer option exists.
NormalizeCharMap map = new NormalizeCharMap();
map.add("-", " ");
TokenStream stream = new StandardTokenizer(
new MappingCharFilter(map,
new StringReader("nl-lt0")));
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
