Simon Willnauer wrote: > > you could do > the whole job in a Tokenizer but this would not be a good separation > of concerns right!? >
right, it wouldn't be a good separation of concerns. That's why I wanted to know what you consider as "Tokenizer's job". -- View this message in context: http://www.nabble.com/Any-Tokenizator-friendly-to-C%2B%2B%2C-C-%2C-.NET%2C-etc---tp25063175p25077083.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org