Simon Willnauer wrote:
> 
> you could do
> the whole job in a Tokenizer but this would not be a good separation
> of concerns right!?
> 

right, it wouldn't be a good separation of concerns. 
That's why I wanted to know what you consider as "Tokenizer's job".


-- 
View this message in context: 
http://www.nabble.com/Any-Tokenizator-friendly-to-C%2B%2B%2C-C-%2C-.NET%2C-etc---tp25063175p25077083.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org

Reply via email to