Hi, I just translated these words, using google translate look like Japanese I [ Can you check if these words are in your stopword file. if these words exits in your stop word file than you will not get them in token stream.
-Swapnil On Fri, Jan 18, 2013 at 6:58 PM, Jerome Lanneluc <jerome_lanne...@fr.ibm.com > wrote: > [私 日本人