Thanks Dawid, that was it. I'm now using an empty stoptags set and I'm
seeing all the expected tokens.
Jerome
From: Dawid Weiss
To: java-user@lucene.apache.org,
Date: 01/18/2013 02:52 PM
Subject: Re: Japanese analyzer
Jerome,
Some of the tokens are removed bec
ot;
> and the second one is a unit of length.
>
> Jerome
>
>
>
> From: Swapnil Patil
> To: java-user@lucene.apache.org,
> Date: 01/18/2013 02:33 PM
> Subject:Re: Japanese analyzer
>
>
>
> Hi,
>
> I just translated these words, using goog
Jerome
From: Swapnil Patil
To: java-user@lucene.apache.org,
Date: 01/18/2013 02:33 PM
Subject: Re: Japanese analyzer
Hi,
I just translated these words, using google translate look like Japanese
I [
Can you check if these words are in your stopword file.
if these words exi
Hi,
I just translated these words, using google translate look like Japanese
I [
Can you check if these words are in your stopword file.
if these words exits in your stop word file than you will not get them in
token stream.
-Swapnil
On Fri, Jan 18, 2013 at 6:58 PM, Jerome Lanneluc wrote:
>
