The filter is still there. In Lucene 4.0 all tokenstream implementations are in 
a separate module, no longer in Lucene core. The package names of most analysis 
components changed, too.
Use your IDE to find it or ask Google...

Uwe



"Igal @ getRailo.org" <i...@getrailo.org> schrieb:

>hi,
>
>I'm trying to migrate to Lucene 4.
>
>in Lucene 3.5 I extended
>org.apache.lucene.analysis.FilteringTokenFilter 
>and overrode accept() to remove undesired shingles.  in Lucene 4 
>org.apache.lucene.analysis.FilteringTokenFilter does not exist?
>
>I'm trying to achieve two things:
>
>1) remove shingles that have an empty item.
>
>2) remove shingles when the phrase contains a comma, for example:
>
>    for the phrase:    "delicious red apples, green pears, and oranges"
>
>I want the following shingles (with a shingle size of 2):
>
>"delicious red", "red apples", "green pears", "and oranges"
>(no "apples green" because there's a comma)
>(no "pears and" because there's a comma)
>
>any ideas?
>
>TIA
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
>For additional commands, e-mail: java-user-h...@lucene.apache.org

--
Uwe Schindler
H.-H.-Meier-Allee 63, 28213 Bremen
http://www.thetaphi.de

Reply via email to