Well, I expect that defining "less common" is tricky and doesn't lend itself
to a canned answer <G>. Would it work to create your own list of stop words
(possibly very large) to use for indexing and/or searching? This would
simply exclude the "less common" words (as you define them).
StandardAnalyzer, for instance, can take a File of stop words in one of its
constructors.......

Erick

On 8/7/06, Chad Hardin <[EMAIL PROTECTED]> wrote:

hi all,

I'm new to lucene but I'm loving it!  I'm writing a prototype that
links documents together based upon similarities.  Obviously the
first thing I did was use MoreLikeThis.  However, it seems to be
finding matches based upon words that are too common, in this case
the words "from" and "can" and seems to be missing matches using the
terms I would expect (in this case documents about "bikes").

I seems I need a more custom tailored Filter that only passes through
more less-common words.  Does something like this already exist?

Thanks,

Chad



---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]


Reply via email to