Bear with me, I might be missing something.... My documents get indexed (
writer.addDocument(doc) ) with one IndexWriter created using one Analyzer
(the SnowballAnalyzer). So unless you can somehow use a different Analyzer
per field I don't see how the second field will help. If I get the
TermFreqVector for a field for a document that was indexed using the
SnowballAnalyzer, isn't it always going to return stemmed words?
To confirm your assumption, I suppose I am trying to display the values of
the indexed field. It doesn't matter to me whether I count "party" and
"parties" as separate words or not but I cannot display "parti" to a user as
it's not a word.
I'm thinking I need a separate index with the field created using the
StandardAnalyzer unless there's some other trick with mixing Analyzers I'm
unaware of.
Thanks again for your help,
Chris
----- Original Message -----
From: "Grant Ingersoll" <[EMAIL PROTECTED]>
To: <java-user@lucene.apache.org>
Sent: Wednesday, January 11, 2006 8:32 AM
Subject: Re: top n words within a results set?
I believe the usual solution is to have a separate field on the same
document for display purposes (I am assumming you are trying to display the
values of the indexed field) that is not stemmed. The tradeoff is in disk
space, of course.
Chris Brown wrote:
Okay, I've taken Grant's advice and aggregated the TermFreqVector's for
each term in the applicable field. It works quite well, there's just one
glitch.
Some words like "party" and "picture" appear as "parti" and "pictur". I
am
using the SnowballAnalyzer, I suspect that's what's changing the words.
Short of maintaining a second index using a different analyzer, does
anyone
have any ideas?
----- Original Message ----- From: "Grant Ingersoll" <[EMAIL PROTECTED]>
To: <java-user@lucene.apache.org>
Sent: Monday, January 09, 2006 12:34 PM
Subject: Re: top n words within a results set?
You could use term vectors to accomplish this. Get your hits for the
website, then load the term vector for the field containing the keywords
and add up the frequencies
Chris Brown wrote:
Hello,
Is it possible to retrieve the top 'n' most often appearing words
within a search criteria? I've seen the High Frequency Terms code in
the sandbox but it works across the whole index.
To put this question into context: We're developing website that hosts
a user's photo website. Searches can be specific to a particular user's
website or be performed globally across one, many or all websites. I've
accomplished this with a field in the index called website. What I'd
like to do is give each user the top ten words that appear on their
website.
Thanks,
Chris Brown
http://www.orangepics.com/
--
-------------------------------------------------------------------
Grant Ingersoll Sr. Software Engineer Center for Natural Language
Processing Syracuse University School of Information Studies 337 Hinds
Hall Syracuse, NY 13244
http://www.cnlp.org Voice: 315-443-5484 Fax: 315-443-6886
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
--
-------------------------------------------------------------------
Grant Ingersoll Sr. Software Engineer Center for Natural Language
Processing Syracuse University School of Information Studies 337 Hinds
Hall Syracuse, NY 13244
http://www.cnlp.org Voice: 315-443-5484 Fax: 315-443-6886
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
