[
https://issues.apache.org/jira/browse/LUCENE-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12859817#action_12859817
]
Michael McCandless commented on LUCENE-2393:
--------------------------------------------
Thanks for the updated patch Tom... feedback:
* Maybe do away with the "hack to allow tokens with whitespace"?
One should use quotes with their shell for this? (And eg the hack
doens't work with tokens that have 2 spaces).
* Can you rename things like total_tf --> totalTF (consistent w/
Lucene's standard code style)
* Maybe rename TermInfoWithTotalTF -> TermStats? (It also has
.docFreq)
* Maybe rename TermInfoWithTotalTF.termFreq -> .totalTermFreq?
* Maybe rename .getTermFreqOrdered -> .sortByTotalTermFreq?
* You don't really need a priority queue to for the
getTermFreqOrdered case? Ie, instead, just fill in the
.totalTermFreq and then do a normal sort (make a
Comparator<TermStats> that sorts by the .totalTermFreq)
> Utility to output total term frequency and df from a lucene index
> -----------------------------------------------------------------
>
> Key: LUCENE-2393
> URL: https://issues.apache.org/jira/browse/LUCENE-2393
> Project: Lucene - Java
> Issue Type: New Feature
> Components: contrib/*
> Reporter: Tom Burton-West
> Priority: Trivial
> Attachments: LUCENE-2393.patch, LUCENE-2393.patch, LUCENE-2393.patch,
> LUCENE-2393.patch
>
>
> This is a command line utility that takes a field name, term, and index
> directory and outputs the document frequency for the term and the total
> number of occurrences of the term in the index (i.e. the sum of the tf of the
> term for each document). It is useful for estimating the size of the term's
> entry in the *prx files and consequent Disk I/O demands
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
