Re: Overall doc-count in TermStats, during flush...

2013-03-20 Thread Ravikumar Govindarajan
Thanks Simon for the quick update... We always have uniform docs with same set of fields added and that led to the confusion. -- Ravi On Wed, Mar 20, 2013 at 6:33 PM, Simon Willnauer wrote: > The BitSet basically counts how many documents have one or more values > in this field. Some docs might

Re: Overall doc-count in TermStats, during flush...

2013-03-20 Thread Simon Willnauer
The BitSet basically counts how many documents have one or more values in this field. Some docs might not have values in this field. state.segmentInfo.getDocCount() is the # of docs in this segment but we are flushing a single field here. We pass down the cardinality here since we keep the statist