Re: Computing multiple different aggregations over a match-set in one pass

2023-02-16 Thread Stefan Vodita
Hi Greg, To better understand how much work gets duplicated, I went ahead and modified FloatTaxonomyFacets as an example [1]. It doesn't look too pretty, but it illustrates how I think multiple aggregations in one iteration could work. Overall, you're right, there's not as much wasted work as I h

Re: [External] Re: How to highlight fields that are not stored?

2023-02-16 Thread Shifflett, David [USA]
Hi Michael. Thanks for the reply. As I said in the opening statement, I need to move away reading a file into memory before indexing the file.. The use case here is files 2+ GB in size. I thought streaming the file to be indexed is the only alternative to reading the full file in RAM then indexi

Re: How to highlight fields that are not stored?

2023-02-16 Thread Michael Sokolov
Sorry your problem statement makes no sense: you should be able to store field data in the index without loading all your documents into RAM while indexing. Maybe there is some constraint you are not telling us about? Or you may be confused. In any case highlighting requires the document in its uni

DoubleLeafComparator Question

2023-02-16 Thread Puneeth Bikkumanla
Hello everyone, In the DoubleLeafComparator::getValueForDoc when Lucene is converting back to the double from the long representation,