H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: u...@thetaphi.de
>
>> -Original Message-
>> From: Valentin Popov [mailto:valentin...@gmail.com]
>> Sent: Saturday, November 14, 2015 1:51 PM
>> To: java-user@lucene.apache.org
>> Su
If you don't care about search, why not just use reader to traverse ?
Establish a for loop from 0 to reader.maxDoc() - 1, and filter the
documents using Multifields. You can even bucket this procedure, and run
your statistics calc in parallel.
On Thursday, November 12, 2015, Valentin Popov
wrote:
Actually, this looks like a fine place to use Streaming
Aggregation/Streaming Expressions. Those operate off of docValues
fields anyway, so you kind of get all this "for free".
I don't see the Solr version though, much of this is in later 5x
versions. Pull down the Solr Reference Guide for the ver
Chris , hello.
Thank got the tip, but could you explain how can I use it?
Regards,
Valentin.
> On 16 нояб. 2015 г., at 0:42, Chris Hostetter
> wrote:
>
>
> : public void collect(int docID) throws IOException {
> : Document doc = indexSearcher
: public void collect(int docID) throws IOException {
: Document doc = indexSearcher.doc(docID,
loadFields);
: found.found(doc);
: }
Based on your description of the calculation you are doing
t;
> -
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: u...@thetaphi.de
>
>> -Original Message-
>> From: Valentin Popov [mailto:valentin...@gmail.com]
>> Sent: Saturday, November 14, 2015 1:51 PM
>> To: java-u
thetaphi.de
> eMail: u...@thetaphi.de
>
>> -Original Message-
>> From: Valentin Popov [mailto:valentin...@gmail.com]
>> Sent: Saturday, November 14, 2015 1:51 PM
>> To: java-user@lucene.apache.org
>> Subject: Re: 500 millions document for loop.
>>
>>
To: java-user@lucene.apache.org
> Subject: Re: 500 millions document for loop.
>
> Thank you very much!
>
>
> > On 14 нояб. 2015 г., at 15:49, Uwe Schindler wrote:
> >
> > Hi,
> >
> > This code is buggy! The collect() call of the collector does not get a
&
---Original Message-
>> From: Valentin Popov [mailto:valentin...@gmail.com]
>> Sent: Saturday, November 14, 2015 1:04 PM
>> To: java-user@lucene.apache.org
>> Subject: Re: 500 millions document for loop.
>>
>> Hi, Uwe.
>>
>> Thanks for you advise.
&
il: u...@thetaphi.de
> -Original Message-
> From: Valentin Popov [mailto:valentin...@gmail.com]
> Sent: Saturday, November 14, 2015 1:04 PM
> To: java-user@lucene.apache.org
> Subject: Re: 500 millions document for loop.
>
> Hi, Uwe.
>
> Thanks for you advise.
>
> Af
t;> eMail: u...@thetaphi.de
>>>
>>>> -Original Message-
>>>> From: Valentin Popov [mailto:valentin...@gmail.com]
>>>> Sent: Thursday, November 12, 2015 6:48 PM
>>>> To: java-user@lucene.apache.org
>>>> Subject: Re
8213 Bremen
>>> http://www.thetaphi.de
>>> eMail: u...@thetaphi.de
>>>
>>>> -Original Message-
>>>> From: Valentin Popov [mailto:valentin...@gmail.com]
>>>> Sent: Thursday, November 12, 2015 6:48 PM
>>>> To: java-
t;> Uwe
>>>
>>> -
>>> Uwe Schindler
>>> H.-H.-Meier-Allee 63, D-28213 Bremen
>>> http://www.thetaphi.de
>>> eMail: u...@thetaphi.de
>>>
>>>> -Original Message-
>>>> From: Valentin Popov [mailto:va
llee 63, D-28213 Bremen
> > http://www.thetaphi.de
> > eMail: u...@thetaphi.de
> >
> >> -Original Message-
> >> From: Valentin Popov [mailto:valentin...@gmail.com]
> >> Sent: Thursday, November 12, 2015 6:48 PM
> >> To: java-user@lucene.apac
Toke, I just look throw code we already using such method
IndexSearcher indexSearcher = getIndexSearcher(searchResult);
TopDocs topDocs;
ScoreDoc currectScoreDoc = p.startScoreDoc;
for (int page = 1;
entin Popov [mailto:valentin...@gmail.com]
>> Sent: Thursday, November 12, 2015 6:48 PM
>> To: java-user@lucene.apache.org
>> Subject: Re: 500 millions document for loop.
>>
>> Toke, thanks!
>>
>> We will look at this solution, looks like this is that what
...@thetaphi.de
> -Original Message-
> From: Valentin Popov [mailto:valentin...@gmail.com]
> Sent: Thursday, November 12, 2015 6:48 PM
> To: java-user@lucene.apache.org
> Subject: Re: 500 millions document for loop.
>
> Toke, thanks!
>
> We will look at this soluti
Toke, thanks!
We will look at this solution, looks like this is that what we need.
> On 12 нояб. 2015 г., at 20:42, Toke Eskildsen
> wrote:
>
> Valentin Popov wrote:
>
>> We have ~10 indexes for 500M documents, each document
>> has «archive date», and «to» address, one of our task is
>> c
Valentin Popov wrote:
> We have ~10 indexes for 500M documents, each document
> has «archive date», and «to» address, one of our task is
> calculate statistics of «to» for last year. Right now we are
> using search archive_date:(current_date - 1 year) and paginate
> results for 50k records for pa
We are using 4.10.4 and it is not possible move right now to 5.x version.
Thanks!
> On 12 нояб. 2015 г., at 19:47, Anton Zenkov
> wrote:
>
> Which version of Lucene are you using?
>
>
> On Thu, Nov 12, 2015 at 11:39 AM, Valentin Popov
> wrote:
>
>> Hello everyone.
>>
>> We have ~10 index
Which version of Lucene are you using?
On Thu, Nov 12, 2015 at 11:39 AM, Valentin Popov
wrote:
> Hello everyone.
>
> We have ~10 indexes for 500M documents, each document has «archive date»,
> and «to» address, one of our task is calculate statistics of «to» for last
> year. Right now we are us
21 matches
Mail list logo
