Re: improve indexing speed with nomergepolicy

2014-08-14 Thread Shai Erera
gt; forceMerge(). > > Uwe > > - > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > > > -Original Message- > > From: Shai Erera [mailto:ser...@gmail.com] > > Sent: Thursday, August 07, 2014

RE: improve indexing speed with nomergepolicy

2014-08-07 Thread Uwe Schindler
.@gmail.com] > Sent: Thursday, August 07, 2014 4:11 PM > To: java-user@lucene.apache.org > Subject: Re: improve indexing speed with nomergepolicy > > Yes, currently an MP isn't a "live" setting on IndexWriter, meaning you pass > it > at construction time an

Re: improve indexing speed with nomergepolicy

2014-08-07 Thread Shai Erera
Yes, currently an MP isn't a "live" setting on IndexWriter, meaning you pass it at construction time and don't change it afterwards. I wonder if after LUCENE-5711 we can move MergePolicy to LiveIndexWriterConfig and fix IndexWriter to not hold on to it, but rather pull it from the config. Not sure

Aw: Re: improve indexing speed with nomergepolicy

2014-08-07 Thread Sascha Janz
16:05 Uhr Von: "Jon Stewart" An: java-user@lucene.apache.org Betreff: Re: improve indexing speed with nomergepolicy Related, how does one change the MergePolicy on an IndexWriter (e.g., use NoMergePolicy during batch indexing, then change to something better once finished with batch)

Re: improve indexing speed with nomergepolicy

2014-08-07 Thread Jon Stewart
Related, how does one change the MergePolicy on an IndexWriter (e.g., use NoMergePolicy during batch indexing, then change to something better once finished with batch)? It looks like the MergePolicy is set through IndexWriterConfig but I don't see a way to update an IWC on an IW. Thanks, Jon O

Aw: Re: improve indexing speed with nomergepolicy

2014-08-07 Thread Sascha Janz
speed with nomergepolicy  many thanks for the tip with NRTCachingDirectory. didn't know that. i will try it . Sascha   Gesendet: Donnerstag, 07. August 2014 um 13:37 Uhr Von: "Shai Erera" An: "java-user@lucene.apache.org" Betreff: Re: improve indexing speed with nomergepolicy Usi

Aw: Re: improve indexing speed with nomergepolicy

2014-08-07 Thread Sascha Janz
 many thanks for the tip with NRTCachingDirectory. didn't know that. i will try it . Sascha   Gesendet: Donnerstag, 07. August 2014 um 13:37 Uhr Von: "Shai Erera" An: "java-user@lucene.apache.org" Betreff: Re: improve indexing speed with nomergepolicy Using NoMerge

Re: improve indexing speed with nomergepolicy

2014-08-07 Thread Shai Erera
Using NoMergePolicy for online indexes is usually not recommended. You want to use NoMP in case where you build an index in a batch job, then in the end before the index is "published" you run a forceMerge or maybeMerge (with a real MergePolicy). For online indexes, i.e. indexes that are being sea