Re: FieldCache & DocValues Filter

2013-06-06 Thread Robert Muir
Yes: thats right. On Thu, Jun 6, 2013 at 3:23 AM, Arun Kumar K wrote: > Hi, > > Thanks Robert ! This info is exactly what i need. > > Just for getting myself clear. > If the field is a DocValue field the FieldCacheTermsFilter will use the > existing DocValues Field. For Normal Fields the filter

Re: FieldCache & DocValues Filter

2013-06-06 Thread Arun Kumar K
Hi, Thanks Robert ! This info is exactly what i need. Just for getting myself clear. If the field is a DocValue field the FieldCacheTermsFilter will use the existing DocValues Field. For Normal Fields the filter will create a DocValues for that field using FieldCache. Arun On Thu, Jun 6, 2013

Re: Taking backup of a Lucene index

2013-06-06 Thread Shai Erera
Hi Taking a backup of the index by doing a naive file copy is not a good approach. As you mentioned, Lucene does background merging and if your application suddenly commits, old segment files may be deleted. Also, your backup will most probably include files that were not committed yet. Rather, y

Re: FieldCache & DocValues Filter

2013-06-06 Thread Michael McCandless
On Thu, Jun 6, 2013 at 5:35 AM, Robert Muir wrote: > Its confusing: I think we should rename FieldCacheXXX to DocValuesXXX. +1 Mike McCandless http://blog.mikemccandless.com - To unsubscribe, e-mail: java-user-unsubscr...@luc

Re: FieldCache & DocValues Filter

2013-06-06 Thread Robert Muir
FieldCacheTermsFilter will use your docvalues field. Its confusing: I think we should rename FieldCacheXXX to DocValuesXXX. On Thu, Jun 6, 2013 at 2:22 AM, Arun Kumar K wrote: > Hi Guys, > > I was trying to better the filtering mechanism for my use case. > When i use the existing filters like F

FieldCache & DocValues Filter

2013-06-06 Thread Arun Kumar K
Hi Guys, I was trying to better the filtering mechanism for my use case. When i use the existing filters like FieldCacheTermsFilter, TermsFilter i see that the first filtering take up enough time may be for building the FieldCache. Subsequent filters are fast enough. Currently, I am using CachingW

Re: Taking backup of a Lucene index

2013-06-06 Thread Daniel Penning
I do my backups by creating a new index at the backup target and copying everything over with IndexWriter#addIndexes(IndexReader... readers). In the future i am also planing on using a RateLimitedDirectoryWrapper to reduce the influence of the running backup on the rest of the system. Am 06.06

Re: Taking backup of a Lucene index

2013-06-06 Thread Thomas Matthijs
On Thu, Jun 6, 2013 at 7:38 AM, Lance Norskog wrote: > The simple answer (that somehow nobody gave) is that you can make a copy > of an index directory at any time. Indexes are changed in "generations". > The segment* files describe the current generation of files. All active > indexing goes on i