Re: MaxFieldLength

2016-07-08 Thread Michael McCandless
The default for IndexWriter is no limit, so if that's what you'd like, then yes, you don't need to use LimitTokenCountFilter. Mike McCandless http://blog.mikemccandless.com On Fri, Jul 8, 2016 at 11:58 AM, Siraj Haider wrote: > Thanks Mike, > > The name LimitTokenCountAnalyzer suggests that it

Re: Port of Custom value source from v4.10.3 to v6.1.0

2016-07-08 Thread Yonik Seeley
Use getSortedDocValues for a single-valued field, or getSortedSetDocValues for multi-valued. -Yonik On Fri, Jul 8, 2016 at 12:29 PM, paule_lecuyer wrote: > Many Thanks Yonik, I will try that. > > For my understanding, what is the difference between SortedSetDocValues > getSortedSetDocValues(St

Re: Port of Custom value source from v4.10.3 to v6.1.0

2016-07-08 Thread paule_lecuyer
Many Thanks Yonik, I will try that. For my understanding, what is the difference between SortedSetDocValues getSortedSetDocValues(String field) and SortedDocValues getSortedDocValues(String field) ? Paule. -- View this message in context: http://lucene.472066.n3.nabble.com/Upgrade-of-Custom-

Problems Refactoring a Lucene Index

2016-07-08 Thread Stuart Goldberg
As our software goes through its lifecycle, we sometimes have to alter existing Lucene indexes. The way I have done that in the past is to open the existing index for reading, read each Document, modify it and write that Document to a new index. At the end of the process, I delete the old index and

RE: MaxFieldLength

2016-07-08 Thread Siraj Haider
Thanks Mike, The name LimitTokenCountAnalyzer suggests that it is used to Limit the token count, so I was thinking that the default now is no limit and we might not need to use it as we wanted to increase the field size instead of limiting it. Please let me know. -- Regards -Siraj Haider (2

Re: MaxFieldLength

2016-07-08 Thread Michael McCandless
This was removed a while back and replaced with LimitTokenCountFilter, which you just need to tack onto your analysis chain to get the same behavior as before. Mike McCandless http://blog.mikemccandless.com On Fri, Jul 8, 2016 at 11:53 AM, Siraj Haider wrote: > Hello there, > What is the defau

MaxFieldLength

2016-07-08 Thread Siraj Haider
Hello there, What is the default maximum field length in Lucene 6? In Lucene2.9 we use IndexWriter.MaxFieldLength to increase the default to 100,000 as we index some very large fields. What should be the alternate for that in Lucene 6? -- Regards -Siraj Haider (212) 306-0154 __

Re: Port of Custom value source from v4.10.3 to v6.1.0

2016-07-08 Thread Yonik Seeley
Use the docValues interface by calling getSortedSetDocValues on the leaf reader. That will either 1) use real docValues if you have indexed them 2) use the FieldCache to uninvert an indexed field and make it look like docValues. -Yonik On Thu, Jul 7, 2016 at 1:33 PM, paule_lecuyer wrote: > Hi