Re: Question about MaxFieldLength

2011-08-27 Thread roz dev
Thanks Li. It makes sense On Sat, Aug 27, 2011 at 7:28 PM, Li Li wrote: > It will affect the entire index because it 's a parameter of IndexWriter. > but you can modify it anytime you like before IndexWriter.addDocument. > If you want to truncate different fields with different maxLength. you

Re: Question about MaxFieldLength

2011-08-27 Thread Li Li
It will affect the entire index because it 's a parameter of IndexWriter. but you can modify it anytime you like before IndexWriter.addDocument. If you want to truncate different fields with different maxLength. you should avoid multithreads' race condition. maybe you can add a TokenFilter t

Question about MaxFieldLength

2011-08-27 Thread roz dev
Hi All I have a question regarding MaxFieldLength. Is it a limit for number of tokens in 1 field per document or entire index? Example: If MaxFieldLength is set to 100 and I add a document which has 105 tokens for 1 field then I expect 5 tokens to be ignored. but, if i add another document which

Re: Possible to use span queries to avoid stepping over null index positions

2011-08-27 Thread Trejkaz
On Sat, Aug 27, 2011 at 2:30 AM, wrote: > Hello, > In our indexes we have a field that is a combination of other various > metadata fields (i.e. subject, from, to, etc.). Each field that is added has > a null position at the beginning. As an example, in Luke the field data looks > like: > > nu