RE: growing segments issue in lucene

2011-09-28 Thread suman.holani
Hi Ian, Thanks for reply. Let me reframe the question My aim is to search fast in ever changing indexes. So I decided onto use RAM directory index.but since it is not persistent .I need to copy onto FSFirectory , which is nothing but the replica of it for failure scenarios. RAMDirectory is used

Re: setting MaxFieldLength in indexwriter

2011-09-28 Thread Peyman Faratin
Ah. Thank you Steve Peyman On Sep 28, 2011, at 9:53 AM, Steven A Rowe wrote: > Hi Peyman, > > The API docs give a hint > : > > = > Nested Class Summary > ... > static class IndexWriter.MaxFieldLength >

Re: growing segments issue in lucene

2011-09-28 Thread Ian Lea
Please start new questions in a new thread. I suggest you start with a lucene tutorial, or look as solr, or dbsight. Your favourite search engine should have no problem finding all of them. -- Ian. On Wed, Sep 28, 2011 at 11:58 AM, Rajesh Nadiminti wrote: > Hi, > I need some help on implemen

Re: growing segments issue in lucene

2011-09-28 Thread Ian Lea
Seems a strange way of doing things. What do you gain by messing around with RAMDirectory? Anyway, you appear to just add docs to the file based index, so surely it will keep growing? You could try optimizing the file based index but that is unlikely to gain you a huge amount unless it holds del

RE: setting MaxFieldLength in indexwriter

2011-09-28 Thread Steven A Rowe
Hi Peyman, The API docs give a hint : = Nested Class Summary ... static class IndexWriter.MaxFieldLength Deprecated. use LimitTokenCountAnalyzer instead. =

setting MaxFieldLength in indexwriter

2011-09-28 Thread Peyman Faratin
Hi Newbie question. I'm trying to set the max field length property of the indexwriter to unlimited. The old api is now deprecated but I can't seem to be able to figure out how to set the field with the new (IndexWriterConfig) API. I've tried IndexWriterConfig.maxFieldLength(Integer.MAX_VALUE)

RE: growing segments issue in lucene

2011-09-28 Thread Rajesh Nadiminti
Hi, I need some help on implementing lucence search engine. we are using mysql DB(InnoDB Engine) with java as fromtend. we have one table with LONGBLOB type as column(contain text name/ value pairs). with some other columns Now using Lucence we need to search a string like "ZONE" on LONGBLOB v

growing segments issue in lucene

2011-09-28 Thread suman.holani
Hi , I am using lucene 3.0.3. It seems like either the lucene indexes are not getting optimized properly as the files created in lucene index dir is growing with every doc added Please let me know the way to restrict the files and segments created . merge factor is10 max merge docs is21