Speed up searching on index created using JdbcDirectory

2014-08-20 Thread Mahesh Charegaonkar
Hi Lucene masters, I was using lucene couple of years back. We have developed application which uses lucene's JdbcDirecory feature. Using JdbcDirecory we have writing and reading data from database. Over the time data has increased tremendously and that why we are facing performance issue with se

Re: IndexReade​rWarmer and IndexWrite​r.GetReade​r()

2014-08-20 Thread Michael McCandless
The warmer is just used to warm merged segments before IW.getReader "sees" them. The idea is the a merge could produce a very large segment, and it could be you want to warm up the OS's IO cache on that segment before it becomes visible to a newly opened IW.getReader. It may improve the performan

Two-pass TokenFilter

2014-08-20 Thread Christian Beil
Hey guys, I need a TokenFilter that filters some tokens like the FilteringTokenFilter. The problem is, in order to do the filtering I need to know all tokens in advance. I thought I'll adapt the CachingTokenFilter in order to collect all tokens in the first pass. In the second pass it can use thi

Re: Lucene index corruption on HDFS

2014-08-20 Thread varun sharma
Please do help here. Thank you , Varun. On Tuesday, 15 July 2014 2:14 PM, varun sharma wrote: I am building my code using Lucene 4.7.1 and Hadoop 2.4.0 . Here is what I am trying to do Create Index 1. Build index in RAMDirectory based on data stored on HDFS . 2. Once built

IndexReade​rWarmer and IndexWrite​r.GetReade​r()

2014-08-20 Thread Shubhanshu Pathak
Hello Group Members, I am a new user of Lucene. Currently I am using lucene.net 3.0.3. In my application I am trying to get IndexReader from the existing instance of IndexWriter. Like this... IndexReader indexReader = m_IndexWriter.GetReader(); However when I read the documentation of the GetR