Re: Speed up searching on index created using JdbcDirectory

2014-08-23 Thread Pradeep Bhattiprolu
trace the DB operation Lucene is performing for your search operation and pass on the explain plan to the list. There is little you can do to tune this from a Lucene point of view but you can probably tune the database to perform this operation faster. This solution would just get you going for

SegmentReader heap usage with stored field compression on

2014-08-23 Thread Vitaly Funstein
Is it reasonable to assume that using stored field compression with a lot of stored fields per document in a very large index (100+ GB) could potentially lead to a significant heap utilization? If I am reading the code in CompressingStoredFieldsIndexReader correctly, there's a non-trivial accounti

Re: Speed up searching on index created using JdbcDirectory

2014-08-23 Thread Mahesh Charegaonkar
Hi, My company policy not allowed me to place files on websphere server JVM, so thats why we are placing index files in database and searching using JDBCDirectory. I am using 2.4 Lucene API jars API with below ways to search the fields from index, Directory dir; = new JdbcDirectory (ds,dialect

RE: Speed up searching on index created using JdbcDirectory

2014-08-23 Thread Uwe Schindler
Hi, there is no need to have an index in a relational database. Lucene indexes are commonly stored as files on local disks. Use FSDirectory subclasses to do this! For more details about performance problem, you should maybe give us more details. Uwe - Uwe Schindler H.-H.-Meier-Allee 63, D

Re: Speed up searching on index created using JdbcDirectory

2014-08-23 Thread Mahesh Charegaonkar
Thanks Uwe for your response. Could you please tell me if i have to still need to keep index in database what will be good option for searching. Thanks Mahesh On Sat, Aug 23, 2014 at 2:15 PM, Uwe Schindler wrote: > Don't use JDBCDirectory. It does not scale and has very poor performance. > Th

RE: Speed up searching on index created using JdbcDirectory

2014-08-23 Thread Uwe Schindler
Don't use JDBCDirectory. It does not scale and has very poor performance. This is why it was removed in Lucene 3. Uwe - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message- > From: Mahesh Charegaonkar [mailto:mahesh.

Re: Speed up searching on index created using JdbcDirectory

2014-08-23 Thread Mahesh Charegaonkar
HI All, Please help me out to resolve this issue. Your help is really appriciated. Thanks Mahesh On Wed, Aug 20, 2014 at 1:57 PM, Mahesh Charegaonkar < mahesh.charegaon...@gmail.com> wrote: > Hi Lucene masters, > > I was using lucene couple of years back. We have developed application > which