Rendexing problem: Indexing folder size is keep on growing for same remote folder

2013-09-30 Thread gudiseashok
Hi I am reading log files a remote folder and keeping them in local folder and then I am indexing as I shown below, how ever I am not saving the whole content as input stream, I am splitting them with Grok regex and saving as below strings. I am repeating this "copy and indexing" process for ev

RE: OOM during commit - Lucene 3.6

2013-09-30 Thread Uwe Schindler
Hi, See also: http://wiki.apache.org/lucene-java/JavaBugs And also my talk about buggy JVMs: http://goo.gl/4E1eIm In general, JRockit does not work correctly with Lucene, use Offical Sun/Oracle JDKs (ideally Java 7)! If you want to use JRockit, use the -XnoOpt parameter, but this may slow down.

Re: OOM during commit - Lucene 3.6

2013-09-30 Thread Michael McCandless
The JVM is crashing right? (Not an OOMException)? This must be a bug in Jrockit. If you use a different JVM do you still see the crash? Mike McCandless http://blog.mikemccandless.com On Mon, Sep 30, 2013 at 2:39 PM, Saurabh Sethi wrote: > Hi, > > I have a method that deletes entries from Lu

Multi server

2013-09-30 Thread Neda Grbic
Hi all I'm hoping to use Lucene in my project, but I have two master-master servers. Is there any good tutorial how to make Lucene scalable (without Solr and similar web applications). Thanks

OOM during commit - Lucene 3.6

2013-09-30 Thread Saurabh Sethi
Hi, I have a method that deletes entries from Lucene and calls IndexWriter.commit() in the end. This method is called multiple times and each time the batch size varies from 5-20 items. After some deletions, commit() causes JVM to crash. I am using Lucene 3.6 and JDK is jrockit-jdk-1.6.0_22-R2

Re: please help me

2013-09-30 Thread parnab kumar
Just add the lucene jar files in the build path of the project. On Sat, Sep 28, 2013 at 5:04 PM, sajad naderi wrote: > hi > i want run code sample of "lucene in action"book by eclipse > please tell me how configure eclipse to run those code >

please help me

2013-09-30 Thread sajad naderi
hi i want run code sample of "lucene in action"book by eclipse please tell me how configure eclipse to run those code

How to make good use of the multithreaded IndexSearcher?

2013-09-30 Thread Benson Margulies
The multithreaded index searcher fans out across segments. How aggressively does 'optimize' reduce the number of segments? If the segment count goes way down, is there some other way to exploit multiple cores?

Re: Multiphrase Query in Lucene 4.3

2013-09-30 Thread Ian Lea
Whenever someone says they are using a custom analyzer that has to be a suspect. Does it work if you use one of the core lucene analyzers instead? Have you used Luke to verify that the index holds what you think it does? -- Ian. On Mon, Sep 30, 2013 at 3:21 PM, VIGNESH S wrote: > Hi, > > It

Re: Multiphrase Query in Lucene 4.3

2013-09-30 Thread VIGNESH S
Hi, It is not the problem with case..Because Iam using LowercaseFilter. My Analyzer is a custom analyzer which will ignore just white spaces.All other numbers date and other special characters it will consider.The Same analyzer works for Lucene 3.6. When i do a single term query for "Geoffrey"

Re: Multiphrase Query in Lucene 4.3

2013-09-30 Thread Ian Lea
Whenever someone says something along the lines of a search for "geoffrey" not matching "Geoffrey" the case difference springs out, Can't recall what if anything you said about the analysis side of things but that could be the cause. See http://wiki.apache.org/lucene-java/LuceneFAQ#Why_am_I_gettin