Re: lucene indexwriter crash

2013-07-25 Thread ash nix
Is this a local > drive or a remote mount? > > IndexWriter tried to create a new file and hit that odd Input/output > error... > > Mike McCandless > > http://blog.mikemccandless.com > > > On Wed, Jul 24, 2013 at 8:53 PM, ash nix wrote: > > Hi, > > > >

lucene indexwriter crash

2013-07-24 Thread ash nix
Hi, I am using lucene 4 to index very big data. The indexer crashed after three days (147Gig of current index size). I find the stack trash weird. Any ideas on this will be helpful. Exception in thread "main" java.io.FileNotFoundException: /ir/data/data/collections/KBA/2013/index/1322092800-13264

Re: high memory usage by indexreader

2013-03-27 Thread ash nix
gainst a local index first. > > > -- > Ian. > > > On Thu, Mar 21, 2013 at 10:37 PM, ash nix wrote: >> Hi Ian, >> >> Thanks for your reply. >> The index is on NFS and there is no storage local/near to machine. >> Operating system is CentOS 6.3 with

numeric range query

2013-03-25 Thread ash nix
Hi, I have time stamp field for my documents which I have indexed as DoubleField for NumericRange query to work. This field "stream_time" is indexed as DoubleField("stream_time", , Field.Store.No). I get null value when I query a lucene document for this field by using document.getField() call. Do

Re: high memory usage by indexreader

2013-03-21 Thread ash nix
've ever worked with but I'm > still surprised it takes 4 minutes to initialize an index reader. > > What exactly do you mean by initialization? Show us the code that > takes 4 minutes. > > What version of lucene? What OS? What disks? > > > -- > Ian. >

Re: high memory usage by indexreader

2013-03-20 Thread ash nix
f you are determined to split the index. > > > -- > Ian. > > > On Wed, Mar 20, 2013 at 5:12 PM, ash nix wrote: >> Hi Everybody, >> >> I have created a single compound index which is of size 250 Gigs. >> I open a single index reader to search simple boolean quer

high memory usage by indexreader

2013-03-20 Thread ash nix
Hi Everybody, I have created a single compound index which is of size 250 Gigs. I open a single index reader to search simple boolean queries. The process is consuming lot of memory search painfully slow. It seems that I will have to create multiple indexes and have multiple index readers. Can an

re-indexing a field

2013-03-15 Thread ash nix
Hi, I have time stamp field which I should have indexed as DoubleField for numericrange queries/filter to work. I got it indexed as DoubleDocValuesField. Is it possible to reindex this field? Don't want to create a new index as it will take lot of time. Pointer to some document or blog on reindexi

SpanQuery getSpan call in lucen 4

2013-03-11 Thread ash nix
Hi, I was following tutorail at http://searchhub.org/2009/05/26/accessing-words-around-a-positional-match-in-lucene/ for couting number of spans of a query in a document. But the defination of getSpan(IndexReader) in the SpanQuery is changed to getSpan(IndexReaderContext, Bits, Map) with no inform

counting spans through spanquery.

2013-03-08 Thread ash nix
Hello, Following is brief description of what I want to do. === Search for Phrase query in index. Phrases are two to four terms at max. Scoring of the documents is based on the number of occurrence of phrase in a document. ===