Re: Java Heap Space -Out Of Memory Error

2007-09-13 Thread Sebastin
It works finally .i use Lucene 2.2 in my application.thanks testn and Mike Michael McCandless-2 wrote: > > > It sounds like there may be a Lucene version mismatch? When Luke was used > it was likely based on Lucene 2.2, but it sounds like an older version of > Lucene is now being used to open

Re: Lucene

2007-09-13 Thread Devinder Singh
I want to know what type of setup i need to get started with Lucene. Do i need Java and Apache Tomcat on Windows XP. Devinder On 14/09/2007, Devinder Singh <[EMAIL PROTECTED]> wrote: > > Hi Chris > > Thanks do you also have a channel on IRC so we wan communicate. > > Devinder > > > On 14/09/2

Re: Lucene

2007-09-13 Thread Devinder Singh
Hi Chris Thanks do you also have a channel on IRC so we wan communicate. Devinder On 14/09/2007, Chris Lu <[EMAIL PROTECTED]> wrote: > > Hi, Devinder, > > Lucene is agnostic of any database configuration. You need to pull data > via > jdbc out, and feed it to Lucene to create an index file, and

Re: Lucene

2007-09-13 Thread Chris Lu
Hi, Devinder, Lucene is agnostic of any database configuration. You need to pull data via jdbc out, and feed it to Lucene to create an index file, and then use Lucene API to search on it. -- Chris Lu - Instant Scalable Full-Text Search On Any Database/Application site: ht

Re: Lucene

2007-09-13 Thread Devinder Singh
> Hi > > I want to use Apache Lucene to do a full text search for Postgresql. > > May i know the set up requirements and if it supports postgresql > > -- > Devinder -- Devinder

Re: Treating values of numeric fields as numbers

2007-09-13 Thread Erik Hatcher
Ivan - have you considered using NumberUtils? I'm curious if those utility methods solve the same problem you're working on. Erik On Sep 13, 2007, at 1:19 PM, I

Re: search results with sort

2007-09-13 Thread spinergywmy
Hi, Thanks. However, I tested with more terms in title field, for instance, lucene sort, abc_def, and that works. I deleted the old index file and re-index the whole documents again, and it works fine. So, I'm little bit confuse about how that really work. Please advise. -- View t

Re: Tokenization question

2007-09-13 Thread Mike Klaas
On 13-Sep-07, at 12:37 PM, Dan Luria wrote: What I do is Doc1 = source_doc Doc2 = new Document() foreach (field f in doc1.getfields) { Doc2.Add(new Field(doc1.getField(key), doc1.getField(value)); } but when i pull the fields from Doc1, i never get the tokenized field.. it just doesnt appea

Re: Tokenization question

2007-09-13 Thread Dan Luria
What I do is Doc1 = source_doc Doc2 = new Document() foreach (field f in doc1.getfields) { Doc2.Add(new Field(doc1.getField(key), doc1.getField(value)); } but when i pull the fields from Doc1, i never get the tokenized field.. it just doesnt appear. so my question is -- i can see that field in

Re: search results with sort

2007-09-13 Thread Chris Hostetter
:I have this exception there are more terms than documents in field : "Title", but it's impossible to sort on tokenized fields. : :I'm try to sort the result by Title and the field title is un_tokenized : and it has only one term such as document, 06, rational, etc, and some other : field

Re: regarding FieldSelector

2007-09-13 Thread Erick Erickson
I'm not entirely sure. So what I'd do if I were you is write a little test program and step through it in the debugger and see But, if you're only allowing the user to fetch a single document at a time, I don't think it matters enough to worry about. If, on the other hand, you're allowing the

Treating values of numeric fields as numbers

2007-09-13 Thread Ivan Vasilev
Hi All, I have made some changes in my Lucene source, so that values of numeric fields to be treated as numbers but not as Strings. After testing everything seems to work correctly, but I still would like to know your opinion about this. So my approach is the following: 1. As during the inde

Re: Problem in building Lucene

2007-09-13 Thread Matthew Hall
Also, ensure that you didn't inadvertently add an older version of your Jar file somewhere in your classpath. Eclipse will take the first it comes to, and skip any others found later on in the path. Right Click on your Project -> Properties -> Java Build Path and ensure you don't have an olde

Re: Java Heap Space -Out Of Memory Error

2007-09-13 Thread testn
As Mike mentioned, what is the version of Lucene you are using? Plus can you also post the stacktrace? Sebastin wrote: > > Hi testn, > i wrote the case wrongly actually the error is > > java.io.ioexception file not found-segments > > testn wrote: >> >> Should the file be "segme

Re: Java Heap Space -Out Of Memory Error

2007-09-13 Thread Sebastin
Hi testn, i wrote the case wrongly actually the error is java.io.ioexception file not found-segments testn wrote: > > Should the file be "segments_8" and "segments.gen"? Why is it "Segment"? > The case is different. > > > Sebastin wrote: >> >> java.io.IoException:File Not Found

Re: Java Heap Space -Out Of Memory Error

2007-09-13 Thread Michael McCandless
It sounds like there may be a Lucene version mismatch? When Luke was used it was likely based on Lucene 2.2, but it sounds like an older version of Lucene is now being used to open the index? Mike "testn" <[EMAIL PROTECTED]> wrote: > > Should the file be "segments_8" and "segments.gen"? Why is

Re: Problem in building Lucene

2007-09-13 Thread Koji Sekiguchi
Try to reread jar file on Eclipse. To do it, right-click on your project, then choose refresh. Thank you, Koji sandeep chawla wrote: I have to change lucene code for some reason. I changed the source code of the lucene and ran the ant command on build.xml. it created a jar file in build dire

Re: Java Heap Space -Out Of Memory Error

2007-09-13 Thread testn
Should the file be "segments_8" and "segments.gen"? Why is it "Segment"? The case is different. Sebastin wrote: > > java.io.IoException:File Not Found- Segments is the error message > > testn wrote: >> >> What is the error message? Probably Mike, Erick or Yonik can help you >> better on this

Re: Java Heap Space -Out Of Memory Error

2007-09-13 Thread Sebastin
java.io.IoException:File Not Found- Segments is the error message testn wrote: > > What is the error message? Probably Mike, Erick or Yonik can help you > better on this since I'm no one in index area. > > Sebastin wrote: >> >> HI testn, >> 1.I optimize the Large Indexes of size

Re: regarding FieldSelector

2007-09-13 Thread Mohammad Norouzi
well, actually, I have 5 index directory and it will increase in future. and the thing is that each document about 20 fields on average. considering many users may connect to the system (we anticipate 500 users at this time) I want to know whether this will make performance issue or not. we provi

Problem in building Lucene

2007-09-13 Thread sandeep chawla
I have to change lucene code for some reason. I changed the source code of the lucene and ran the ant command on build.xml. it created a jar file in build directory then i added the jar file to my project in eclipse . I am facing a bizarre problem now. Changes i have made in source code are not

Re: regarding FieldSelector

2007-09-13 Thread Erick Erickson
Do you have any evidence that you're having a performance issue? If not, I'd just do the simple thing and ignore the rest. The performance issues I found were because I was spinning through many, many documents. If you're only worrying about one document at a time, it may not be an issue. If you *

Re: Tokenization question

2007-09-13 Thread Erick Erickson
If I'm understanding you correctly, the answer is... maybe, kinda. Take a look at some of the Luke code. That tries to reconstruct document fields from the index, but it's lossy. So it depends upon what kind of fidelity you need. Erick On 9/12/07, Dan Luria <[EMAIL PROTECTED]> wrote: > > If I hav

Re: Java Heap Space -Out Of Memory Error

2007-09-13 Thread testn
What is the error message? Probably Mike, Erick or Yonik can help you better on this since I'm no one in index area. Sebastin wrote: > > HI testn, > 1.I optimize the Large Indexes of size 10 GB using Luke.it > optimize all the content into a single CFS file and it generates > segmen

OutOfMemoryError: allocLargeArray

2007-09-13 Thread testn
I got this intermittent stacktrace 3 times in a month from using Lucene with JRockIt. Has anyone ever seen this in Lucene 2.2? java.lang.OutOfMemoryError: allocLargeArray at org.apache.lucene.util.PriorityQueue.initialize(PriorityQueue.java:36) at org.apache.lucene.index.SegmentMe

Re: regarding FieldSelector

2007-09-13 Thread Mohammad Norouzi
Thanks as I saw the documents, we can only use this great field selector in IndexReader.document() method the problem is I have a Searcher in my result set structure and when the client calls getString("a_field_name") at that time I invoke the searcher.doc(current_doc_id).get("a_field_name), I alre

Re: Java Heap Space -Out Of Memory Error

2007-09-13 Thread Sebastin
HI testn, 1.I optimize the Large Indexes of size 10 GB using Luke.it optimize all the content into a single CFS file and it generates segments.gen and segments_8 file when i search the item it shows an error that segments file is not there.could you help me in this testn wrote: > >