Re: Websphere and Dark Matter

2007-01-16 Thread Nadav Har'El
On Tue, Jan 16, 2007, Rollo du Pre wrote about "Re: Websphere and Dark Matter": > I was hoping it would, yes. Does websphere not release memory back to > the OS when it not longer needs it? I'm concerned that if the memory > spiked for some reason (indexing a large document) then that would > ha

Re: only one search result

2007-01-16 Thread Erick Erickson
What analyzer are you using when you *index*? Just as the analyzer you use when you query breaks up the query string, the analyzer you use when you index breaks up the indexing stream. You can easily get unexpected results when you use one analyzer for indexing and another for parsing your query.

rangequery not tokenizer

2007-01-16 Thread John Song
It seems that range query is not going through tokenization process. E.g.: I have a field call "iso" which contains the photographic iso number such as 100, 200, 400, ... I have a special tokenizer that convert the integer using lucene's NumberTools.longToString. If I search "iso:100" everyth

Re: Another MultiFieldQueryParser question...

2007-01-16 Thread Erick Erickson
UN_TOKENIZED fields are indexed "as is", without going through an analyzer. What that means is 1> no casing is done. 2> multi-word values are stored just like they are put in. So indexing "wordone wordtwo" results in exactly one token being indexed... you guessed it, "wordone wordtwo". Which m

only one search result

2007-01-16 Thread silegav_k
Hi! I am quite new to lucene, so forgive me if I cannot see something obvious. I have the following code: <--Code Start > IndexReader reader = IndexReader.open(index); S

RE: Another MultiFieldQueryParser question...

2007-01-16 Thread Jiho Han
Thanks for the information. After checking out the query using ToString(), I did not see anything unusual really. But I noticed that the search result was a miss only for certain field combinations. And eventually it led me to the conclusion that the search was not returning results where the fie

Re: Sorting using Lucene search query syntax

2007-01-16 Thread Erik Hatcher
On Jan 16, 2007, at 3:22 PM, moraleslos wrote: Is it possible to specify a sort on a field using standard Lucene search query syntax? I was not able to find it in the query doc so I assume not but I would like to make sure before going on to use the API. Thanks in advance! No, the Quer

Sorting using Lucene search query syntax

2007-01-16 Thread moraleslos
Is it possible to specify a sort on a field using standard Lucene search query syntax? I was not able to find it in the query doc so I assume not but I would like to make sure before going on to use the API. Thanks in advance! -los -- View this message in context: http://www.nabble.com/Sortin

Re: html parsers and numers of terms

2007-01-16 Thread ohad
Hi All Just wanted to fill you in on an open source project i have recently published. It is called Java Mozilla Html Parser ( on sourceforge , http://sourceforge.net/projects/mozillaparser ). I had to create a java html parser that works just like browser do , so the natural selection was using m

Re: Websphere and Dark Matter

2007-01-16 Thread Rollo du Pre
Hi John, I was hoping it would, yes. Does websphere not release memory back to the OS when it not longer needs it? I'm concerned that if the memory spiked for some reason (indexing a large document) then that would hamper the rest of the OS because it'd hold on to far more memory than is need

Re: Websphere and Dark Matter

2007-01-16 Thread John Haxby
Rollo du Pre wrote: We have a scenario where a web search app using Lucene causes Websphere 5.1 allocated memory to grow but not shrink. JProfiler shows the heap shrinks back ok, leaving the JVM with over 1GB allocated to the jvm but only 400MB in use. Websphere does not perform a level 2 garbage

Websphere and Dark Matter

2007-01-16 Thread Rollo du Pre
Hi, Has anyone encountered significant amounts of Websphere Dark Matter generation when using Lucene? We have a scenario where a web search app using Lucene causes Websphere 5.1 allocated memory to grow but not shrink. JProfiler shows the heap shrinks back ok, leaving the JVM with over 1GB alloc

RE: My Category Search Problem

2007-01-16 Thread Graham Stead
Hello Vijay, I'm not sure whether such a change is feasible for you, but Solr has supported facets for some time now. Solr is a front-end for Lucene that provides a number of valuable features not found in Lucene itself: caching, FunctionQueries, and facets, to name a few. It has an XML interface

Re: How to support float type term in Lucene?

2007-01-16 Thread David
thanks, I use the port PyLucene, and I wonder if there is some utils in Lucene that can convert floating point number to sortable string, somebody tell me there should be such utils, but I can't find it in Lucene document. Appreciate your help! 2007/1/10, Yonik Seeley <[EMAIL PROTECTED]>: On 1