Hi all,
Before posting this question I have read a couple of old threads on this list
on ways to update an existing index. the conclusion was to recreate a new
index. unfortunalty this may not be possible in my case (please correct me if I
am wrong).
let me first describe what I am having trou
you can initiliaze your IndexSearcher in a Servlet Listner, and even warm it up
with few queries. that way when the user sends the first query it won't take a
long time to load the index in RAM.
> -Original Message-
> From: Fabrice Robini [mailto:[EMAIL PROTECTED]
> Sent: Tuesday, June 2
Hi all,
my index size has grown too much and I keep getting outOfMemoryError after
running few searches. I am using all the RAM that the JVM is allowing me 2.6GB.
I am left with two solutions now, the easy and expensive solution is to upgrade
the hardware to a 64-bit System and use more RAM. the
have a look at spring module 0.3. it has a lucene module which contains many
interesting classes LuceneIndexTemplate, LuceneSearchTemplate, and all kind of
factotires following spring concepts.
here is the url to the documentation: http://www.springframework.org/node/270
-Original Message---
Hi all,
I need to be able to get specific documents out of the returned documents
without the need to retrieve all the other documents.
just to describe my case, the user is allowed to specify in the queryString the
page number and number of results to return. for example if a query returns
100
you have two choices that I can think of:
1- before adding a document, check if it does't exist in the index. you can do
this by querying on a unique field if you have it .
2- you can index all your documents, and once the indexing is done you can
dedupe. (Lucene has built in methods that can hel
I have tried to use the isCurrent() method IndexReader to figure out if an
index is merging. but since I have to do this evrytime I need to add a
document, the performance got s slow.
here is what I am doing, I create 4 indexs and I am running with 4 threads. I
do a round robbin on the ind
tor really high
so that merges will never happen, and set maxBufferedDocs to the size
of the segments you want.
-Yonik
On 2/2/06, Omar Didi <[EMAIL PROTECTED]> wrote:
> Hi all,
>
> I am trying to index in 2 different indexes with different mergefactors. so
> if one of the index
Hi all,
I am trying to index in 2 different indexes with different mergefactors. so if
one of the indexes is merging than I want to index only on the other index.
is there a way to know if an index is merging?.
thanks
-
To uns
if you get an OutOfMemoryException, I beleive the only thing you can do
is just increase the JVM heap to a larger size.
-Original Message-
From: Harald Stowasser [mailto:[EMAIL PROTECTED]
Sent: Monday, June 13, 2005 8:28 AM
To: java-user@lucene.apache.org
Subject: Re: TooManyClauses in Boo
this depends on the analyzer you are using, use luke and check that numbers are
actually in the index. if not then use an analyzer that does index numbers.
omar
-Original Message-
From: Daniel Naber [mailto:[EMAIL PROTECTED]
Sent: Tuesday, June 07, 2005 4:27 PM
To: java-user@lucene.apach
what you can do is open the index and loop through all the documents in
decending order.
the code below will explain more.
Directory dir = FSDirectory.getDirectory( args[ 0 ], false );
IndexReader reader = IndexReader.open( dir );
int numDocs = reader.numDocs();
HashSet items = new HashSet( size
ces, play with copies and see what
happens.
Otis
--- Omar Didi <[EMAIL PROTECTED]> wrote:
> hey guys,
>
> my application died while I was merging two indexes. acoording to my
> undestanding, if I just delete the new files that have been created
> while I started merg
hey guys,
my application died while I was merging two indexes. acoording to my
undestanding, if I just delete the new files that have been created while I
started merging, the index won't be affected. is this true?. what will happen
if i just restart the merging from where the application died?
Hi guys,
I am writing an indexing applications that writes to 4 different indexes. the
way it work is the following: I write to one index every 1 documents and
then close that index and call optimize() as well, at the same time I write to
the second index and close it after 1 docs and s
Hi guys,
If a field is indexed as UnStored how can I get it value?
I tried document.get("UnStored_field") it returns null.
thanks
-Original Message-
From: Kevin L. Cobb [mailto:[EMAIL PROTECTED]
Sent: Wednesday, April 20, 2005 8:52 AM
To: java-user@lucene.apache.org
Subject: RE: Best way
-Original Message-
From: Erik Hatcher [mailto:[EMAIL PROTECTED]
Sent: Friday, April 15, 2005 8:11 PM
To: java-user@lucene.apache.org
Subject: Re: strange results using QueryFilter
On Apr 15, 2005, at 4:52 PM, Omar Didi wrote:
> Hi guys,
>
> I have to do a search where the user wi
Hi guys,
I have to do a search where the user will enter a query and then i have to get
the hit's length for that term plus get the hit's length for that term such
that the url ends with com or net or . I used QueryFilter, it works fine
when the query is only one word but when the query is
hi guys,
is it possible to filter the hits returned from a certain query?. for example
if I have a search like this:
Query searchQuery = queryParser.parse( query );
Hits results = m_searcher.search( searchQuery );
is there a way to use the results and find out how many of the ret
I have 5 indexes, each one is 6GB...I need 512MB of Heap size in order to open
the index and have all type of queries. My question is, is it better to just
have on large Index 30GB? will increasing the Heap size increase performance?
can I store an instance of MultiSearcher(OR just Searcher in c
-
> From: Erik Hatcher [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, March 30, 2005 8:58 PM
> To: java-user@lucene.apache.org
> Subject: Re: error when query contains numbers
>
>
>
> On Mar 30, 2005, at 8:05 PM, Omar Didi wrote:
>> the .toString() looks excactly like
ut I can t find them. any
ideas??
-Original Message-
From: Erik Hatcher [mailto:[EMAIL PROTECTED]
Sent: Wednesday, March 30, 2005 8:58 PM
To: java-user@lucene.apache.org
Subject: Re: error when query contains numbers
On Mar 30, 2005, at 8:05 PM, Omar Didi wrote:
> the .toString() l
[mailto:[EMAIL PROTECTED]
Sent: Wed 3/30/2005 8:58 PM
To: java-user@lucene.apache.org
Subject: Re: error when query contains numbers
On Mar 30, 2005, at 8:05 PM, Omar Didi wrote:
> the .toString() looks excactly like the query I enter: if I search for
> "yahoo AND 200" it retu
as indexed, I am just
developing an aplication to search using the analyzer that was used while
indexing.
my concern now is if there is an error with the way the indexing was do I have
to reindex the documents?
thanks
On Mar 30, 2005, at 4:41 PM, Omar Didi wrote:
> I am using a QueryParser
hi guys,
I am using a QueryParser to search the index. when the query has numbers, i don
t get any results??
any suggestions??
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
: Wednesday, March 30, 2005 1:59 PM
To: java-user@lucene.apache.org
Subject: Re: searcher question
Omar Didi wrote:
> I am having a large index (100GB) and when i run the following code :
>
> String indexLocation = servlet.getServletContext().getInitParameter(
> "com.lucene.index
I am having a large index (100GB) and when i run the following code :
String indexLocation = servlet.getServletContext().getInitParameter(
"com.lucene.index" );
logger.log( Level.INFO, "got the index location from: " + indexLocation );
searcher = new IndexSearcher(indexLocation);
logger.log( Lev
Hi all,
I am running a search on a large index (100GB), my search consists of
10 booleanQueries that run at the same time and their results is
combined to display the results. the first problem is it is very slow,
but that is normal i guess for such a big index, the problem i have
been having late
Hi all,
I am running a search on a large index (100GB), my search consists of
10 booleanQueries that run at the same time and their results is
combined to display the results. the first problem is it is very slow,
but that is normal i guess for such a big index, the problem i have
been having late
I have the following expression :
results is of type Hits, i want to know if there is a way using Expression
language or jstl to access for example: result.doc(i).
Hi folks,
I have a task when I need to read the query entered by the user, add to it many
other terms in a boolean expression and get the count of each clause in a
different field.
for examples: if the user enters: red. i need to take red and generate the
following query(red AND blue) OR (red A
Hi folks,
I have a task when I need to read the query entered by the user and then add to
it many other terms in a boolean expression.
for examples: if the user enters: red. i need to take red and generate the
following query(red AND blue) OR (red AND green) OR( red AND yellow). the
problem is
expression
Omar Didi writes:
> thank you so much Eric and Morus, I have a clear idea now how it works. i
> will try to implement a custom code that adds the parenthesis to boolean
> expressions with some rules about operator precedence.
>
I rather suggest, that you patch QP inst
A B AND C and would be used to set the flag on
the A clause.
Erik
On Mar 1, 2005, at 9:12 AM, Omar Didi wrote:
> I found something kind fo weird about the way lucene interprets
> boolean expressions wihout parenthesis.
> when i run the query A AND B OR C, it returns only the doc
34 matches
Mail list logo
