I dont know whether this is helpful to you.
Our application is base on entity "project". Say we have 10 projects, then
we create 10 indexers. Then we use Jboss cache to load those indexes as
when needed.
Jboss cache has functionality to limit the size of memory usage.
Base points is breaking th
> : 2) I don't see the code to close your statement, connection, and
> : ResultSet. Those typically go to a finally block.
>
> I'm 85% sure that's the memory leak right there... in absence of a
> good memory profiler, have you tried commenting out all of the Lucene
> related code, to make sure th
Hi Otis,
thank you for you tips so far. I will use a profiles for finding out,
where the problem is. All your hints were helpful for me. I think the
problem is the connection to mySQL, not the indexer. So I will look
for newsgroup on the connector mysql-connector-java-3.1.10-bin.jar.
Or do you hav
A Hits object holds a reference to a Searcher and uses it to retrieve
docs not in the cache list.
Is it ok if I modify the Hits object in a way that it may have its
searcher replaced,
i.e. introduce a:
*setSearcher(Searcher s) { this.searcher = s; }*
method and invoke it (syncronously) between i
Try doing that in reverse order:
rs.close();
rs = null;
stmnt.close();
stmnt = null;
conn.close();
conn = null;
I usual do one more step also, just to be safe.
try {rs.close();} catch (Exception ignore) {}
rs = null;
try {stmnt.close();} catch (Exception ignore) {}
stmnt = null;
try {conn.close(
Hi
We have a web app, which keep a copy of the index searcher, then reloads
the index searcher every night to obtain the latest version of the
index( as it updates every day).
However, we have a fail over mode, which will eventually use another
index on another server, it there anyway to know if
Hi Steve;
Not sure if this would work...
Each day you could get the value from IndexReader's getCurrentVersion and
store it somewhere (DB or serialize it). The next day when you grab the
value again you could compare it to the stored one, if they differ you would
know it has been replaced.
Luke
Hi Luke
It's a good idea, but we need to know instantly the fail over happens.
We obtain a new instance of the index searcher every night anyway to
obtain the latest index. When the fail over happens, the index location
is in the same place, but was wandering if there was a way to find out
if the
Hi Steve,
we have a similar situation and we choosed the following solution:
The process that modifies the index (the writer) notifies the process
that searches the index (the reader)
In our case the notification is a specificly named subdirectory
"index_modified" of the directory containing th
If your SQL data volume is large, try to switch to the latest JDBC
driver from mySQL.
mysql-connector-java-3.2.0-alpha-bin.jar
More details is the lower part of this page:
http://wiki.dbsight.com/index.php?title=JDBC_Driver
--
Chris Lu
Lucene Search on Any Database
http://www.dbsig
Hi Stanislav,
Try it, but I think it won't work if document IDs don't match in the
old and new Index(Searcher).
Otis
--- Stanislav Jordanov <[EMAIL PROTECTED]> wrote:
> A Hits object holds a reference to a Searcher and uses it to retrieve
>
> docs not in the cache list.
> Is it ok if I modify
I've got an application that performs millions of searches against a
lucene index, can someone give me a bit of insight as to the memory
consumption of these searches? Is there a cap on how many are kept
around? is there any way I can disable caching for this type of
search?
--
_
Searches are not cached (other than possibly by the OS/File system).
IndexSearcher can/should be cached (by your application), and how much
memory it consumes depends on ... hm, I thought we included a formula
for that in Lucene in Action, but it looks like we only included the
formula for calcula
: Well, Doug provided this formula a few times, and I don't recall it off
: the top of my head, but I do know that the .tii index file will be
: fully read into memory, so look at the size of that file to get an
: initial idea.
the other big piece of caching that goes on is the FieldCache which i
Does anyone know why lucene would throw the following stacktrace
when a search runs while the system is in the process of merging
documents? Based on the book, this should be a legal operation.
I've seen this stacktrace mentioned several times in the archives but
I never seen a solut
Chris Fraschetti wrote:
I've got an application that performs millions of searches against a
If the results are not, say, "personalized", than I suggest some kind of
web container cache - I use and like OSCache - and it can even cache
page fragments.
http://www.opensymphony.com/oscache/
In my experience, when the index is updated, if you don't refresh the
searcher by open the index again, you will have this error.
--
Chris Lu
Lucene Search RAD on Any Database
http://www.dbsight.net
On 8/1/05, Tony Wiegand <[EMAIL PROTECTED]> wrote:
>
> Does anyone know why luce
17 matches
Mail list logo
