Re: Simultaneous Indexing and searching

2020-09-09 Thread Christoph Kaser
Hi Richard, it seems like lucene index replication could help you here: you could create the index on the backend server and replicate it to the frontend servers. http://shaierera.blogspot.com/2013/05/the-replicator.html http://blog

Re: Simultaneous Indexing and searching

2020-09-02 Thread Matt Davis
Also can check out https://github.com/zuliaio/zuliasearch for a thinner approach closer to native lucene or just to see examples of using lucene. On Wed, Sep 2, 2020, 11:24 AM Alex K wrote: > FWIW, I agree with Michael: this is not a simple problem and there's been a > lot of effort in Elasticse

Re: Simultaneous Indexing and searching

2020-09-02 Thread Alex K
FWIW, I agree with Michael: this is not a simple problem and there's been a lot of effort in Elasticsearch and Solr to solve it in a robust way. If you can't use ES/solr, I believe there are some posts on the ES blog about how they write/delete/merge shards (Lucene indices). On Tue, Sep 1, 2020 at

Re: Simultaneous Indexing and searching

2020-09-01 Thread Michael Sokolov
So ... this is a fairly complex topic I can't really cover it in depth here; how to architect a distributed search engine service. Most people opt to use Solr or Elasticsearch since they solve that problem for you. Those systems work best when the indexes are local to the service that is accessing

Simultaneous Indexing and searching

2020-09-01 Thread Richard So
Hi there, I am beginner for using Lucene especially in the area of Indexing and searching simultaneously. Our environment is that we have several webserver for the search front-end that submit search request and also a backend server that do the full text indexing; whereas the index files are

Re: simultaneous indexing and searching causing intermitently long searches.

2009-04-05 Thread Michael McCandless
On Sat, Apr 4, 2009 at 5:03 PM, Dan OConnor wrote: > We have watched GC times closely in the past. Most of the results of us > trying various settings was to make GC worse instead of better. OK, but is a slow "stop the world" GC event to blame for the queries that unexpectedly long to come back

RE: simultaneous indexing and searching causing intermitently long searches.

2009-04-04 Thread Dan OConnor
riginal Message- From: Michael McCandless [mailto:luc...@mikemccandless.com] Sent: Saturday, April 04, 2009 6:38 AM To: java-user@lucene.apache.org Subject: Re: simultaneous indexing and searching causing intermitently long searches. On Fri, Apr 3, 2009 at 10:21 PM, Dan OConnor wrote: >

Re: simultaneous indexing and searching causing intermitently long searches.

2009-04-04 Thread Michael McCandless
On Fri, Apr 3, 2009 at 10:21 PM, Dan OConnor wrote: > All, > > I have a several questions regarding query response time and I would > appreciate any help that can be provided. > > We have a system that indexes approximately 200,000 documents per day at a > fairly constant rate and holds them in

simultaneous indexing and searching causing intermitently long searches.

2009-04-03 Thread Dan OConnor
All, I have a several questions regarding query response time and I would appreciate any help that can be provided. We have a system that indexes approximately 200,000 documents per day at a fairly constant rate and holds them in a cfs-style file system directory index for 8 days. The index is