IndexSearcher on multi-core CPU machine

2007-02-18 Thread dmitri
We have search (no update) web app on 2 dual core CPU machine (2x Dual Core AMD Opteron(tm) Processor 280) with 8G of RAM. Lucene 2.0 is used. My index is optimized and non compound, 9G holding 6.5 M documents. Search includes term queries, range filters and sorts. When I use single IndexSearche

Re: IndexSearcher on multi-core CPU machine

2007-02-19 Thread dmitri
I use - searcher = new IndexSearcher(indexLocation); - So readers are created under the hood. dmitri karl wettin-3 wrote: > > > 18 feb 2007 kl. 22.52 skrev dmitri: > >> With org.apache.lucene.store.MMapDirectory throughput is better but >

Re: IndexSearcher on multi-core CPU machine

2007-02-19 Thread dmitri
I don't think so as sorting in on integer fields - dmitri Paul Smith-2 wrote: > > are you using Locale-sensitive sorting at all? > > https://issues.apache.org/jira/browse/LUCENE-806 > > Just wondering if you're seeing the same problem we are having.

Re: IndexSearcher on multi-core CPU machine

2007-02-19 Thread dmitri
I haven't tried using several IndexSearchers over a single IndexReader. Do you think it can help? --- dmitri karl wettin-3 wrote: > > > What are the effects if you supply the same reader to IndexSearcher:s? > > 19 feb 2007 kl. 16.03 skrev dm

Scoring while sorting

2007-02-21 Thread dmitri
What is the point to calculate score if the result set is going to be sorted by some field? Is it ok to replace several terms query (a OR b OR c) with MatchAllQuery and RangeFilters (from a to a, from b to b, from c to c) if sorting is needed? Won't it be faster? - d

ParallelSearcher in multi-node environment

2007-02-27 Thread dmitri
dexes somewhere? -- Thank you Dmitri -- View this message in context: http://www.nabble.com/ParallelSearcher-in-multi-node-environment-tf3301080.html#a9182802 Sent from the Lucene - Java Users mailing list archive at Nabbl

Re: [ANN] ParallelSearcher in multi-node environment

2007-03-01 Thread dmitri
l for every document) Dmitri -- View this message in context: http://www.nabble.com/ParallelSearcher-in-multi-node-environment-tf3301080.html#a9245525 Sent from the Lucene - Java Users mailing list archive at Nabbl

Re: Which stemmer?

2012-11-26 Thread Dmitri Mamrukov
Sent from my iPhone On Nov 16, 2012, at 7:18 PM, "Igal @ getRailo.org" wrote: R > This message cannot be displayed because of the way it is formatted. Ask the > sender to send it again using a different format or email program. > text/plainydckcu -

IndexSearcher and multi-threaded performance

2008-11-11 Thread Dmitri Bichko
ot retrieving any results. The index is about 5GB and 20 million documents. This is running on a 8 x quad-core Opteron machine with plenty of RAM to spare. Any idea why I would see this behaviour? Thanks, Dmitri - To unsubsc

Re: IndexSearcher and multi-threaded performance

2008-11-11 Thread Dmitri Bichko
n the safe side). Still, looks like the extra resource management overhead for ram-thread beats whatever lock-contention ram-shared introduces. I'm rerunning everything with readonly set and nio, I'll post the results once it's done. Cheers, Dmitri On Tue, Nov 11, 2008 at 5:40

Re: IndexSearcher and multi-threaded performance

2008-11-11 Thread Dmitri Bichko
17251 21199 39947 9704 12 17267 36284 40208 10996 I can't seem to get NIOFSDirectory working, though. Calling NIOFSDirectory.getDirectory("foo") just returns an FSDirectory. Any ideas? Cheers, Dmitri On Tue, Nov 11, 2008 at 5:09 PM, Mark Miller <[EMAIL PROTECT

Re: IndexSearcher and multi-threaded performance

2008-11-12 Thread Dmitri Bichko
>From the user perspective: a public constructor would be the most obvious, and would be consistent with RAMDirectory. Dmitri On Wed, Nov 12, 2008 at 4:50 AM, Michael McCandless <[EMAIL PROTECTED]> wrote: > > I think we really should open up a non-static way to choose a differen

Re: IndexSearcher and multi-threaded performance

2008-11-12 Thread Dmitri Bichko
17 23 8154 24 8685 25 7878 26 8398 27 8265 28 8266 29 7951 30 8606 31 8385 32 8630 That solves it for me, but I do see a fair amount of free time on this machine - if there are other things you want to benchmark, I'd be happy to do it. Cheers,

Retrieving payloads for terms matched by a query

2009-05-21 Thread Dmitri Bichko
I'll need custom tokenizers/filters to identify and tag the entities and handle class references in queries, but that part seems pretty straightforward). Does this sound workable? Thanks, Dmitri - To unsubscribe, e-mail: j

Hardware recommendation

2005-09-09 Thread Dmitri Bichko
ore complex records (ie many fields, but little data with each), which are mostly retrieved on unique identifiers (very little text searching). This would probably run to a few tens of millions of records, maybe around 100 million eventually. Given these applications, what else should I be thinking a

Sentence classification with Lucene

2025-02-17 Thread Dmitri Geller
Hi all, I would like to classify a sentence into one or two categories. I see this classification roughly this way: ``` unknown:    example1    example2    ...    exampleN class1:    example1    example2    ...    exampleN class2:    example1    example2    ...    exampleN ... classN:    exa

RE: Re: Sentence classification with Lucene

2025-02-19 Thread Dmitri Geller
ghbors. > > Regards, > Tommaso > > [1] : > https://lucene.apache.org/core/10_1_0/classification/org/apache/lucene/classification/package-summary.html > > On Mon, 17 Feb 2025 at 16:15, Dmitri Geller wrote: > > > Hi all, I would like to classify a sentence into o