Lucene Term Encoder

2009-06-26 Thread John Seer
Hello, Is there any class in lucene which will do encoding for term? Thanks -- View this message in context: http://www.nabble.com/Lucene-Term-Encoder-tp24228145p24228145.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. --

Scaling out/up or a mix

2009-06-26 Thread Marcus Herou
Hi. I currently have an index which is 16GB per machine (8 machines = 128GB) (data is stored externally, not in index) and is growing like crazy (we are indexing blogs which is crazy by nature) and have only allocated 2GB per machine to the Lucene app since we are running some other stuff there in

Re: Optimizing unordered queries

2009-06-26 Thread Michael McCandless
On Thu, Jun 25, 2009 at 10:11 PM, Nigel wrote: > Currently we're (perhaps naively) doing the equivalent of > query.weight(searcher).scorer(reader).score(collector).  Obviously there's a > certain amount of unnecessary calculation that results from this if you > don't care about sorting.  Are there

Re: Optimizing unordered queries

2009-06-26 Thread eks dev
also see, http://lucene.apache.org/java/2_2_0/api/org/apache/lucene/search/BooleanQuery.html#getAllowDocsOutOfOrder() - Original Message > From: Nigel > To: java-user@lucene.apache.org > Sent: Friday, 26 June, 2009 4:11:53 > Subject: Optimizing unordered queries > > I recently pos

Re: Optimizing unordered queries

2009-06-26 Thread eks dev
You omitNorms(), did you also omitTf()? when something like https://issues.apache.org/jira/browse/LUCENE-1345 gets commited, you will have a posibility to see some benefits (e.g. by packing single postings lists as Filters). The code there optimises exactly that case as filters contain no Sco

Re: special Type of indexing

2009-06-26 Thread B0DYLANG
Thanks for your response, i want to explaing more so that you can help me, the code am writing is as follows Field termField = new Field("terms",terms, Field.Store.YES, Field.Index.TOKENIZED); the terms i indexed consists of a concatenated string looks like "computer,230#pc,333#lucene,201#" an

Re: customizing lucene formula

2009-06-26 Thread Grant Ingersoll
The source code is freely available. Take a look at the Similarity class and where it is used. Before you do that, though, perhaps there are other ways to achieve your goals. Feel free to explain what you are trying to do. -Grant On Jun 26, 2009, at 5:04 AM, B0DYLANG wrote: Dears, i

RE: setTermInfosIndexDivisor

2009-06-26 Thread Ganesh
Currently In DateTime field I am using ConstantScoreRangeQuery to do range query and doing sorting as String. Even i changed the sort field as Long then also i don't see much difference in RAM. When Lucene 2.9 is released? Is there any functionality added for better sorting? Regards Ganesh --

Re: special Type of indexing

2009-06-26 Thread Anshum
Isn't it better for you to for a query at search time with query term boosts? that way you would have a smaller index (Boost info not getting stored for each doc-field). Also, you would have the flexibility of changing your boost without having to reindex the entire data. -- Anshum Gupta Naukri La

Re: Analyzing performance and memory consumption for boolean queries

2009-06-26 Thread Toke Eskildsen
On Wed, 2009-06-24 at 21:38 +0200, Nigel wrote: > It sounds like surely any swapping out of the JVM memory could cause big and > unpredictable performance drops. As I just mentioned in reply to Uwe, our > poor performance times don't always directly correlate with index updates, > but it may be th

customizing lucene formula

2009-06-26 Thread B0DYLANG
Dears, i want to add some arguments to the lucene formula or override it, is there a mean of doing so ? thanks for your response. -- View this message in context: http://www.nabble.com/customizing-lucene-formula-tp24217132p24217132.html Sent from the Lucene - Java Users mailing list archive

special Type of indexing

2009-06-26 Thread B0DYLANG
dears, my problem is that i want to apply a wieght for each word i add to the lucene document, so that when i want to index a sentence like this "Hello how you doing" i want to add Hello with a boost equals to 0.75 and how with boost 0.50 and doing with boost 0.3 is there is a mean of doing that