Issue with indexed tokens position

2007-08-17 Thread Ramana Jelda
Hi, Lucene doesn't find following value. Some issues with PhraseQuery. indexed value: pink-I Indexed tokens:1: [pink:0->5] 2: [pinki:0->5] 3: [i:5->6] (ex. explanation: "pink" is a term "0->5" term-position) And I have indexed in a field called "fieldName". My lucene search with the query [fieldN

RE: Issue with indexed tokens position

2007-08-17 Thread Ramana Jelda
Strangely.. My lucene query: fieldName:"pinki i" finds document. (see "i" in "pinki") Jelda > -----Original Message- > From: Ramana Jelda [mailto:[EMAIL PROTECTED] > Sent: Friday, August 17, 2007 12:33 PM > To: java-user@lucene.apache.org >

RE: Issue with indexed tokens position

2007-08-17 Thread Ramana Jelda
Have you used Luke to examine your index and see if it's > indexed as you expect? > > Best > Erick > > On 8/17/07, Ramana Jelda <[EMAIL PROTECTED]> wrote: > > > > Strangely.. > > My lucene query: fieldName:"pinki i" finds document. (see "i&quo

RE: Issue with indexed tokens position

2007-08-20 Thread Ramana Jelda
Hi Hoss & Erick, Thx for your responses. I found the bug in my code. It is not something todo with positions (As I said in my first mail, I was using right position increments) and also nothing to do with offsets. Offsets are just ignored, only useful for Highlighter perhaps. Anyway I am not intere

RE: Lucene id generation

2006-12-11 Thread Ramana Jelda
I really lack this feature from lucene too. Whatever the requirements from Mohammed, There surely I see some improvements in search performance. My argument here is, why not lucene provides a mechanism to be able to provide custom document ids? > -Original Message- > From: Find Me [mailt

RE: Lucene id generation

2006-12-15 Thread Ramana Jelda
Hi Hoss, Exactly in this scenario, I would love to use my custom generated document id. The array reference number is MyId & its value is some-interested-value matched to MyID. So,how can I generate custom document id.? Jelda > -Original Message- > From: Chris Hostetter [mailto:[EMAIL PR

RE: How can I use SortComparator in my case?

2007-03-05 Thread Ramana Jelda
gt; Subject: RE: How can I use SortComparator in my case? > > You'll need to do it manually and not with Lucene. > > Just grab all the results from Lucene and process them yourself. > > Aviran > http://aviransplace.com > > -Original Message- > From: Ram

RE: FieldCache: flush cache explicitly

2007-03-09 Thread Ramana Jelda
Yeap. I strongly support John. I knew when I reopen indexes. Then what is the reason to wait for garbage collector.. And that too, FieldCache uses WeakHashMap and that may lead some memory leaks. Jelda > -Original Message- > From: John Wang [mailto:[EMAIL PROTECTED] > Sent: Friday, March

RE: How can I use SortComparator in my case?

2007-03-27 Thread Ramana Jelda
ue, you might trysearchinng for that. Also, try > > "buckets" which was the header of that discussion. > > > > You can also think about clever indexing schemes with fields that > > allow you to sort however you really need to, although I confess > > nothin

RE: How can I use SortComparator in my case?

2007-03-27 Thread Ramana Jelda
Actually I don't like well my proposed way of implementation. I wanna play with score to implement the similar logic as I mentioned in my solution. But how? Any suggestions, I would really appreciate. :) Jelda > -Original Message- > From: Ramana Jelda [mailto:[EMAIL PROTECT

RE: How to avoid score calculation completely?

2007-05-24 Thread Ramana Jelda
But I also see importance of ignoring score calculation. If you put it aside performance gain, is there any possibility to completely ignore scoring calculation? Jelda > -Original Message- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf > Of Yonik Seeley > Sent: Wednesday,

RE: Using Lucene as compressed DB

2007-06-13 Thread Ramana Jelda
Its not a trick. And this is what lucene meant for. Jelda > -Original Message- > From: Sammpathkumar, C [mailto:[EMAIL PROTECTED] > Sent: Wednesday, June 13, 2007 9:36 AM > To: java-user@lucene.apache.org > Subject: Using Lucene as compressed DB > > Hi, > > I am looking for a in memor

RE: How to show category count with results?

2007-07-26 Thread Ramana Jelda
Hi , Of course this statement is very expensive. -->document.get("CAMPCATID")==null?"":document.get("CAMPCATID"); Use StringIndex/FieldCache/something similar to implement category counting. :) Jelda > -Original Message- > From: Bhavin Pandya [mailto:[EMAIL PROTECTED] > Sent: Thursday,

RE: indexreader refresh

2006-01-04 Thread Ramana Jelda
Hi Amol, Yeah you should close reader to get updated index into effect. Regards, Jelda -Original Message- From: Amol Bhutada [mailto:[EMAIL PROTECTED] Sent: Wednesday, January 04, 2006 4:21 PM To: java-user@lucene.apache.org Subject: indexreader refresh If I have a reader and searcher

RE: searching and indexing simultaneously...

2006-01-05 Thread Ramana Jelda
Hi, You are right. There can be multiple indexreaders but only one indexwriter is advised. No, we can not use two indexwriters simultaneously. Jelda -Original Message- From: K.A.Hussain Ali [mailto:[EMAIL PROTECTED] Sent: Thursday, April 06, 2006 5:01 PM To: java-user@lucene.apache.o

RE: searching and indexing simultaneously...

2006-01-05 Thread Ramana Jelda
, correct? -Original Message- From: Ramana Jelda [mailto:[EMAIL PROTECTED] Sent: Thursday, January 05, 2006 9:08 AM To: java-user@lucene.apache.org Subject: RE: searching and indexing simultaneously... Hi, You are right. There can be multiple indexreaders but only one indexwriter is advi

RE: lucene & ejbs

2006-02-10 Thread Ramana Jelda
HI, I am doing the same. My design contains. Index Repository: is responsible for keep up to index.:)Index-configurator. Index-manager: Real CRUD indexing.. And ofcourse index-searcher: I want results ..:) U know very well->Searcher and Indexer are both separate functionalities.. So the reason wh

RE: [ANN] Searchable 0.6.2 - Annotations for Lucene

2006-03-09 Thread Ramana Jelda
Hi, Exactly, I have already implemented in my application using annotations. and some changes to query input in my application. I don't see where you provide Analyzer annotation. It seems u forgot it. Nice coincidence. Jelda > -Original Message- > From: Seth Fitzsimmons [mailto:[EMAI

RE: Lucene In Action for lucene 2.0

2006-03-10 Thread Ramana Jelda
I look forward for it also. I even first look forward for LuceneInAction book to get up to date with lucene 2.0. Regards, Jelda > -Original Message- > From: Ernesto De Santis [mailto:[EMAIL PROTECTED] > Sent: Friday, March 10, 2006 2:49 PM > To: Lucene Users List > Subject: Lucene In Act

RE: speed

2006-03-10 Thread Ramana Jelda
Hi, You are opening IndexSearcher for each and every search request, which is not adviasable. Cache IndexSearcher or IndexReader.. This will surely improve your speed . Greetings, > -Original Message- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] > Sent: Friday, March 10, 2006 3

PhraseQuery with synonyms or having n tokens at the same tokenposition.

2006-03-27 Thread Ramana Jelda
Hi, PhraseQuery is not working as I wanted,when indexed with synonyms. ex: I have indexed name: "sony dsc-d cybershot" as following tokens provided token positions. 1: [sony:0->4] 2: [dsc:5->10] 3: [dscd:5->10] 4: [d:5->10] 5: [cybershot:11->20] So "dsc-d" is tokenized into 3 tokens "dsc

BooleanQuery containing SpanNearQuery throws ArrayOutOfBoundsException .

2006-03-28 Thread Ramana Jelda
Hi, I have a got strange problem. My searchterm : "mp3 player" Lucene Query : +( +( spanNear([productName:mp, productName:3], 3, true) spanNear([subName:mp, subName:3], 3, true) ) +(productName:player subName:player) ) Throws following lucene BooleanScorer2 exception. Caused by:

RE: BooleanQuery containing SpanNearQuery throws ArrayOutOfBoundsException .

2006-03-29 Thread Ramana Jelda
uesday, March 28, 2006 11:12 PM > To: java-user@lucene.apache.org > Subject: Re: BooleanQuery containing SpanNearQuery throws > ArrayOutOfBoundsException . > > Comments inline below. > > On Tuesday 28 March 2006 18:29, Ramana Jelda wrote: > > > > Hi, > > I

RE: Return all distinct values

2006-03-30 Thread Ramana Jelda
Hi, Actually lucene does not provide you a straight forward Query to get UNIQUE results. But as far as I know, u can use HitsCollector & BitSet combination to count/get unique results. Regards, Jelda > -Original Message- > From: Java Programmer [mailto:[EMAIL PROTECTED] > Sent: Thursday

RE: Lucene Seaches VS. Relational database Queries

2006-04-13 Thread Ramana Jelda
No.. I don't see your solution is performant.. If each lucene Document corresponds to a row in 'A join B' then Index explodes.. Index size drastically increases. Why not then creating two indexs A and B. And search for A and then from obtained A documents information search in B. It seems for me

RE: hypens

2006-04-18 Thread Ramana Jelda
Hi, I would use index & search analyzers in this case.. "b-trunk" is analyzed & indexed as b,btrunk,trunk Search term "b-trunk" is anlayzed using search analyzer as "btrunk" and searched. U will find the result.. Similarly for 12412-235, 12412-121, 12412-etc , indexed as 12412,12412235,235 etc...

RE: hypens

2006-04-18 Thread Ramana Jelda
> Which analyzer are you recommending I use for this? > > -Original Message- > From: Ramana Jelda [mailto:[EMAIL PROTECTED] > Sent: Tuesday, April 18, 2006 3:45 AM > To: java-user@lucene.apache.org > Subject: RE: hypens > > Hi, > I would use index & search analyzers in t

OutOfMemoryError while enumerating through reader.terms(fieldName)

2006-05-02 Thread Ramana Jelda
Hi, I am getting OutOfMemoryError , while enumerating through TermEnum after invoking reader.terms(fieldName). Just to provide you more information, I have almost 1 unique terms in field A. I can successfully enumerate around 5000terms but later I am gettting OutOfMemoryError. I set jvm max

RE: OutOfMemoryError while enumerating through reader.terms(fieldName)

2006-05-02 Thread Ramana Jelda
OutOfMemoryError. Any advise is relly welcome. Thx, Jelda > -Original Message- > From: Ramana Jelda [mailto:[EMAIL PROTECTED] > Sent: Tuesday, May 02, 2006 12:55 PM > To: java-user@lucene.apache.org > Subject: OutOfMemoryError while enumerating through > reader.terms(fieldNam

RE: OutOfMemoryError while enumerating through reader.terms(fieldName)

2006-05-02 Thread Ramana Jelda
I am trying to implement category count almost similar to CNET approach. At the initialization time , I am trying to create all these BitSets and then trying to and them with user query(with a bitset obtained from queryfilter containing user query).. This way my application is performant..Don't u

RE: OutOfMemoryError while enumerating through reader.terms(fieldName)

2006-05-02 Thread Ramana Jelda
query, using HitCollector docids, I will try to calculate each category count.. I think it is self understandable.. What do u think?? Any advice is really welcome.. Note: Actually, I have around 2 unique cateogry ids.. Thx, Jelda > -Original Message- > From: Ramana Jelda [

RE: OutOfMemoryError while enumerating through reader.terms(fieldName)

2006-05-02 Thread Ramana Jelda
Thx for ur quick reply. I will go through it. Rgds, Jelda > -Original Message- > From: mark harwood [mailto:[EMAIL PROTECTED] > Sent: Tuesday, May 02, 2006 5:03 PM > To: java-user@lucene.apache.org > Subject: RE: OutOfMemoryError while enumerating through > reader.terms(fieldName) >

RE: Obtain terms for only particular field(s)

2006-05-04 Thread Ramana Jelda
FieldCache.getStringIndex(reader,fieldName) Good luck Jelda > -Original Message- > From: Chun Wei Ho [mailto:[EMAIL PROTECTED] > Sent: Thursday, May 04, 2006 12:36 PM > To: java-user@lucene.apache.org > Subject: Obtain terms for only particular field(s) > > Hi, > > I have a pretty lar

RE: Range queries

2006-05-09 Thread Ramana Jelda
Hi, You can use BooleanQuery.setMaxClauseCount() to set to your required maximum clause count. But ofcourse too big clause count is not advisable. May be you need to find some strategy to reduce this range. Ex:Reduce date ranges to 20060505 from including timestamp like 20060505120530 :) All t

RE: Aggregating category hits

2006-05-16 Thread Ramana Jelda
But this BitSet strategy is more memory consuming mainly if you have documents in million numbers and categories in thousands. So I preferred in my project FieldCache strategy. Jelda > -Original Message- > From: Kapil Chhabra [mailto:[EMAIL PROTECTED] > Sent: Tuesday, May 16, 2006 7:38 A

RE: Aggregating category hits

2006-05-16 Thread Ramana Jelda
o: java-user@lucene.apache.org > Subject: Re: Aggregating category hits > > Hi Jelda, > I have not yet migrated to Lucene 1.9 and I guess FieldCache > has been introduced in this release. > Can you please give me a pointer to your strategy of FieldCache? > > Thanks & Regards, &g

RE: Aggregating category hits

2006-05-22 Thread Ramana Jelda
Kapil Chhabra wrote: > > Thanks a lot Jelda. > > I'll try this get back with the performance comparison chart. > > > > Regards, > > kapilChhabra > > > > Ramana Jelda wrote: > >> Hi Kapil, > >> As I remember FieldCache is in luce

How can I tell Lucene to also use analyzer for Keyword fields

2006-06-12 Thread Ramana Jelda
Hi, It seems anaylzers are never get called for UnTokenized fields(Seems no luck either using PerFieldAnalyzer). What should I do, If I would like to use analyzer for Untokenized fields. Lets say for Keyword or Unstored fields. I basically would like to use lucene Sort functionality on UnTokenize

RE: How can I tell Lucene to also use analyzer for Keyword fields

2006-06-13 Thread Ramana Jelda
Thanks for your replies. > -Original Message- > From: Chris Hostetter [mailto:[EMAIL PROTECTED] > Sent: Tuesday, June 13, 2006 9:13 AM > To: java-user@lucene.apache.org > Subject: Re: How can I tell Lucene to also use analyzer for > Keyword fields > > > : It seems anaylzers are never

RE: IndexSearcher in Servlet

2006-06-27 Thread Ramana Jelda
Hi, You are wrong. In ur case (If I ignore any updates to index) , One IndexSearcher object is enough. IndexSearcher is thread safe. Jelda > -Original Message- > From: heritrix.lucene [mailto:[EMAIL PROTECTED] > Sent: Tuesday, June 27, 2006 10:58 AM > To: java-user@lucene.apache.org > S

RE: HitCollector and Sort Objects

2006-06-30 Thread Ramana Jelda
Yeah!! There are no methods that you mentioned. But there are some ways to do this. TopFieldDocs:search(Query query, Filter filter, int n, Sort sort) If above method does not solve your purpose, then My suggestion is to use method search(Query query, Filter filter, HitCollector results) and pa

RE: retrieving LowestDoc

2006-09-01 Thread Ramana Jelda
Collect searched results in your own HitCollector and return results how ever you like.. :) Jelda > -Original Message- > From: Rupinder Singh Mazara [mailto:[EMAIL PROTECTED] > Sent: Friday, September 01, 2006 5:13 PM > To: java-user@lucene.apache.org > Subject: retrieving LowestDoc > >

RE: Using Hibernate to store Lucene Indexes in a Database

2006-09-08 Thread Ramana Jelda
HI Marcus, Somehow I like your wording.. Can't stop replying you. Jelda > -Original Message- > From: Marcus Falck [mailto:[EMAIL PROTECTED] > Sent: Friday, September 08, 2006 2:05 PM > To: java-user@lucene.apache.org > Subject: SV: Using Hibernate to store Lucene Indexes in a Database >