Re: Faceted search with OpenBitSet/SortedVIntList

2009-02-17 Thread Paul Elschot
On Tuesday 17 February 2009 10:12:12 Raffaella Ventaglio wrote: > Thanks for sharing this info. > In any case, this is not a problem for me since I have used only the "idea" > to choose between OpenBitSet and SortedViIntList from contrib BooleanFilter, > but I have then implemented it in my own fac

Re: Faceted search with OpenBitSet/SortedVIntList

2009-02-17 Thread Raffaella Ventaglio
Thanks for sharing this info. In any case, this is not a problem for me since I have used only the "idea" to choose between OpenBitSet and SortedViIntList from contrib BooleanFilter, but I have then implemented it in my own facets manager structure, so I do not use the "removed" finalResult method.

Re: Faceted search with OpenBitSet/SortedVIntList

2009-02-15 Thread Paul Elschot
Meanwhile the choice between SortedVIntList and OpenBitSet has been removed from the trunk (development version), that now uses OpenBitSet only: https://issues.apache.org/jira/browse/LUCENE-1296 In case there is preference to have SortedVIntList used in the next lucene version (i.e. in cases when

Re: Faceted search with OpenBitSet/SortedVIntList

2009-02-08 Thread John Wang
Hi Paul: Took a little time to find these classes, they are post-2.4 additions I think. Our representation: 1) We do not build on top of the FieldCacheImpl class for a few reasons: It is keyed off of the IndexReader, and application cannot clear the cache, and we assume indexes can upd

Re: Faceted search with OpenBitSet/SortedVIntList

2009-02-08 Thread Paul Elschot
ngaea.de/ > E-mail: uschind...@pangaea.de > > > -Original Message- > > From: Raffaella Ventaglio [mailto:r.ventag...@gmail.com] > > Sent: Sunday, February 08, 2009 9:47 AM > > To: java-user@lucene.apache.org > > Subject: Re: Faceted search with OpenBitSet/So

Re: Faceted search with OpenBitSet/SortedVIntList

2009-02-08 Thread Paul Elschot
John, On Sunday 08 February 2009 00:35:10 John Wang wrote: > Our implementation of facet search can handle this. Using bitsets for > intersection is not scalable performance wise when index is large. > > We are using a compact forwarded index representation in memory for the > counting. Could yo

RE: Faceted search with OpenBitSet/SortedVIntList

2009-02-08 Thread Uwe Schindler
1 218 65595 Fax: +49 421 218 65505 http://www.pangaea.de/ E-mail: uschind...@pangaea.de > -Original Message- > From: Raffaella Ventaglio [mailto:r.ventag...@gmail.com] > Sent: Sunday, February 08, 2009 9:47 AM > To: java-user@lucene.apache.org > Subject: Re: Faceted se

Re: Faceted search with OpenBitSet/SortedVIntList

2009-02-08 Thread Erik Hatcher
On Feb 8, 2009, at 3:32 AM, Raffaella Ventaglio wrote: Hi Chris, The "SortedVIntList" approach is similar to field cache. It's better to use the fieldcache for the facet search, which is the "normal" approach and used in tools like Solr, DBSight, Bobo Browse Engine, etc. Thanks for you

Re: Faceted search with OpenBitSet/SortedVIntList

2009-02-08 Thread Raffaella Ventaglio
Hi Paul, One way to implement that would be to use one of the boolean combination > filters in contrib, BooleanFilter or ChainedFilter, and simply count the > the number of times next() returns true on the result. I am sorry, but I cannot understand: how can I create a BooleanFilter or a Chaine

Re: Faceted search with OpenBitSet/SortedVIntList

2009-02-08 Thread Raffaella Ventaglio
Hi Chris, The "SortedVIntList" approach is similar to field cache. It's better to use > the fieldcache for the facet search, which is the "normal" approach and > used > in tools like Solr, DBSight, Bobo Browse Engine, etc. Thanks for your answer, I did not know about FieldCache. However, I think

Re: Faceted search with OpenBitSet/SortedVIntList

2009-02-07 Thread John Wang
Our implementation of facet search can handle this. Using bitsets for intersection is not scalable performance wise when index is large. We are using a compact forwarded index representation in memory for the counting. Similar to FieldCache idea but more compact. Check it out at: http://sourcefor

Re: Faceted search with OpenBitSet/SortedVIntList

2009-02-07 Thread Paul Elschot
On Saturday 07 February 2009 19:57:19 Raffaella Ventaglio wrote: > Hi, > > I am trying to implement a kind of faceted search using Lucene 2.4.0. > > I have a list of configuration rules that tell me how to generate this > facets and the corresponding queries (that can range from simple term > que

Re: Faceted search with OpenBitSet/SortedVIntList

2009-02-07 Thread Chris Lu
The first approach is rather limiting when facets number grows. The "SortedVIntList" approach is similar to field cache. It's better to use the fieldcache for the facet search, which is the "normal" approach and used in tools like Solr, DBSight, Bobo Browse Engine, etc. To avoid creating a lot of

Re: Faceted search with OpenBitSet/SortedVIntList

2009-02-07 Thread Sameer Maggon
Did you look at Solr? It provides faceted search out of the box and is built on top of Lucene. Sameer. On Feb 7, 2009, at 10:57 AM, Raffaella Ventaglio wrote: Hi, I am trying to implement a kind of faceted search using Lucene 2.4.0. I have a list of configuration rules that tell me how

Faceted search with OpenBitSet/SortedVIntList

2009-02-07 Thread Raffaella Ventaglio
Hi, I am trying to implement a kind of faceted search using Lucene 2.4.0. I have a list of configuration rules that tell me how to generate this facets and the corresponding queries (that can range from simple term queries to complex boolean queries). When my application starts, it creates the w