Re: Design Problem: Searching large set of protected documents

2007-04-04 Thread Paul Elschot
On Wednesday 04 April 2007 01:32, Erick Erickson wrote: > I thought you could simply add a ConstantScoreQuery (whose > constructor takes a Filter) to a BooleanQuery. It seems that doing > this at the very top level with a MUST would do the trick. I have not tried this myself, but indeed this m

Re: Design Problem: Searching large set of protected documents

2007-04-03 Thread Erick Erickson
I thought you could simply add a ConstantScoreQuery (whose constructor takes a Filter) to a BooleanQuery. It seems that doing this at the very top level with a MUST would do the trick. Erick On 4/3/07, Paul Elschot <[EMAIL PROTECTED]> wrote: On Tuesday 03 April 2007 17:44, Erick Erickson w

Re: Design Problem: Searching large set of protected documents

2007-04-03 Thread Paul Elschot
On Tuesday 03 April 2007 17:44, Erick Erickson wrote: > ... > Then simply add the users filter to a BooleanQuery (MUST) > that you use when you search. > Adding a Filter to a BooleanQuery is not (yet) possible. For the moment one needs to use the Searcher methods that take a filter and a query.

Re: Design Problem: Searching large set of protected documents

2007-04-03 Thread Grant Ingersoll
16:44 Please respond to java-user@lucene.apache.org To java-user@lucene.apache.org cc Subject Re: Design Problem: Searching large set of protected documents Storage isn't too much of a problem, 12.5 M since a Lucene Filter is just a BitSet, one bit per document. (plus some

Re: Design Problem: Searching large set of protected documents

2007-04-03 Thread Jonathan O'Connor
; > *"Michael D. Curtin" <[EMAIL PROTECTED]>* > > 03/04/2007 15:28 Please respond to > java-user@lucene.apache.org > > > To > > java-user@lucene.apache.org > cc > > > Subject > > Re: Design Problem: Searching large set of p

Re: Design Problem: Searching large set of protected documents

2007-04-03 Thread Erick Erickson
03/04/2007 15:28 Please respond to java-user@lucene.apache.org To java-user@lucene.apache.org cc Subject Re: Design Problem: Searching large set of protected documents Jonathan O'Connor wrote: > I have a database of a million documents and about 100 users. The docum

Re: Design Problem: Searching large set of protected documents

2007-04-03 Thread Jonathan O'Connor
Michael, as usual its never so easy! Some users can see almost all documents, and some other users can see very few. I did find an interesting document that describes the problem (but offers no solutions :-() http://www.ideaeng.com/pub/entsrch/v3n4/article01.html. This article talks about early a

Re: Design Problem: Searching large set of protected documents

2007-04-03 Thread Daniel Rosher
Hi Jonathon, Since the number of users in your application is small, perhaps you could apply a pre-generated filter per user, and apply this to the search, however this won't scale well if the number of users grow. Another idea might be to have several filters,each of which detail a particular t

Re: Design Problem: Searching large set of protected documents

2007-04-03 Thread Michael D. Curtin
Jonathan O'Connor wrote: I have a database of a million documents and about 100 users. The documents can have an access control list, and there is a complex, recursive algorithm to say if a particular user can see a particular document. My problem is that my search algorithm is to first do a st

Design Problem: Searching large set of protected documents

2007-04-03 Thread Jonathan O'Connor
Hi, I have a database of a million documents and about 100 users. The documents can have an access control list, and there is a complex, recursive algorithm to say if a particular user can see a particular document. My problem is that my search algorithm is to first do a standard lucene search for