What's the aggregate size of all your user indexes? And how many servers could you potentially spread the load across? What kind of queries do you allow? wildcards? simple term? Arbitrary Boolean expressions? What kind of throughput are you expecting?
Opening and closing a reader for each search is generally a bad idea, but so is having up to 200,000 concurrently open IndexReaders. Are you having performance issues? Why do you feel the need to change anything? I'm really asking for significantly more information from you in order to be able to give any meaningful reply.... Best Erick On 4/5/07, nesrka sri <[EMAIL PROTECTED]> wrote:
Hi, Iam currently working on indexing the documents present in a web based document management system. The system currently has around 200,000 users and each user has approximately 10 to 100 documents.We currently have around 50 GB of data. The system should allow the users only to search across his/her documents. Currently our system is designed such that each user has a separate index. The index size for each user is around 500KB to 5MB approx. For each document added by the user a indexwriter is created and for each search by the user a indexreader is created. ( I think it may not be a good idea). Can some throw some light on what kind of issues we might face with this kind of setup? Or should we have a single index. add unique user id as a field in each document. Search with user id added as a filter. Thanks, nesrka --------------------------------- Here's a new way to find what you're looking for - Yahoo! Answers