Re: Retrieving large numbers of documents from several disks in parallel

2011-12-27 Thread Erick Erickson
I'll take your word for it, though it seems odd. I'm wondering if there's anything you can do to pre-process the documents at index time to make the post-processing less painful, but that's a wild shot in the dark... Another possibility would be to fetch only the fields you need to do the post-pro

Re: Retrieving large numbers of documents from several disks in parallel

2011-12-27 Thread Robert Bart
Erick, Thanks for your reply! You are probably right to question how many Documents we are retrieving. We know it isn't best, but significantly reducing that number will require us to completely rebuild our system. Before we do that, we were just wondering if there was anything in the Lucene API o