Re: Performance problems with lazily loaded fields

2011-03-22 Thread Erick Erickson
Don't do that Let's back up a second and ask why in the world you want to do this, what's the use-case you're satisfying? Because spinning through all the results and getting information from the underlying documents is inherently expensive since, as Sanne says, you're doing disk seeks. Most L

Re: Performance problems with lazily loaded fields

2011-03-21 Thread Sanne Grinovero
2011/3/21 Brian Hurt : > I'm having a problem with the performance of lazily-loaded fields with > lucene.  The basic structure of the code is that I get a set of documents > back from a query, then iterate through them, reading most fields to collect > fragments.  This is taking an excessively long

Performance problems with lazily loaded fields

2011-03-21 Thread Brian Hurt
I'm having a problem with the performance of lazily-loaded fields with lucene. The basic structure of the code is that I get a set of documents back from a query, then iterate through them, reading most fields to collect fragments. This is taking an excessively long amount of time- mostly in my c