Re: deleteDocuments(Term... terms) takes a long time to do nothing.

2013-12-17 Thread Michael McCandless
OK I'm glad it's resolved. Another way to handle the "expire old documents" would be to index into separate indices by time, and use MultiReader to search all of them. E.g. maybe one index per day. This way, to delete a day just means you don't pass that index to MultiReader. Mike McCandless h

Re: deleteDocuments(Term... terms) takes a long time to do nothing.

2013-12-16 Thread Jason Corekin
Mike, Thank you for your help. Below are a few comments to directly reply to your questions, but in general your suggestions helped to get me on the right track and I believe that have been able to solve the Lucene component of my problems. The short answer was that I when I had previously tri

Re: deleteDocuments(Term... terms) takes a long time to do nothing.

2013-12-14 Thread Jason Corekin
Mike, Thanks for the input, it will take me some time to digest and trying everything you wrote about. I will post back the answers to your questions and results to from the suggestions you made once I have gone over everything. Thanks for the quick reply, Jason On Sat, Dec 14, 2013 at 5:13 P

Re: deleteDocuments(Term... terms) takes a long time to do nothing.

2013-12-14 Thread Michael McCandless
It sounds like there are at least two issues. First, that it takes so long to do the delete. Unfortunately, deleting by Term is at heart a costly operation. It entails up to one disk seek per segment in your index; a custom Directory impl that makes seeking costly would slow things down, or if t

Re: deleteDocuments(Term... terms) takes a long time to do nothing.

2013-12-14 Thread Jason Corekin
I knew that I had forgotten something. Below is the line that I use to create the field that I am trying to use to delete the entries with. I hope this avoids some confusion. Thank you very much to anyone that takes the time to read these messages. doc.add(new StringField("FileName",filename, F

deleteDocuments(Term... terms) takes a long time to do nothing.

2013-12-13 Thread Jason Corekin
Let me start by stating that I almost certain that I am doing something wrong, and that I hope that I am because if not there is a VERY large bug in Lucene. What I am trying to do is use the method deleteDocuments(Term... terms) out of the IndexWriter class to delete several Term object Arra