Re: Deletions in NRTCAchingDirectory

2018-05-14 Thread Erick Erickson
" I have a use case of bulk deletions with solr and want to understand using soft commits will help or not." Will help with what? You haven't told us what the problem you're worried about is. This might help: https://lucidworks.com/2013/08/23/understanding-transaction-logs-s

Deletions in NRTCAchingDirectory

2018-05-14 Thread Shivam Omar
Hi, I need to understand whether deletions get put in memory by the NRTCachingDirectory or not. I have a use case of bulk deletions with solr and want to understand using soft commits will help or not. Please suggest. Shivam DISCLAIMER This email and any files transmitted with it are intended

Re: Deletions

2008-07-11 Thread Michael McCandless
files that should be deleted, but that is no longer used as of 2.1. Instead, Lucene computes (using reference counting) which files in the directory are no longer referenced. Mike Anshum wrote: Hi John, In case of deletions, it is just a delayed delete. In other words, the doc is just

Re: Deletions

2008-07-10 Thread Anshum
Hi John, In case of deletions, it is just a delayed delete. In other words, the doc is just marked as deleted in the deletable file, leaving a void in the numbering of docs. The actual shifting of document ids happens only when you optimize the index. In that case the deletables file is used to

Deletions

2008-07-10 Thread John Griffin
Guys (and Gals), A question on index deletions, what exactly happens to the Lucene document numbers in an index when a document is deleted? Let's say I have a 5 doc index. Document # Doc 0 doc1

Re: Lockless read-only deletions in IndexReader?

2007-09-04 Thread Michael McCandless
; > > >> I want to set documents in my IndexReader as deleted, but I will > >> never commit these deletions. Sort of a filter on a reader rather > >> than on a searcher, and no write-locks. > > > > >> I could go hacking in IndexReader, definalizing it

Re: Lockless read-only deletions in IndexReader?

2007-08-30 Thread Karl Wettin
20 aug 2007 kl. 14.33 skrev Michael McCandless: "karl wettin" <[EMAIL PROTECTED]> wrote: I want to set documents in my IndexReader as deleted, but I will never commit these deletions. Sort of a filter on a reader rather than on a searcher, and no write-locks. I cou

Re: Lockless read-only deletions in IndexReader?

2007-08-22 Thread Karl Wettin
Thanks Mike, I'll dig around a bit and report back what I did. 20 aug 2007 kl. 14.33 skrev Michael McCandless: "karl wettin" <[EMAIL PROTECTED]> wrote: I want to set documents in my IndexReader as deleted, but I will never commit these deletions. Sort of a filter on a

Re: Lockless read-only deletions in IndexReader?

2007-08-20 Thread Michael McCandless
"karl wettin" <[EMAIL PROTECTED]> wrote: > I want to set documents in my IndexReader as deleted, but I will > never commit these deletions. Sort of a filter on a reader rather > than on a searcher, and no write-locks. > Perhaps I can pass down a IndexDeletionP

Lockless read-only deletions in IndexReader?

2007-08-19 Thread karl wettin
I want to set documents in my IndexReader as deleted, but I will never commit these deletions. Sort of a filter on a reader rather than on a searcher, and no write-locks. Can I do that out of the box? Perhaps I can pass down a IndexDeletionPolicy to my IndexWriter that ignores deletions

Re: Batch deletions of Records from index

2005-11-25 Thread Chris Hostetter
: Need is to device a solution that will delete all the old records ( : three months). I tried keeping the record of Docid's added but that is : not really helping cause number of record added can vary. one solution : can be indexing the date of index also but i can not alter the index : now. we

Batch deletions of Records from index

2005-11-24 Thread Manish.Chowdhary
hii erik and other gurus, I have a big index with millions of document where every indexed document points to some system files and database rows. we are archiving the system files and database rows older then three months. Need is to device a solution that will delete all the old records ( thre

Re: Adding document with FileReader and deletions.

2005-06-08 Thread Chris D
On 6/7/05, Chris D <[EMAIL PROTECTED]> wrote: > Hi list, > > I've been trying to use lucene to index documents that change > occasionally with fields that change frequently. When I add the > contents of the file they are removed when I try to delete and readd > the document. I and am using somethi

Adding document with FileReader and deletions.

2005-06-07 Thread Chris D
Hi list, I've been trying to use lucene to index documents that change occasionally with fields that change frequently. When I add the contents of the file they are removed when I try to delete and readd the document. I and am using something like the following. public void index(String stuff, Fi