Re: A broad question - What could go wrong if I copy paste a live index and use as backup

2018-04-18 Thread sandesh.yapuram
Thanks Adrien for pointing that out... I am going ahead with SnapshotDeletionPolicy. I will take backup of my index with this class, but I have run into a problem, I can't seem to understand how to take backup of my facets using the same deletion policy. -- Sent from: http://lucene.472066.n3.nab

A broad question - What could go wrong if I copy paste a live index and use as backup

2018-04-17 Thread sandesh.yapuram
I'm sorry for a vague question like this, but lemme narrow it down- I am trying to take back up of my live lucene index(Max size is 1-3 GBs). I am completely aware of the cleaner 'replicator' module, but I figured out it is too much code change for me. So here's what I am planning - I will copy p

What are other options for index backup/replication?

2018-04-13 Thread sandesh.yapuram
Hello, I have an application that uses lucene indexes and we generate a single index for all data. I want to take a weekly *local* backup of the index quitely and asynchronously. So far I've tried: 1. The replicator module - I found it very complicated for what I just want to copy and paste indexes

[lucene-6.3.0] hit tragic OutOfMemoryError inside getReader

2017-07-12 Thread sandesh.yapuram
I'm trying to index 5M Documents and currently indexing takes 13 hours. My data source is SQL db and I've verified out of 13 hours only 30 mins is spent in fetching data so SQL is not the bottleneck. The complete index size is 40GB. My application runs on Tomcat with 2GB JVM space. Just after the