Re: Reindexing solr after backup restore

2015-05-01 Thread Jason Campbell
Hi guys, We ended up prototyping DynamoDB for a variety of reasons, so I didn't get to test this during the workweek, but it's still interesting as I use Riak for my personal projects (although not YZ yet). So here is the rough process I followed (mainly from http://docs.basho.com/riak/latest/

Re: Reindexing solr after backup restore

2015-04-24 Thread Zeeshan Lakhani
Awesome. Thanks. Zeeshan Lakhani programmer | software engineer at @basho | org. member/founder of @papers_we_love | twitter => @zeeshanlakhani > On Apr 24, 2015, at 8:56 PM, Jason Campbell wrote: > > This may be a case of force-replace vs replace vs reip. I'm happy to see if > I can get ne

Re: Reindexing solr after backup restore

2015-04-24 Thread Jason Campbell
This may be a case of force-replace vs replace vs reip. I'm happy to see if I can get new cluster from backup to keep the Solr indexes. The disk backup was all of /var/lib/riak, so definitely included the YZ indexes before the force-replace, and they were kept on the first node that was changed

Re: Reindexing solr after backup restore

2015-04-24 Thread Zeeshan Lakhani
Hey Jason, Yeah, nodes can normally be joined without a cluster dropping its Solr Index and AAE normally rebuilds the missing KV bits. In the case of restoring from a backup and having missing data, we can only recommend a reindex (the indexes that have the issue) with aggressive AAE settings

Re: Reindexing solr after backup restore

2015-04-24 Thread Jason Campbell
Is there a way to do a restore without rebuilding these indexes though? Obviously this could take a long time depending on the amount of indexed data in the cluster. It's a fairly big gotcha to say that Yokozuna fixes a lot of the data access issues that Riak has, but if you restore from a bac

Re: Reindexing solr after backup restore

2015-04-24 Thread Zeeshan Lakhani
Hey Jason, Here’s a little more discussion on Yokozuna backup strategies: http://lists.basho.com/pipermail/riak-users_lists.basho.com/2014-January/014514.html . Nonetheless, I wouldn’t say the behavior’s expe

Re: Reindexing solr after backup restore

2015-04-23 Thread Jason Campbell
I think I figured it out. I followed this guide: http://docs.basho.com/riak/latest/ops/running/nodes/renaming/#Clusters-from-Backups The first Riak node (changed with riak-admin reip) kept it's Solr index. However, the other nodes when joined via riak-admin cluster force-replace, dropped thei

Reindexing solr after backup restore

2015-04-23 Thread Jason Campbell
I've just done a backup and restore of our production Riak cluster, and Yokozuna has dropped from around 125 million records to 25million. Obviously the IPs have changed, and although the Riak cluster is stable, I'm not sure Solr handled the transition as nicely. Is there a way to force Solr t