Re: anti_entropy and solr taking up suspiciously large amounts of space

2017-04-05 Thread Fred Dushin
Batching parameters only affect the update operations, so while deletes are relevant, none of the batching parameters will affect the issue you are seeing with TTLs that are only implemented in the back end. One thing that might help, in the future, is the sweeper functionality, which is curren

Re: anti_entropy and solr taking up suspiciously large amounts of space

2017-04-05 Thread Damien Krotkine
On Mon, Apr 3, 2017, at 22:20, Matthew Von-Maszewski wrote: > Rohit, > > My apologies for the delayed reply. Too many conflicting demands on > my time the past two weeks. > > I reviewed the riak-debug package you shared. I also discussed its > contents with other Riak developers. >

Re: anti_entropy and solr taking up suspiciously large amounts of space

2017-04-03 Thread Rohit Sanbhadti
our reliance on riak search on our application’s side. -- Rohit S. From: Matthew Von-Maszewski Date: Monday, April 3, 2017 at 1:20 PM To: Rohit Sanbhadti Cc: "riak-users@lists.basho.com" Subject: Re: anti_entropy and solr taking up suspiciously large amounts of space Rohit, My apo

Re: anti_entropy and solr taking up suspiciously large amounts of space

2017-04-03 Thread Matthew Von-Maszewski
Rohit, My apologies for the delayed reply. Too many conflicting demands on my time the past two weeks. I reviewed the riak-debug package you shared. I also discussed its contents with other Riak developers. There does not appear to be anything unexpected. The anti_entropy bloat is due to t

Re: anti_entropy and solr taking up suspiciously large amounts of space

2017-03-22 Thread Matthew Von-Maszewski
Rohit, Would you please run “riak-debug” on one server from the command line and send the tar.gz file it creates directly to me. Do not copy the email list. Notes on its usage are here: http://docs.basho.com/riak/kv/2.2.1/using/cluster-operations/inspecting-node/#riak-debug

Re: anti_entropy and solr taking up suspiciously large amounts of space

2017-03-21 Thread Rohit Sanbhadti
Matthew, To clarify, this happens on all nodes in our cluster (10+ nodes) although the exact size varies by 10s of GB. I’ve rolling restarted the cluster the last time this happened (last week) with no significant change in size, although the output from riak-admin aae-status and riak-admin sea

Re: anti_entropy and solr taking up suspiciously large amounts of space

2017-03-21 Thread Matthew Von-Maszewski
Rohit, If you restart the node does the elevated anti_entropy size decline after the restart? Matthew > On Mar 21, 2017, at 8:00 PM, Rohit Sanbhadti > wrote: > > Running Riak 2.2.0 on Ubuntu 16.04.1, we’ve noticed that anti_entropy is > taking up way too much space on all of our nodes. We

anti_entropy and solr taking up suspiciously large amounts of space

2017-03-21 Thread Rohit Sanbhadti
Running Riak 2.2.0 on Ubuntu 16.04.1, we’ve noticed that anti_entropy is taking up way too much space on all of our nodes. We use multi_backend with mostly bitcask backends (relevant part of config pasted below). Has anyone seen this before, or does anyone have an idea what might be causing this