Freeing space used by deleted objects

2018-05-22 Thread Daniel Miller
Riak (CS)? I would like to answer the following: What factors affect the lag after deleting objects until space is freed on disk? Is there any manual intervention I can make on Cluster 3 to trigger garbage cleanup? Thank you! Daniel Miller Dimagi, Inc

Re: WARNING: Not all replicas will be on distinct nodes

2017-12-14 Thread Daniel Miller
e able to > resolve by leaving the node that has the violations, and then re-adding it. > > Sorry, I'm a bit rushed - but I hope this helps get you started. > > Martin > > > > > > On 14 December 2017 at 19:49, Daniel Miller wrote: > >> I have a 6 no

WARNING: Not all replicas will be on distinct nodes

2017-12-14 Thread Daniel Miller
I have a 6 node cluster (now 7) with ring size 128. On adding the most recent node I got the WARNING: Not all replicas will be on distinct nodes. After the initial plan I ran the following sequence many times, but always got the same plan output: sudo riak-admin cluster clear && \ sleep 10 && \ su

Re: Object not found after successful PUT on S3 API

2017-05-02 Thread Daniel Miller
ory requirements. I > understand why your swappiness setting is helping. It is pushing > executable pages into swap in favor of data memory pages. That is going to > help in your situation. Do not waste time going back to swappiness=0. > > Matthew > > > > On May 2,

Re: Object not found after successful PUT on S3 API

2017-04-28 Thread Daniel Miller
ak cs avoid the rare occasions where it overwrites the manifest file while using this (non-multi) backend? Thank you, Daniel Miller On Tue, Mar 7, 2017 at 3:58 PM, Luke Bakken wrote: > Hi Daniel, > > Thanks for providing all of that information. > > You are missing important confi

Re: Object not found after successful PUT on S3 API

2017-03-10 Thread Daniel Miller
t; this point without noticing it at all. > > *IMPORTANT:* you can't switch from your current configuration to this new > one without re-saving all of your data. > > -- > Luke Bakken > Engineer > lbak...@basho.com > > -- > Luke Bakken > Engineer > l

Re: Object not found after successful PUT on S3 API

2017-03-08 Thread Daniel Miller
ile. You may also have corrupted files at > this point without noticing it at all. > > *IMPORTANT:* you can't switch from your current configuration to this new > one without re-saving all of your data. > > -- > Luke Bakken > Engineer > lbak...@basho.com > > -- &g

Re: Object not found after successful PUT on S3 API

2017-03-07 Thread Daniel Miller
Also I just realized I gave the wrong platform_data_dir in the config-files.zip I sent yesterday. The correct path is shown in riak-env.txt as well as generated.configs.tbz attachments sent later. On Tue, Mar 7, 2017 at 9:47 AM, Daniel Miller wrote: > Responses inline. > > On Mon, Ma

Re: Object not found after successful PUT on S3 API

2017-03-07 Thread Daniel Miller
Responses inline. On Mon, Mar 6, 2017 at 3:04 PM, Luke Bakken wrote: > Hi Daniel, > > Two questions: > > * Do you happen to have an /etc/riak/app.config file present? > No. Not sure if relevant, but I did notice that /etc/riak-cs/advanced.config does exist, which contradicts with what I said e

Re: Object not found after successful PUT on S3 API

2017-03-06 Thread Daniel Miller
nclude here. > > Thanks > > -- > Luke Bakken > Engineer > lbak...@basho.com > > > On Mon, Mar 6, 2017 at 7:07 AM, Daniel Miller wrote: > > I recently had another case of a disappearing object. This time the > object > > was successfully PUT, and (unlike the p

Re: Object not found after successful PUT on S3 API

2017-03-06 Thread Daniel Miller
"small_vclock": 50, > > "write_once": false, > > "basic_quorum": false, > > "big_vclock": 50, > > "chash_keyfun": { > > "fun": "chash_std_keyfun", > > "mod&q

Re: Object not found after successful PUT on S3 API

2017-02-14 Thread Daniel Miller
gt; Hi Daniel - > > I don't have any ideas at this point. Has this scenario happened again? > > -- > Luke Bakken > Engineer > lbak...@basho.com > > > On Wed, Jan 25, 2017 at 2:11 PM, Daniel Miller wrote: > > Thanks for the quick response, Luke. > > >

Re: cluster clear without stopping node

2017-02-09 Thread Daniel Miller
: this is a little surprising since I think I’ve done that before but I haven’t observed it generating a new plan. I’ll try it again. Thanks for very quick response. Daniel ​ On Thu, Feb 9, 2017 at 9:27 AM, Magnus Kessler wrote: > On 8 February 2017 at 21:33, Daniel Miller wrote: > >>

cluster clear without stopping node

2017-02-08 Thread Daniel Miller
According to the docs “Running [riak-admin cluster clear] will also stop the current node in addition to clearing any staged changes. Is there a way to clear the current cluster plan without stopping the current node? Even better (

Re: Multiple nodes leaving cluster

2017-02-08 Thread Daniel Miller
Thanks Magnus and Shaun, that's very helpful. Daniel On Wed, Feb 8, 2017 at 4:00 AM, Magnus Kessler wrote: > On 7 February 2017 at 23:25, Daniel Miller wrote: > >> Hi Riak Users, >> >> In the documentation >> <http://docs.basho.com/riak/kv/2.2.0/using/adm

Multiple nodes leaving cluster

2017-02-07 Thread Daniel Miller
Hi Riak Users, In the documentation for riak-admin cluster leave it says “You can stage multiple leave command before planning/committing.” This implies that it is safe to stage multiple nodes leaving the cluster simultaneously. Is

Riak: leveldb vs multi backend disk usage

2017-01-26 Thread Daniel Miller
de during the replacement. Cluster size is 5 nodes. N-value is the default (3). These have not changed during the migration. Thanks in advance for any information you can provide. Daniel Miller ___ riak-users mailing list riak-users@lists.basho.com http

Re: Object not found after successful PUT on S3 API

2017-01-25 Thread Daniel Miller
at all of the log > files for "[error]" or other entries at about the same time as these > PUTs or 404 responses. > > Is there anything unusual about the key being used? > -- > Luke Bakken > Engineer > lbak...@basho.com > > > On Wed, Jan 25, 2017 at 6:40 A

Object not found after successful PUT on S3 API

2017-01-25 Thread Daniel Miller
involving GETs and PUTs that are not failing. I'm unsure of how to troubleshoot further to find out what may have happened to those objects and why they are now missing. What is the best approach to figure out why an object that was successfully PUT seems to be missing? Thanks

Re: Riak CS: avoiding RAM overflow and OOM killer

2016-11-28 Thread Daniel Miller
reduces > number of objects allocated to each node. The converse is also true, if you > double your node size you could halve your node count. That said, systems > like Riak like prefer more nodes. It's just a math game. > > @siculars > http://siculars.posthaven.com > > Sent from my iRota

Re: Riak CS: avoiding RAM overflow and OOM killer

2016-11-23 Thread Daniel Miller
t; Kota was a former Basho engineer who worked on CS... That said, Basho > may not support a non standard deployment. > > -Alexander > > On Mon, Nov 21, 2016 at 2:45 PM, Daniel Miller wrote: > > I found a similar question from over a year ago > > (http://lists.basho.com

Re: Riak CS: avoiding RAM overflow and OOM killer

2016-11-21 Thread Daniel Miller
using leveldb backend instead of the mutli backend for CS? On Fri, Nov 4, 2016 at 11:48 AM, Daniel Miller wrote: > Hi, > > I have a Riak CS cluster up and running, and am anticipating exponential > growth in the number of key/value pairs over the next few years. From > reading t

Riak CS: avoiding RAM overflow and OOM killer

2016-11-05 Thread Daniel Miller
ilability for a prolonged period if multiple nodes go down at once. Thanks! Daniel Miller Dimagi, Inc. ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com