Riak Cluster Behavior - Clarification

2016-05-24 Thread Vikram Lalit
Hi - I'd appreciate if someone can opine on the below behavior of Riak that I am observing... is that expected, or something wrong in my set-up / understanding? To summarize, I have a 3-node Riak cluster (separate EC2 AWS instances) with a separate chat server connecting to them. When I write data

Re: Riak Cluster Behavior - Clarification

2016-05-24 Thread Vikram Lalit
ring? > > On Tue, May 24, 2016 at 7:34 AM, Vikram Lalit > wrote: > > Hi - I'd appreciate if someone can opine on the below behavior of Riak > that > > I am observing... is that expected, or something wrong in my set-up / > > understanding? > > > > To su

Riak not storing data in a round-robin manner across instances

2016-05-27 Thread Vikram Lalit
I have a Riak cluster (of 3 nodes, with 64 partitions and n_val = 3) but I find that for some objects, their hosting partitions / vnodes are not spread out across the 3 nodes. In some cases, 2 of them are on 1 node and the third is on a second node. That runs contrary to my understanding (link here

Re: Riak not storing data in a round-robin manner across instances

2016-05-27 Thread Vikram Lalit
the ring > such that there is an even distribution amongst the member nodes and that > no node is responsible for more than one replica of a key. > > > > On Friday, May 27, 2016, Vikram Lalit wrote: > >> I have a Riak cluster (of 3 nodes, with 64 partitions and n_val = 3) but >&g

Re: Riak not storing data in a round-robin manner across instances

2016-05-27 Thread Vikram Lalit
n one day ;) > > On Friday, May 27, 2016, Vikram Lalit wrote: > >> Ok got it thanks. >> On May 27, 2016 4:02 PM, "DeadZen" wrote: >> >>> reiterating my last email >>> >>> > theres no guarantee vnodes are assigned to unique ser

Re: Riak not storing data in a round-robin manner across instances

2016-05-27 Thread Vikram Lalit
nder > > On Friday, May 27, 2016, DeadZen wrote: > >> np, number of nodes and ring size play a lot into that. >> as does your r,w settings. >> might be fun to create a visualization one day ;) >> >> On Friday, May 27, 2016, Vikram Lalit wrote:

Re: Riak not storing data in a round-robin manner across instances

2016-05-31 Thread Vikram Lalit
Thanks very much Sam... much appreciated. On Fri, May 27, 2016 at 4:55 PM, Vikram Lalit wrote: > Thanks Alexander ... makes complete sense... > > On Fri, May 27, 2016 at 4:39 PM, Alexander Sicular > wrote: > >> There is a reason Basho's minimum production deploym

Re: Riak Cluster Behavior - Clarification

2016-05-31 Thread Vikram Lalit
e still up at the point the server went down.. > There are some configuration values you could experiment with, that > will ok a write only as long as its gone to a durable storage count.. > But keep in mind theres no guarantee vnodes are assigned to unique > servers.. > > > O

Re: Riak Cluster Behavior - Clarification

2016-05-31 Thread Vikram Lalit
aks-config-behaviors-part-2/ > http://basho.com/posts/technical/riaks-config-behaviors-part-3/ > http://basho.com/posts/technical/riaks-config-behaviors-part-4/ > > On Tue, May 24, 2016 at 3:08 PM, Vikram Lalit > wrote: > > It's returning no object at all for the relevant

Recovering Riak data if it can no longer load in memory

2016-07-12 Thread Vikram Lalit
Hi - I've been testing a Riak cluster (of 3 nodes) with an ejabberd messaging cluster in front of it that writes data to the Riak nodes. Whilst load testing the platform (by creating 0.5 million ejabberd users via Tsung), I found that the Riak nodes suddenly crashed. My question is how do we recove

Re: Recovering Riak data if it can no longer load in memory

2016-07-12 Thread Vikram Lalit
you run with less memory. > > In riak.conf, set: > > leveldb.limited_developer_mem = true > > Matthew > > > > On Jul 12, 2016, at 11:56 AM, Vikram Lalit > wrote: > > > > Hi - I've been testing a Riak cluster (of 3 nodes) with an ejabberd > messaging cluster i

Re: Recovering Riak data if it can no longer load in memory

2016-07-13 Thread Vikram Lalit
o save memory. > > Matthew > > P.S. You really want 8 CPU cores, 4 as a dirt minimum. And review this > for more cpu performance info: > > https://github.com/basho/leveldb/wiki/riak-tuning-2 > > > > On Jul 12, 2016, at 4:04 PM, Vikram Lalit wrote: > &g

Playing with / understanding Riak configurations

2016-07-27 Thread Vikram Lalit
Hi - I have a Riak node with n_val=3, r=2, w=2 and have just one key-object stored there-in. I'm trying to test various configurations to better understand the system and have the following observations - some dont seem to align with my understanding so far, so appreciate if someone can throw some

Re: Playing with / understanding Riak configurations

2016-07-27 Thread Vikram Lalit
fantastic blog series that places your question in > context and then answers it. > > > http://basho.com/posts/technical/understanding-riaks-configurable-behaviors-part-1/ > > Tom > > On Wed, Jul 27, 2016 at 4:07 PM, Vikram Lalit > wrote: > >> Hi - I have a Riak no

Re: Playing with / understanding Riak configurations

2016-07-28 Thread Vikram Lalit
existing data, as you have, is not-recommended and the source of your > inconsistent results. > > Tom > > On Wed, Jul 27, 2016 at 4:18 PM, Vikram Lalit > wrote: > >> Thanks Tom... Yes I did read that but I couldn't deduce the outcome if n >> is decreas

High number of Riak buckets

2016-09-29 Thread Vikram Lalit
Hi - I am creating a messaging platform wherein am modeling each topic to serve as a separate bucket. That means there can potentially be millions of buckets, with each message from a user becoming a value on a distinct timestamp key. My question is there any downside to modeling my data in such a

Re: High number of Riak buckets

2016-09-30 Thread Vikram Lalit
that all buckets are part of that bucket type. > > http://docs.basho.com/riak/kv/2.1.4/developing/usage/bucket-types/ > > -- > Luke Bakken > Engineer > lbak...@basho.com > > On Thu, Sep 29, 2016 at 4:42 PM, Vikram Lalit > wrote: > > Hi - I am creating a messagin

Re: High number of Riak buckets

2016-09-30 Thread Vikram Lalit
TS makes all > sorts of time series oriented projects easier than modeling them against > KV. Oh, and you can also leverage KV buckets alongside TS (resource > limitations not withstanding.) > > Would love to hear more, > Alexander > > @siculars > http://siculars.postha

Associating Riak CRDT Sets to Buckets / Keys via Erlang Client

2016-11-16 Thread Vikram Lalit
Hi - I am trying to leveraging CRDT sets to store chat messages that my distributed Riak infrastructure would store. Given the intrinsic conflict-resolution, I thought this might be more beneficial than me putting together a merge implementation based on the causal context. However, my data model

Re: Associating Riak CRDT Sets to Buckets / Keys via Erlang Client

2016-11-17 Thread Vikram Lalit
:40, Vikram Lalit wrote: > >> Hi - I am trying to leveraging CRDT sets to store chat messages that my >> distributed Riak infrastructure would store. Given the intrinsic >> conflict-resolution, I thought this might be more beneficial than me >> putting together a merge impl