Re: counter crdt in riak

2015-10-20 Thread Russell Brown
On 21 Oct 2015, at 04:56, David Byron wrote: > Apologies if this is basic question, or one that's already been answered. > I've done a fair amount of digging (e.g. > http://thread.gmane.org/gmane.comp.db.riak.user/12808/focus=12816), but I'm > still confused about the documentation regarding

Re: counter crdt in riak

2015-10-20 Thread David Byron
On 10/20/15 9:26 PM, xia...@xiaclo.net wrote: This gives a little more detail about each of the CRDT types: https://github.com/basho/riak/issues/354 Thanks much. That link is very helpful. Your assumptions are correct. Within Riak, an actor is a vnode, and counters behave as G-Counters. K

Re: ERROR: S3 error: 403 (AccessDenied): Access Denied with s3cmd

2015-10-20 Thread Devin Butterfield
Sorry, please disregard. After careful double-checking I found an error in my stanchion.conf. Fixed, restarted and now all is working great. Thanks for the awesome work on risk-cs/s2! — Regards, Devin > On Oct 20, 2015, at 10:21 PM, Devin Butterfield > wrote: > > Hi, > > I’ve setup risk-cs

ERROR: S3 error: 403 (AccessDenied): Access Denied with s3cmd

2015-10-20 Thread Devin Butterfield
Hi, I’ve setup risk-cs (2.1.0) on a linux (ubuntu 15.04) box to start learning and followed the Riak Fast Track guide. I am trying to use s3cmd (version 1.5.0-rc1) to interact with riak-cs in a proxy configuration (not direct). However, any attempt to create a bucket fails with 403. My s3cmd co

Re: counter crdt in riak

2015-10-20 Thread xiaclo
This gives a little more detail about each of the CRDT types: https://github.com/basho/riak/issues/354Your assumptions are correct. Within Riak, an actor is a vnode, and counters behave as G-Counters.Keep in mind that Riak counters store both an increment and decrement for each actor, which allows

counter crdt in riak

2015-10-20 Thread David Byron
Apologies if this is basic question, or one that's already been answered. I've done a fair amount of digging (e.g. http://thread.gmane.org/gmane.comp.db.riak.user/12808/focus=12816), but I'm still confused about the documentation regarding conflict resolution for riak's crdt counter. Specific

Re: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Alex Moore
Hi Dennis & Mark, I noticed some timing code in your snippets: long beforeProcessing = DateTime.Now.Ticks; Do you have any numbers on what an individual operation for KV vs CRDTs looks like on your system? (Mean, percentiles if possible) Also, how big are your KV objects? CRDTs will take extra

Riak in Docker - Error folding keys - incomplete_hint

2015-10-20 Thread Toby Corkindale
Hi, I've been working on getting Riak to run inside Docker containers - in a multi-machine cluster. (Previous work I've seen has only run Riak as a cluster all on the same machine.) I thought I had it cracked, although I tripped up on the existing issue with Riak and lockfiles[1]. But the nodes ha

RE: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Dennis Nicolay
ResultObject cdr; while (queued.TryDequeue(out cdr)) { long beforeProcessing = DateTime.Now.Ticks; UpdateMap.Builder builder = BuildMapObject(bucket, cdr); UpdateMap cmd = build

Re: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Christopher Mancini
Hi Mark / Dennis, Can you provide the snippet of the code that puts a 5k record onto Riak as a map? Chris On Tue, Oct 20, 2015 at 11:30 AM Mark Schmidt wrote: > Hi folks, sorry for the confusion. > > > > Our scenario is as follows: > > > > We have a 6 node development cluster running on its ow

RE: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Mark Schmidt
Hi folks, sorry for the confusion. Our scenario is as follows: We have a 6 node development cluster running on its own network segment using HAProxy to facilitate load-balancing across the nodes. A single Riak-dot-NET client service is performing the insert operations from dedicated hardw

Re: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Alexander Sicular
Let's talk about Riak data types for a moment. Riak data types are collectively implementations of what academia refer to as CRDT's (convergent or conflict free replicated data types.) The key benefit a CRDT offers, over a traditional KV by contrast, is in automatic conflict resolution. The vari

RE: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Dennis Nicolay
Hi Alexander, I’m parsing the file and storing each row with own key in a map datatype bucket and each column is a register. Thanks, Dennis From: Alexander Sicular [mailto:sicul...@gmail.com] Sent: Tuesday, October 20, 2015 10:34 AM To: Dennis Nicolay Cc: Christopher Mancini; riak-

Re: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Alexander Sicular
Hi Dennis, It's a bit unclear what you are trying to do here. Are you 1. uploading the entire file and saving it to one key with the value being the file? Or are you 2. parsing the file and storing each row as a register in a map? Either of those approaches are not appropriate in Riak KV. For

Riak S2 2.1 is available

2015-10-20 Thread Matthew Brender
Hello all, Riak S2 2.1 (aka Riak CS) is available. Thanks to all who made it happen! Here are the highlights of the release: * New metrics that enable you to determine the health of your Riak S2 system, as well as get reports on your storage utilization per bucket or user. * Garbage collection re

Re: Using Bucket Data Types slowed insert performance

2015-10-20 Thread Christopher Mancini
Hi Dennis, I am not the most experienced, but what I do know is that a file that size causes a great deal of network chatter because it has to handoff that data to the other nodes in the network and will cause delays in Riak's ability to send and confirm consistency across the ring. Typically we r

Using Bucket Data Types slowed insert performance

2015-10-20 Thread Dennis Nicolay
Hi, I'm using .net RiakClient 2.0 to insert a 44mb delimited file with 139k rows of data into riak. I switched to a map bucket data type with registers. It is taking about 3 times longer to insert into this bucket vs non data typed bucket. Any suggestions? Thanks in advance, Dennis