dealing with binary keys

2013-09-11 Thread Alex Rice
Hi all, I was messing around with basho_bench and I think it created a 'test' bucket with lots of binary keys, not string keys. Using the .NET api (http://corrugatediron.org/) and it fails to delete these keys. Any suggestions how I can get rid of this bucket, aside from stopping all nodes and dele

Re: dealing with binary keys

2013-09-11 Thread Alex Rice
Jeremiah, OK I see- thanks for explaining it. Yeah I will just nuke the data, and will be more careful with basho_bench in the future: On Wed, Sep 11, 2013 at 10:24 AM, Jeremiah Peschka wrote: > If this is a big show stopper for you, let me know and I can see what it > would take to put in a flag

Re: .net corrugatediron q. re: content types

2013-09-11 Thread Alex Rice
into it as > soon as I get a chance. You can track the issue here > https://github.com/DistributedNonsense/CorrugatedIron/issues/171 > > --- > Jeremiah Peschka - Founder, Brent Ozar Unlimited > MCITP: SQL Server 2008, MVP > Cloudera Certified Developer for Apache Hadoop > &

.net corrugatediron q. re: content types

2013-09-11 Thread Alex Rice
Is there a way to trick corrugatediron into serializing a protobuf class for me? I know I can serialize it to byte[] myself and Put that. But I thought setting the ContentType might do the trick, but it looks like it's getting saved as JSON instead. This might be a convenient feature to add. // cr

use Siblings to implement a message queue?

2013-09-11 Thread Alex Rice
Hi I'm very new to Riak. The allow_mult = true / Siblings feature is very interesting. Could it be used to implement a high performance collection like a Queue or Set, in a lock free manner? The Riak docs make it sound like allow_mult is mainly for confict resolution and degenerate cases, rather t

Re: use Siblings to implement a message queue?

2013-09-12 Thread Alex Rice
d tail of the queue (Not so > true for LinkedBlockingQueue) > > And performance of several CRDT for high performance queue I don't actually > think is going to be good. > > If I were to use Riak for my big data environment and would like to match > Riak on a distributed q

short length hash key generation for riak keys?

2013-09-30 Thread Alex Rice
Hi all, coming from a traditional database background of course my first tendency was wanting to auto_increment a primary key somewhere. Not possible with Riak, obviously! :) I was wondering if anyone has a good link or white paper about short length hash key creation. I want to keep my keys short

Re: short length hash key generation for riak keys?

2013-09-30 Thread Alex Rice
Although with 40 bytes per key overhead, which I just read about, perhaps this is somewhat of a ridiculous optimization for me to be attempting to shorten the key size ? :) On Mon, Sep 30, 2013 at 12:20 PM, Alex Rice wrote: > Hi all, coming from a traditional database background of course

Re: short length hash key generation for riak keys?

2013-09-30 Thread Alex Rice
That is awesome! thanks Jeremiah - I really need to take the time to browse through all your stuff on Gitub :) On Mon, Sep 30, 2013 at 12:28 PM, Jeremiah Peschka wrote: > Howdy Alex! > > It's not ludicrous at all since changes in Riak 2.0 should reduce that > overhead to about 13 bytes per key,

Re: short length hash key generation for riak keys?

2013-09-30 Thread Alex Rice
Ah thanks Brian, that's good to know! On Mon, Sep 30, 2013 at 12:40 PM, Brian Sparrow wrote: > In addition to Jeremiah's suggestions I would suggest using single character > bucket names. This will save you loads of memory in the long run as each key > in bitcask has its bucket prepended onto its

Re: Deleting data from LevelDB backend

2013-10-01 Thread Alex Rice
Hi all, so is this a common problem? I was just casually playing around with the LevelDB backend, and observed the disk space was not freed, even though all my keys are deleted. Riak 1.4.2 Thanks ___ riak-users mailing list riak-users@lists.basho.com htt

simplest way to log/trace queries?

2013-10-01 Thread Alex Rice
Hi all, I am using C# corrugatedIron client. I would like to get a verbose log of all of my Riak queries and calls. To help during development. Whether it's on the client side, or on the server side (maybe some lager settings in app.config?) doesnt matter. I have been searching for a way to get thi

rekon question

2013-10-02 Thread Alex Rice
Hi all, if rekon lists "undefined" for all attributes and value of a key, what does that mean? I suspect there are siblings for the key, but it's not clear from how rekon is displaying the info. ___ riak-users mailing list riak-users@lists.basho.com http

Re: simplest way to log/trace queries?

2013-10-02 Thread Alex Rice
Thanks OJ-- as well I happenned to notice this https://github.com/xb95/riak-sniffer But in my case since I'm connecting to Riak Linux cluster mostly from Windows servers, that wouldnt really help. Mostly I'm just trying to debug my own bad code on the client side :) ___

benchmark results on my $75/month 5 node cluster :)

2013-10-02 Thread Alex Rice
Hey, something that is impressive about Riak is how well it performs even on super low end cloud virtualization (unlike for example, couchbase, which hardly runs at all unless you have quad cores per each node) Having so much fun benchmarking, it's really distracting me from coding! the cluster

Re: benchmark results on my $75/month 5 node cluster :)

2013-10-02 Thread Alex Rice
On Wed, Oct 2, 2013 at 12:21 PM, Tom Santero wrote: > Nice. > > Can you share your bb config? Is this against leveldb or bitcask? I'm > assuming leveldb, considering the limited RAM on these instances. If thats > the case, I suggest running your benchmarks for longer than 20 minutes (i.e. > severa

Re: benchmark results on my $75/month 5 node cluster :)

2013-10-02 Thread Alex Rice
On Wed, Oct 2, 2013 at 12:29 PM, Alex Rice wrote: > I am using this in a production environment I am ** considering** using this in a production environment :) ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mail

C# client (CI) questions re: IfNotModified

2013-10-02 Thread Alex Rice
Just trying to make sure I understand what is the proper usage of this option IfNotModified in CI. // (first do a Get of the object) // do a SetObject on the riakobject with my changes var putOpts = new RiakPutOptions () { IfNotModified = true }; // do a Put with those Options When the put fails,

Re: benchmark results on my $75/month 5 node cluster :)

2013-10-02 Thread Alex Rice
On Wed, Oct 2, 2013 at 12:34 PM, Tom Santero wrote: > Yeah, I noticed the "bitcask" in the dropbox url after I sent the email. Be > sure to keep an eye on memory utilization on each node. > > Best of luck generating revenue! Thanks! Here is a 2 hour graph. Seems pretty solid! The only change was

Re: C# client (CI) questions re: IfNotModified

2013-10-02 Thread Alex Rice
using IfNotModified = true. Just wondering if that is to be expected or maybe worth filing an enhancement request on github? Because it's not really a CommunicationError :) Alex On Wed, Oct 2, 2013 at 2:52 PM, Alex Rice wrote: > Just trying to make sure I understand what is the proper usage

Re: rekon question

2013-10-02 Thread Alex Rice
On Wed, Oct 2, 2013 at 3:56 PM, Christopher Meiklejohn wrote: > Hi Alex, > > Can you provide a screenshot of what you are experiencing? Hi Chris, sure- sometimes rekon returns "undefined" strings - I haven't been able to nail down what's causing it. I am guessing it's related to multi / siblings

Re: benchmark results on my $75/month 5 node cluster :)

2013-10-03 Thread Alex Rice
Thanks for the link, James! Windows Azure has an odd SLA- in fact if you read the fine print they dont even offer SLA for individual VMs. They reserve the right to take down individual VMs if they need to do an upgrades of the Host OS. But they offer 'availability zones' so you can make sure only

understanding optimistic concurrency in Riak

2013-10-03 Thread Alex Rice
Just trying to paraphrase how I understand it from the Riak docs, plus helpful feedback from Jeremiah :) Please correct if I'm not really groking it! with allow_multi = false, the default setting - To achieve CAS* -ish behavior for updates, you can always send the vector clock with a Put. If it f

Links, orphaned

2013-10-06 Thread Alex Rice
Hi all, unable to find these in the Riak docs 1) Can someone point me at directions for cleanup of orphaned Links after an object is Deleted from Riak. Post-commit hooks or something? I really hope I dont have to learn Erlang just to clean up bad links after deleting objects! 2) Are links stored

Re: Links, orphaned

2013-10-06 Thread Alex Rice
Eric- thanks for this! I had no idea that Links were not recommended for new deployments, so glad I asked on here :) Alex On Sun, Oct 6, 2013 at 6:19 PM, Eric Redmond wrote: > > On Oct 6, 2013 4:35 PM, "Alex Rice" wrote: >> >> Hi all, unable to find these in the Ri

are Siblings ordered?

2013-10-07 Thread Alex Rice
Are they ordered by timestamp, and is the ordering guaranteed? (within the clock accuracy of course). Using the C# client Thanks, Alex ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.c

Re: are Siblings ordered?

2013-10-07 Thread Alex Rice
> There's no guarantee of return order as far as I know. Since you can't count > on clocks anyway... > > Are you trying to determine which data modifications to apply from multiple > siblings? > > --- > sent from a tiny portion of the hive mind... > in this c

Re: are Siblings ordered?

2013-10-07 Thread Alex Rice
Yeah so it seems oldest/newest is a flawed notion I have to get over! Siblings are so *ZEN* :) On Mon, Oct 7, 2013 at 12:47 PM, Alex Rice wrote: > Yes, exactly that's what I'm working on. By knowing which sibling is > the oldest and which is the newest it seems like I can usua

vm.swappiness ?

2013-10-16 Thread Alex Rice
Just an informal poll- what is preferred for Linux vm.swappiness setting for Riak in a *cloud* environment? The default is 60 - a lot of stuff gets swapped out. This is good for OS disk cache. I am thinking vm.swappiness = 0 - Avoid slow & potentially costly I/O operations in the virtualized envi

Re: vm.swappiness ?

2013-10-16 Thread Alex Rice
Thanks for confirming, Matthew! That might be a good check for the startup script, much like I think it currently complains about ulimit is not set to the Max. On Wed, Oct 16, 2013 at 2:31 PM, Matthew Von-Maszewski wrote: > recommend value for Riak is zero. > > On Oct 16, 2013, at 4:28

Re: Riak and Riak CS Community Survey

2013-10-16 Thread Alex Rice
Hey I would like some swag! Or schwag, or even some bling! Seriously I submitted the survey, but realized later that this is one of the data types I would love to see in Riak: http://redis.io/commands#sorted_set On Tue, Oct 15, 2013 at 2:25 PM, Hector Castro wrote: > Hi everyone, > > We'd since

Re: vm.swappiness ?

2013-10-17 Thread Alex Rice
Aha! thanks for that tip On Wed, Oct 16, 2013 at 3:05 PM, Jared Morrow wrote: > It is checked by 'riak-admin diag' if you run that to check your system. > > -Jared > > > > > On Wed, Oct 16, 2013 at 2:33 PM, Alex Rice wrote: >> >> Thanks for confi

Re: Riak Recap for September 26 - October 25

2013-10-25 Thread Alex Rice
ex.html (for those of you who haven't seen > Salt Stack yet) > > Basho now has a dedicated conference page on Lanyrd, if you're curious where > you can find us next > - http://lanyrd.com/basho/ > > While we're talking about 2.0 and CRDTs at RICON West, Joel Jaco

Re: benchmark results on my $75/month 5 node cluster :)

2013-10-27 Thread Alex Rice
.dropboxusercontent.com/u/22076075/summary-medium-bitcask-5nodes-30-min.png Anyways- back to work for me!!! :) On Wed, Oct 2, 2013 at 12:14 PM, Alex Rice wrote: > Hey, something that is impressive about Riak is how well it performs > even on super low end cloud virtualization (unlike for ex

Re: benchmark results on my $75/month 5 node cluster :)

2013-10-27 Thread Alex Rice
{value_generator, {fixed_bin, 1}}. > {riakc_pb_replies, 1}. > {operations, [{get, 3}, {put, 1} ]}. > ] > > > On 28/10/13 06:35, Alex Rice wrote: >> >> Here is an updated 2 hour graph of the same "X-Small" 5-node cluster, >> after having perfo

Kinetic Open Storage Platform

2013-10-27 Thread Alex Rice
http://arstechnica.com/information-technology/2013/10/seagate-introduces-a-new-drive-interface-ethernet/ that article only mentions Riak in passing in same sentence with Mongo- boo! I noticed the blog post up on basho.com about it. http://basho.com/basho-releases-ekinetic-driver-and-integrated-riak

Re: bitcask issue - write_locked

2013-11-01 Thread Alex Rice
Thanks for the heads-up sounds simple enough to add to the Riak startup script in /etc/init.d On Fri, Nov 1, 2013 at 10:30 AM, Evan Vigil-McClanahan wrote: > I replied to this (accidentally) off-list. For the rest of you folks, > if you want to follow the resolution you can add yourself to the >