Re: erlang go boom

2013-08-05 Thread Paul Ingalls
I added logging into the resolvers to see how frequently I am received siblings, and how many I get when its called. Almost every call has only two siblings, and, although I am definitely creating them, about 10 or so per minute, it seems to be handling that ok. Its not a perfect test though a

RiakNode class in Python client 2.0

2013-08-05 Thread Matt Black
I've been looking through the changes to the RiakClient class - and have a question about the nodes list and RiakNode/Decaying class. It seems that the Decaying class is used internally to track error_rates (request failure_rate?) of nodes in the available pool. In the application I maintain, we'

Re: erlang go boom

2013-08-05 Thread Paul Ingalls
I'm currently using the java client and its ConflictResolver and Mutator interfaces. In some cases I am just doing a store, and letting the client do an implicit fetch and the mutator to make the actual change. In other cases I'm doing an explicit fetch, modify the result, and then a store wit

Re: erlang go boom

2013-08-05 Thread Jeremy Ong
On the client you could extract the value_count of the objects you read and just log them. Feel free to post code too, in particular, how you are writing out updated values. On Mon, Aug 5, 2013 at 9:20 PM, Paul Ingalls wrote: > Interesting. I have sibling resolution code on the client side. Wou

Re: erlang go boom

2013-08-05 Thread Paul Ingalls
Interesting. I have sibling resolution code on the client side. Would sibling explosion take out the entire cluster all at once? Within 5 minutes of my last email, the rest of the cluster died. Is there a way to quickly figure out whether the cluster is full of siblings? Paul Ingalls Founder

Re: erlang go boom

2013-08-05 Thread Evan Vigil-McClanahan
Given your leveldb settings, I think that compaction is an unlikely culprit. But check this out: 2013-08-05 18:01:15.878 [info] <0.83.0>@riak_core_sysmon_ handler:handle_event:92 monitor large_heap <0.14832.557> [{initial_call,{riak_kv_get_fsm,init,1}},{almost_current_function,{riak_object,encode

Re: Installing protobuf 2.5.0 for Riak Python 2.0

2013-08-05 Thread Sean Cribbs
Yes, that page went out before I had a chance to review it. I'll try to get the installation instructions patched this week. On Mon, Aug 5, 2013 at 6:10 PM, Matt Black wrote: > Ah okay, thanks Sean. > > The reason I went down that road is that the docs say you need v2.5: > > http://docs.basho.co

Re: Installing protobuf 2.5.0 for Riak Python 2.0

2013-08-05 Thread Matt Black
Ah okay, thanks Sean. The reason I went down that road is that the docs say you need v2.5: http://docs.basho.com/riak/latest/dev/taste-of-riak/python/ On 31 July 2013 23:05, Sean Cribbs wrote: > Matt, > > For compatibility reasons, we use 2.4.1, which is pinned in the > requirements of the ri

Re: erlang go boom

2013-08-05 Thread Paul Ingalls
I watched top on all the instances when things started to fall apart. This is what I saw… Everything was jamming along just fine. CPU usage was about 25%, ram usage was about 25% (3 of the 7 were at about 15%). Suddenly, CPU usage spikes to over 50% and ram usage spikes to 80-90% (and I'm gu

Re: erlang go boom

2013-08-05 Thread Paul Ingalls
Hey Kresten, Thanks for the response! I learned my lesson on setting bucket properties. So all buckets currently use the defaults. here is the output from one of our nodes: total 40 drwxr-xr-x 2 root root 4096 Aug 5 21:10 ./ drwxr-xr-x 6 root root 4096 Aug 4 17:26 ../ -rw-r--r-- 1 root ro

riak control post upgrade

2013-08-05 Thread Paul Ingalls
Hope you all don't get pissed for me spamming the list….;) I upgraded my cluster to 1.4.1 in hopes the levelDB changes may help. The cluster is now up and running, however Riak Control is complaining: The following nodes are currently incompatible with Riak Control: I googled around and saw t

Re: erlang go boom

2013-08-05 Thread Kresten Krab Thorup
I'd think the large #buckets could be the issue; especially if there is any bucket properties being set, because that would cause the ring data structure to be enormous. Could you provide an "ls -l" output of the riak data/ring directory? Sent from my iPhone On 05/08/2013, at 21.52, "Paul Inga

Re: [ANN] Riak 1.4.1

2013-08-05 Thread Paul Ingalls
Looks like I had to run make distclean BEFORE checking out the 1.4.1 tag... Paul Ingalls Founder & CEO Fanzo p...@fanzo.me @paulingalls http://www.linkedin.com/in/paulingalls On Aug 5, 2013, at 1:32 PM, Chris Meiklejohn wrote: > Hi Paul, > > Can you confirm that everything was removed from /

Re: [ANN] Riak 1.4.1

2013-08-05 Thread Chris Meiklejohn
Hi Paul, Can you confirm that everything was removed from /home/fanzo/riak/deps after running make distclean? It appears that there's an older riak_kv still hanging around there. Sometimes rebar delete-deps, which is what is triggered by distclean, fails to clean up dependencies when they have b

Re: [ANN] Riak 1.4.1

2013-08-05 Thread Paul Ingalls
When I try to checkout the tag to build the source, and then run make rel I get the following error: ERROR: Dependency dir /home/fanzo/riak/deps/riak_kv failed application validation with reason: {version_mismatch,{"/home/fanzo/riak/deps/riak_kv/src/riak_kv.app.src", {expected

Re: [ANN] Riak 1.4.1

2013-08-05 Thread Chris Meiklejohn
Correct link to the release notes [1]. Apologies. [1] https://github.com/basho/riak/blob/1.4/RELEASE-NOTES.md - Chris On Mon, Aug 5, 2013 at 1:04 PM, Christopher Meiklejohn < cmeiklej...@basho.com> wrote: > Riak Users, > > We are pleased to announce a bugfix release on the Riak 1.4 series >

[ANN] Riak 1.4.1

2013-08-05 Thread Christopher Meiklejohn
Riak Users, We are pleased to announce a bugfix release on the Riak 1.4 series addressing issues with Riak Control, Secondary Indexes and LevelDB. The release notes for Riak can be found here: https://github.com/basho/riak/blob/1.4/RE LEASE-NOTES.md The packages can be found here: http://docs.

erlang go boom

2013-08-05 Thread Paul Ingalls
As promised in previous email, I hit a fairly big problem over the weekend and then reproduced it this morning and I was wondering if I could get some help. Basically, I was running my code against our risk cluster and everything was moving along just fine. However, at some point Riak just seem

Backup/restore progress/ETA?

2013-08-05 Thread Justin
Hello all, Is there any way to determine progress/percent complete? This has been running for 3 days now. I figured it would finish over the weekend but it hasn't. # riak-admin restore riak@ riak /var/lib/riak/backups/all_nodes.20130725.bak Restoring from '/var/lib/riak/backups/all_nodes.2013072

[ANN] Yokozuna 0.8.0

2013-08-05 Thread Ryan Zezeski
Riak Users, The eighth release of Yokozuna is out. It is now considered alpha and will soon become part of Riak proper. There could still be breaking changes leading up to the 1.0.0 release which is currently scheduled for early October. The main things of interest this release are the re-targe

RICON code contest and Riak training

2013-08-05 Thread Hector Castro
Hi everyone, We wanted to single out two RICON announcements: ## RICON code contest We're putting up *five free* tickets to RICON West. If you want one, here's what you need to do: - Write a sample app leveraging either Counters or Yokozuna - Write a packaging/deployment tool with BOSH or Packe

Re: performance

2013-08-05 Thread John Daily
Keep in mind that, apart from custom settings, buckets are just a prefix on keys, so you could create your own "buckets" by just adding the strings directly to your keys. Your current solution is effectively doing that, but keep that option in mind if you decide you need another 50k buckets wit

Re: performance

2013-08-05 Thread Paul Ingalls
We are creating a lot of buckets because I needed the extra namespace. My alternative was constantly updating a value, which in some cases would grow the value very large. I figured keeping the key/value groups small would be quite a bit faster, and since the docs said you could have as many b

Riak 1.3.1 Errors

2013-08-05 Thread Shane McEwan
G'day! Nearly every day since upgrading to Riak 1.3.1 I've been seeing the following errors on random nodes: 2013-08-05 01:00:05.775 [error] <0.212.0> Supervisor riak_pipe_fitting_sup had child undefined started with riak_pipe_fitting:start_link() at <0.26698.882> exit with reason noproc in

Re: memory consumption

2013-08-05 Thread Evan Vigil-McClanahan
Before I'd done the research, I too thought that the overheads were a much lower, near to what the calculator said, but not too far off. There are a few things that I plan on addressing this release cycle: - 16b per-allocation overhead from using enif_alloc. This allows us a lot of flexibility

Re: memory consumption

2013-08-05 Thread Alexander Ilyin
Evan, News about per key overhead of 91 bytes are quite frustrating. When we were choosing a key value storage per key metadata size was a crucial point for us. We have a simple use case but a lot of data (hundreds of millions of items) so we were looking for the ways to reduce memory consumption.