Riak crashed and crashed again when recovering

2010-05-05 Thread Germain Maurice
Hi all, I am testing Riak for my document base and i got a problem when i was migrating documents from my previous system to Riak. I have two nodes and one bucket for the beginning. There are more than 480 000 documents in the bucket and the documents are html pages. In the following you'll f

Re: Riak crashed and crashed again when recovering

2010-05-05 Thread Germain Maurice
I got other informations when I launched "riak console" on the both nodes, as you can see here. I hope this will be useful for you and then for me :) 10.0.0.40:$ riak console [...] =INFO REPORT 5-May-2010::13:04:48 === Starting handoff of partition 479555224749202520035584085735030365824602

Re: Riak crashed and crashed again when recovering

2010-05-05 Thread Sean Cribbs
Germain, It looks like you're filling up the dets tables -- which have a 2GB limit per file, although Riak uses multiple files, one per vnode. Have you tried the innostore backend? Also if you continue to use dets, try increasing the number of partitions, which will make more, smaller files.

Riak Recap for 5/4

2010-05-05 Thread Mark Phillips
Morning, Afternoon, and Evening - A few orphaned questions from IRC, a new PHP sample app, Riak.js talking to Kiwi, and pointer a new Wiki feature for today's recap. Enjoy - Mark -- Community Manager wiki.basho.com twitter.com/pharkmillups -- Riak Recap for 5/4 1) Q --- The docs st

Hello, Bitcask!

2010-05-05 Thread Justin Sheehy
Riak Users, You might have noticed that we released a new local key/value store recently: http://blog.basho.com/2010/04/27/hello,-bitcask/ As of just now, it is available as a storage engine ("backend") in the tip of the Riak repository. You can use it like any other backend just by setting the

Re: Hello, Bitcask!

2010-05-05 Thread Alvaro Videla
Hi, As many of you know from twitter/irc I've put together a bare bones PHP client for Bitcask: http://github.com/videlalvaro/phpcask If some guys/gals here think that this project might be helpful for someone please let me know, so I can spend some more time on it. To name an example where I

Re: Hello, Bitcask!

2010-05-05 Thread francisco treacy
Great news! I am planning to try it out soon in development. 2010/5/5 Justin Sheehy : > Riak Users, > > You might have noticed that we released a new local key/value store > recently: http://blog.basho.com/2010/04/27/hello,-bitcask/ > > As of just now, it is available as a storage engine ("backend

Re: Riak crashed and crashed again when recovering

2010-05-05 Thread Garrett Smith
Sean, I apologize if this is readily available in the docs, faq, etc. (I obviously missed if it is). When a cluster is repartitioned, e.g. as a result of adding or removing vnodes, is one backend preferable to another? Does keeping node size down help/hurt in terms of performance, reliability, et

Re: Riak crashed and crashed again when recovering

2010-05-05 Thread Sean Cribbs
We haven't often dealt with repartitioning clusters, which is why I recommended a complete backup and restore. The behavior when trying to dynamically change the partition quantity is undefined. Honestly I don't know how the backend would affect it at all. As always, however, adding nodes will incr