Re: Store whole database in memory

2011-05-27 Thread Greg Nelson
Michael, You might want to check out riak_kv_ets_backend, riak_kv_gb_trees_backend, and riak_kv_cache_backend. http://wiki.basho.com/Configuration-Files.html -Greg On Friday, May 27, 2011 at 10:35 PM, Michael McClain wrote: > Hi, > > Is it possible to store the whole database in memory? > In

Store whole database in memory

2011-05-27 Thread Michael McClain
Hi, Is it possible to store the whole database in memory? In a similar way as Redis does. I'm really interested in the distributed map reduce done by riak ("bring processing to the data, instead of data to processors), but I need faster writes/reads that a memory-only database could provide.

Re: riaksearch memory growth issues

2011-05-27 Thread Dan Reverri
What are the steps to reproduce the issue? Thanks, Dan Daniel Reverri Developer Advocate Basho Technologies, Inc. d...@basho.com On Fri, May 27, 2011 at 6:44 PM, Gordon Tillman wrote: > Gilbert I will do that and post the results. Have restarted the cluster > but it is really easy to reprodu

Re: riaksearch memory growth issues

2011-05-27 Thread Gordon Tillman
Gilbert I will do that and post the results. Have restarted the cluster but it is really easy to reproduce the issue. Thanks! --gordon On May 27, 2011, at 20:10 , Gilbert Glåns wrote: > Gordon, > Could you try: > > erlang:process_info(list_to_pid("<0.16614.32>"), [messages, > current_func

Re: riaksearch memory growth issues

2011-05-27 Thread Gilbert Glåns
Gordon, Could you try: erlang:process_info(list_to_pid("<0.16614.32>"), [messages, current_function, initial_call, links, memory, status]). in a riak search console for one/some of those mailboxes and share the results? I am curious to see if you are having the same systemic memory consumption I

riaksearch memory growth issues

2011-05-27 Thread Gordon Tillman
Howdy Gang, We are having a bit of an issue with our 3-node riaksearch cluster. What is happing is this: Cluster is up and running. We start testing our application against it. As the application runs the erlang process consumes more and more memory without ever releasing it. In trying to

Re: Load Balancing With Riak Ruby Client

2011-05-27 Thread Sean Cribbs
This is one thing I desperately want to refactor. The Ruby client still contains some things that reflect my earlier, less astute understanding of how a Riak client should behave and doesn't include obvious things like retrying requests (possibly on other nodes), conflict resolution strategies,

Re: Best practice for using erlang modules in riak?

2011-05-27 Thread Sean Cribbs
Sylvain, Can you try running the job like so? your_mr_job.run do |phase, data| puts { phase => data }.inspect end I'd like to see what, if anything comes back from Riak. Sean Cribbs Developer Advocate Basho Technologies, Inc. http://basho.com/ On May 27, 2011, at 3:16 PM, Sylvain Niles wrot

Riak Recap for May 25 - 26

2011-05-27 Thread Mark Phillips
Afternoon, Evening, Morning to All - Very short Recap for today. Also, it's a holiday in the US on Monday, so I won't be writing a Recap. If anyone out there wants to step up and compile it, that would be great; expect a t-shirt if you embark on this very simple, 20 minute task. Otherwise, Recaps

Load Balancing With Riak Ruby Client

2011-05-27 Thread Keith Bennett
Hi, all. If I have several riak servers on a cluster, and want to distribute load fairly evenly, and am using the Ruby Riak client, what is the best way to balance load? With the HTTP interface, I can randomize the choice of host for a request. How would I do the same with the ruby client? W

Re: Best practice for using erlang modules in riak?

2011-05-27 Thread Sylvain Niles
Still looking for advice on this, additionally I'm looking for the correct way to call the erlang modules from Ripple. I've tried calling it from a reduce like so: reduced = Riak::MapReduce.new(Ripple.client).add(a-bucket').map("function(v){return [[v.values[0].data], [v.bucket, v.key]];}", :keep

Riak Search default_field

2011-05-27 Thread Hagbard Celine
Hi, is there a way to use more than one Field as default_field in Riak Search? Are there specific reasons why it is limited to one only? Thanks Hagbard -- Empfehlen Sie GMX DSL Ihren Freunden und Bekannten und wir belohnen Sie mit bis zu 50,- Euro! https://freundschaftswerbung.gmx.de ___

Re: hidding buckets and keys

2011-05-27 Thread Keith Bennett
Another great reason to insert a layer between your app and riak is that if you should ever change your data storage strategy or support multiple strategies (e.g. support the use of a strategy other than riak) it would minimize or eliminate the need to change the client app. - Keith On May 27,

Re: hidding buckets and keys

2011-05-27 Thread Eric Moritz
Don't trust any client that you put in the hands of someone else. i.e. mobile client, client-side web app, etc. It would take anyone with a packet sniffer 5 seconds to figure out you're using Riak and then they have the Riak docs to step them through how to read/write arbitrary values from your c

Re: about riak gossip issue

2011-05-27 Thread Sean Cribbs
Xinming Yao, Yes, there will potentially be a period where not all nodes agree on the ring, which is why the `riak-admin ringready` command exists. However, in cases of nodes joining and leaving, the new ring is cast to all known nodes in the cluster, which helps speed convergence. Other ring

about riak gossip issue

2011-05-27 Thread yaoxinming
hi: I am a newbie of riak ,I read some code about riak gossip,I find in riak gossip,node only random select a node and send a message to that node, maybe sometime the ring infomation of all nodes will not consistent. for example if there are 6 node(A,B,C,D,E,F),A->B,B->C,C->A and D->E,E->F,F->D a

Re: hidding buckets and keys

2011-05-27 Thread Ben Tilly
I would strongly advise you that mobile clients should not be trusted to access your data directly. Because someone *will* reverse engineer them, and *will* see what they can see. You really do need an API between your mobile application and the mobile service. I know you think you don't. You'r