Re: Riak performance on GET operations (was "LevelDB read performance)

2012-07-29 Thread Rapsey
A map reduce job is a batch request. It takes in a list of {Bucket,Key} pairs and returns the result. Though writing map reduce in the erlang PB client is not exactly as nice as one would think. This is the function I use: % P = riak connection % B = bucket % LI = list of keys mget_bin(P,B,LI) ->

Re: Python Riak Crash on get_keys()

2012-07-31 Thread Rapsey
Anything in error logs? Last time this happened to me I did not have ulimit -n set to a high enough number Sergej On Tue, Jul 31, 2012 at 9:47 AM, idmartin wrote: > Not sure if anyone else is running into this... my bucket size isnt too > big, > 4 keys or so. I need to reiterate through al

Re: Multiget

2012-09-23 Thread Rapsey
Map reduce starts out as a multiget. If your reduce function is a union of all data and map is an identity you just have a multiget. What I use: B - bucket, LI - list of keys mget_bin(P,B,LI) -> case riakc_pb_socket:mapred(P,[{B,key(Key)} || Key <- LI], [{reduce, {modfun, riak_kv_mapreduce, redu

Re: Logging chat messages

2012-10-22 Thread Rapsey
On Mon, Oct 22, 2012 at 10:29 AM, Shashwat Srivastava wrote: > > Now, each bucket would have conversation between two users or of a room of > a site. The conversation rate for (some) rooms is very high, some 20,000 - > 30,000 messages per hour. We have observed that users usually don't access > co

Re: Logging chat messages

2012-10-22 Thread Rapsey
with a simple 2i >> index (integer index MMDD for the message date so you can search day by >> day backward), and for the message sequence or identifier you could either >> user ANY SQL database sequence or a UUID generator. >> >> HTH, >> >> Guido.

Re: Transfer database to new machines fail

2012-12-07 Thread Rapsey
Attach to riak: riak attach run this: os:cmd("ulimit -n"). Sergej On Fri, Dec 7, 2012 at 7:45 AM, kser wrote: > I enter ulimit. > return: unlimited > > I also cat /proc/sys/fs/file-max > return: 407441 > > I followed this guide and increase the limit to 81788200 > > http://www.cyberciti.biz/f

erlang_protobuffs library error

2012-01-02 Thread Rapsey
hello, I've been trying to use the erlang_protobuffs library but the scan_file function always crashes. protobuffs_compile:scan_file("../test/erlang_protobuffs_SUITE_data/simple.proto"). =INFO REPORT 31-Dec-2011::19:03:38 === Writing header file to "simple_pb.hrl" ** exception error: no matc

Re: erlang_protobuffs library error

2012-01-02 Thread Rapsey
Found the problem. pokemon_pb file does not get compiled with debug_info which is needed for it to work. rebar.config file is missing this line: {erl_opts, [debug_info]}. Sergej On Mon, Jan 2, 2012 at 10:50 AM, Rapsey wrote: > hello, > > I've been trying to use the erlang_prot