Re: How much memory for 20GB of data?

2011-07-14 Thread Will Moss
In that case, Riak adds a minimum of around 500 bytes of overhead per record, but that can grow as the size of the vector clock grows. As Justin mentioned, if N = 3 you'll be storing three copies of the data, so you need at least 60G, but probably closer to 90G. On Thu, Jul 14, 2011 at 4:13 PM, M

Re: How much memory for 20GB of data?

2011-07-14 Thread Maria Neise
Yes, I meant disk space. Sorry -.- Cheers, Maria 2011/7/15 Justin Sheehy : > Do you perhaps mean disk space instead of memory? > > If so, and if you have left the N-val at the default of 3, then you > will need at least 60G of space before any other overhead is accounted > for. > > -Justin > > >

Re: How much memory for 20GB of data?

2011-07-14 Thread Justin Sheehy
Do you perhaps mean disk space instead of memory? If so, and if you have left the N-val at the default of 3, then you will need at least 60G of space before any other overhead is accounted for. -Justin On Thu, Jul 14, 2011 at 7:04 PM, Maria Neise wrote: > Hey, > thank you a lot for your hints

Re: How much memory for 20GB of data?

2011-07-14 Thread Maria Neise
Hey, thank you a lot for your hints. I have 2000 records à 1KB. The key is a string like "user123456789". I am using the default backend bitcask. There is just one machine in the cluster and I didn't change the N-val. I already tried to insert the 20GB of data, but 40GB of memory were obviously

Re: How much memory for 20GB of data?

2011-07-14 Thread Justin Sheehy
Hi, Maria. In addition to what others have said, I would note that (at least) the following issues matter quite a bit for such planning: - how many items the data is broken up into - how large the keys will be (especially if they are very large due to embedded structure) - what storage engine ("b

Re: riaksearch performace when numFound is high

2011-07-14 Thread Greg Pascale
Hi Ryan, Yes we are using 14.2. I think I get what you are saying about inline fields. It looks like it will fix some of our problems, but not all of them. If you'll indulge me in a little contrived example, I think I can explain what I mean. Let's say I'm implementing a simple twitter clone. In

Re: How much memory for 20GB of data?

2011-07-14 Thread Mark Phillips
On Thu, Jul 14, 2011 at 3:09 PM, Will Moss wrote: > If you're planning on using bitcask, this site should be helpful: > http://wiki.basho.com/Bitcask-Capacity-Planning.html Fair warning - this page is slated to be revised per Nico's Meyer's awesome write up. (See this for more details - https://g

Re: How much memory for 20GB of data?

2011-07-14 Thread Will Moss
If you're planning on using bitcask, this site should be helpful: http://wiki.basho.com/Bitcask-Capacity-Planning.html Innostore and LevelDB store the keys on disk, so the minimum overhead would be quite small. On Thu, Jul 14, 2011 at 3:02 PM, Maria Neise wrote: > Hey, > I would like to store 2

How much memory for 20GB of data?

2011-07-14 Thread Maria Neise
Hey, I would like to store 20GB of data with Riak. Does anyone know how much memory Riak would need for that? Cheers, Maria ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Introducing a forked Rekon that does map/reduce

2011-07-14 Thread Brian Rowe
Hello, I made some enhancements to Rekon that I thought the community might be interested in. The primary pay-off is the ability to execute map/reduce jobs over a bucket via Rekon. You can assemble phases together directly from the browser, execute the job, and see the results. The jobs can be any

RE: remote access to Riak

2011-07-14 Thread OJ Reeves
If you're binding to 127.0.0.1 then it will only respond on the loopback address. If this is for dev just change that address to 0.0.0.0 to bind on all network interfaces. HTH OJ Sent from my Windows Phone (yes you read that correctly) From: Maria Neise Sent: Thursday, 14 July 2011 21:12 To: riak

remote access to Riak

2011-07-14 Thread Maria Neise
Hey, I have two instances, a client and a server. On the server I installed Riak. My application (using the Java-API) is running on the client instance. I would like to read and write some data to the server instance. My IP address and port in the app.config on the server instance is 127.0.0.1 and